To select duplicate values, you need to create groups of rows with the same values and then select the groups with counts greater than one. You can achieve that by using GROUP BY and a HAVING clause.
The query uses window version of COUNT aggregate function: the function is applied over Col1 partitions. The outer query filters out records which have a Col1 value that appears only once. Show activity on this post.
To show an example of what others have been describing:
SELECT
Col1, -- All of the columns you want to dedupe on
Col2, -- which is not neccesarily all of the columns
Col3, -- in the table
Col4,
Col5,
Col6,
Col7,
Col8,
Col9,
Col10
FROM
MyTable
GROUP BY
Col1,
Col2,
Col3,
Col4,
Col5,
Col6,
Col7,
Col8,
Col9,
Col10
HAVING
COUNT(*) > 1
You can use group by
on all columns and then count(*)>1
Try this
Select * From Table
Group By [List all fields in the Table here]
Having Count(*) > 1
To detect, just group by as Guge said.
select fieldA, fieldB, count(*) from table
group by fieldA, fieldB
having count(*) > 1
If you want to delete dupes... pseudo....
select distinct into a temp table
truncate original table
select temp table back into original table
With truncate you may run into problems if you have FK constraints, so be smart about dropping constraints and making sure you don't orphan records.
In addition to the suggestions provided, I would then go to the effort of preventing duplicates in the future, rather than trying to locate them later.
This is done using unique indexes on columns (or groups of columns) that are supposed to be unique. Remember that data in the database can be modified from other locations other than through the specific app that you are working on, so it's best to define what is and isn't allowed in a table at the DB level.
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With