Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Is there a way to check for duplicate values in Excel WITHOUT using the CountIf function?

A lot of the solutions here on SO involve using CountIf to find duplicates. When I have a list of 100,000+ values however, it will often take minutes for CountIf to search for duplicates.

Is there a quicker way to search for duplicates within an Excel column WITHOUT using CountIf?

Thanks!

EDIT #1:
After reading the comments and replies I realize I need to go into greater detail. Let's pretend I'm a birdwatcher, and after I return from a birdwatching trip I input anywhere from 1 to 25 or 50 new birds that I saw on my trip into my "Master List of Birds Seen". This is really a dynamically growing list, and with each addition I want to make sure I'm not duplicating something that already exists in my list.

So, in column A of my file are the names of the birds. Column B-M might contain other attributes of the birds. I want to know if a bird that I just added in column A after my latest birdwatching trip ALREADY exists somewhere ELSE in my list. And, if it does, I would manually merge the data of the 2 entries and throw away some and keep some after careful review. I clearly don't want to have duplicate entries of the same bird in my database.

So, ultimately I want some indication that there is or isn't a duplicate somewhere else, and if there is duplicate please tell me what row to look in (or highlight or color both of the duplicates).

like image 315
phan Avatar asked Mar 09 '12 17:03

phan


People also ask

How do I get Excel to automatically find duplicates?

Highlight the Transaction ID column, goto Home menu, then Conditional Formatting, then Highlight Cell Rules and, finally, Duplicate Values. Set the formatting to show up on duplicate IDs found. Result is shown below. The cashier is right.

How do you locate duplicates in Excel without deleting them?

If you simply want to find duplicates, so you can decide yourself whether or not to delete them, your best bet is highlighting all duplicate content using conditional formatting. Select the columns you want to check for duplicate information, and click Home > Highlight Cell Rules > Duplicate Values.

How do you find duplicates in Excel using Vlookup?

Search & Find Duplicate Data Just create the formula =VLOOKUP(List-1, List-2,True,False) and add it to a third column. The List-1 data will be searched in List-2. If there are any duplicates, then these will be listed in the third column where the formula was placed.


1 Answers

The fastest way that I know of (in case you are using Excel 2007/2010/2011) is to use Data (In Ribbon) | Remove Duplicates to find the total number of duplicates OR to remove duplicates. You might want to move data to a temp sheet before you test this.

The 2nd fastest way is to use Countif. Now Countif can be used in many ways to find duplicates. Here are two main ways.

1) Inserting a New Column next to the data and putting the formula and simply copying it down.

2) Using Countif in Conditional formatting to highlight cells which are duplicates. For more details, please see this link.

suggestions for a macro to find duplicates in a SINGLE column

EDIT:

My Apologies :)

Countif is the 3rd fastest way!

The 2nd fastest way is to use Pivot Tables ;)

What exactly is your main purpose of finding duplicates? Do you want to delete them? Or Do you want to highlight them? Or something else?

FOLLOWUP

Seems like I made a typo in the formula. Yes for large number of rows, CountIf does take minutes as you suggested.

Let me see if I can come up with a VBA code to suit your exact needs.

Sid

like image 94
Siddharth Rout Avatar answered Oct 19 '22 03:10

Siddharth Rout