How to find duplicates in Excel: identify, highlight, count, filter

The tutorial explains how to search for duplicates in Excel. You will learn a few formulas to identify duplicate values or find duplicate rows with or without first occurrences. You will also learn how to count instances of each duplicate record individually and find the total number of dupes in a column, how to filter out duplicates, and more.

While working with a large Excel worksheet or consolidating several small spreadsheets into a bigger one, you may find lots of duplicate rows in it. In one of our previous tutorials, we discussed various ways to compare two tables or columns for duplicates.

And today, I'd like to share a few quick and effective methods to identify duplicates in a single list. These solutions work in all versions of Excel 365, Excel 2021, Excel 2019, Excel 2016, Excel 2013 and lower.

How to identify duplicates in Excel

The easiest way to detect duplicates in Excel is using the COUNTIF function. Depending on whether you want to find duplicate values with or without first occurrences, there's going to be a slight variation in the formula as shown in the following examples.

How to find duplicate records including 1st occurrences

Supposing you have a list of items in column A that you want to check for duplicates. These can be invoices, product Id's, names or any other data.

Here's a formula to find duplicates in Excel including first occurrences (where A2 is the topmost cell):

=COUNTIF(A:A, A2)>1

Input the above formula in B2, then select B2 and drag the fill handle to copy the formula down to other cells:
A formula to identify duplicates including 1st occurrences

As you can see in the screenshot above, the formula returns TRUE for duplicate values and FALSE for unique values.

Note. If you need to find duplicates in a range of cells rather than in an entire column, remember to lock that range with the $ sign. For example, to search for duplicates in cells A2:A8, use this formula:
=COUNTIF($A$2:$A$8, A2)>1

For a duplicate formula to return something more meaningful than the Boolean values of TRUE and FALSE, enclose it in the IF function and type any labels you want for duplicate and unique values:

=IF(COUNTIF($A$2:$A$8, $A2)>1, "Duplicate", "Unique")
An improved formula to identify duplicate and unique values in Excel

In case, you want an Excel formula to find duplicates only, replace "Unique" with an empty string ("") like this:

=IF(COUNTIF($A$2:$A$8, $A2)>1, "Duplicate", "")

The formula will return "Duplicates" for duplicate records, and a blank cell for unique records:
A formula to identify duplicates only

How to search for duplicates in Excel without 1st occurrences

In case you plan to filter or remove duplicates after finding them, using the above formula is not safe because it marks all identical records as duplicates. And if you want to keep the unique values in your list, then you cannot delete all duplicate records, you need to only delete the 2nd and all subsequent instances.

So, let's modify our Excel duplicate formula by using absolute and relative cell references where appropriate:

=IF(COUNTIF($A$2:$A2, $A2)>1, "Duplicate", "")

As you can see in the following screenshot, this formula does not identity the first occurrence of "Apples" as duplicate:
A formula to search for duplicates without 1st occurrences

How to find case-sensitive duplicates in Excel

In situations when you need to identify exact duplicates including the text case, use this generic array formula (entered by pressing Ctrl + Shift + Enter):

IF( SUM(( --EXACT(range, uppermost _cell)))<=1, "", "Duplicate")

At the heart of the formula, you use the EXACT function to compare the target cell with each cell in the specified range exactly. The result of this operation is an array of TRUE (match) and FALSE (not match), which is coerced to an array of 1's and 0's by the unary operator (--). After that, the SUM function adds up the numbers, and if the sum is greater than 1, the IF function reports a "Duplicate".

For our sample dataset, the formula goes as follows:

=IF(SUM((--EXACT($A$2:$A$8,A2)))<=1,"","Duplicate")

As shown in the screenshot below, it treats lowercase and uppercase as different characters (APPLES is not identified as a duplicate):
Identifying case-sensitive duplicates in Excel

Tip. If you are using Google spreadsheets, the following article might be helpful: How to find and remove duplicates in Google Sheets.

How to find duplicate rows in Excel

If your aim is to dedupe a table consisting of several columns, then you need a formula that can check each column and identify only absolute duplicate rows, i.e. rows that have completely equal values in all columns.

Let's consider the following example. Supposing, you have order numbers in column A, dates in column B, and ordered items in column C, and you want to find duplicate rows with the same order number, date and item. For this, we are going to create a duplicate formula based on the COUNTIFS function that allows checking multiple criteria at a time:

To search for duplicate rows with 1st occurrences, use this formula:

=IF(COUNTIFS($A$2:$A$8,$A2,$B$2:$B$8,$B2,$C$2:$C$8,$C2)>1, "Duplicate row", "")

The following screenshot demonstrates that the formula really locates only the rows that have identical values in all 3 columns. For example, row 8 has the same order number and date as rows 2 and 5, but a different item in column C, and therefore it is not marked as duplicate row:
A formula to find duplicate rows in Excel

To show duplicate rows without 1st occurrences, make a little adjustment to the above formula:

=IF(COUNTIFS($A$2:$A2,$A2,$B$2:$B2,$B2,$B$2:$B2,$B2,$C$2:$C2,$C2,) >1, "Duplicate row", "")
Show duplicate rows without 1st occurrences.

How to count duplicates in Excel

If you want to know the exact number of identical records in your Excel sheet, use one of the following formulas to count duplicates.

Count instances of each duplicate record individually

When you have a column with duplicated values, you may often need to know how many duplicates are there for each of those values.

To find out how many times this or that entry occurs in your Excel worksheet, use a simple COUNTIF formula, where A2 is the first and A8 is the last item of the list:

=COUNTIF($A$2:$A$8, $A2)

As demonstrated in the following screenshot, the formula counts the occurrences of each item: "Apples" occurs 3 times, "Green bananas" - 2 times, "Bananas" and "Oranges" only once.
The COUNTIF formula to count instances of each duplicate record individually

If you want to identify 1st, 2nd, 3rd, etc. occurrences of each item, use the following formula:

=COUNTIF($A$2:$A2, $A2)

Identify the 1st, 2nd, 3rd, etc. occurrences of each duplicate item.

In a similar manner, you can count the occurrences of duplicated rows. The only difference is that you will need to use the COUNTIFS function instead of COUNTIF. For example:

=COUNTIFS($A$2:$A$8, $A2, $B$2:$B$8, $B2)

The COUNTIFS formula to count the occurrences of duplicate rows

Once the duplicate values are counted, you can hide unique values and only view duplicates, or vice versa. To do this, apply Excel's auto-filter as demonstrated in the following example: How to filter out duplicates in Excel.

Count the total number of duplicates in a column(s)

The easiest way to count duplicates in a column is to employ any of the formulas we used to identify duplicates in Excel (with or without first occurrences). And then you can count duplicate values by using the following COUNTIF formula:

=COUNTIF(range, "duplicate")

Where "duplicate" is the label you used in the formula that locates duplicates.

In this example, our duplicate formula takes the following shape:

=COUNTIF(B2:B8, "duplicate")

Count the total number of duplicates in a column.

Another way to count duplicate values in Excel by using a more complex array formula. An advantage of this approach is that it does not require a helper column:

=ROWS($A$2:$A$8)-SUM(IF( COUNTIF($A$2:$A$8,$A$2:$A$8)=1,1,0))

Because it's an array formula, remember to press Ctrl + Shift + Enter to complete it. Also, please keep in mind that this formula counts all duplicate records, including first occurrences:
An array formula to count duplicates in Excel

To find the total number of duplicate rows, embed the COUNTIFS function instead of COUNTIF in the above formula, and specify all of the columns you want to check for duplicates. For example, to count duplicate rows based on columns A and B, enter the following formula in your Excel sheet:

=ROWS($A$2:$A$8)-SUM(IF( COUNTIFS($A$2:$A$8,$A$2:$A$8, $B$2:$B$8,$B$2:$B$8)=1,1,0))

An array formula to count duplicate rows

How to filter duplicates in Excel

For easier data analysis, you may want to filter your data to only display duplicates. In other situations, you may need the opposite - hide duplicates and view unique records. Below you will find solutions for both scenarios.

How to show and hide duplicates in Excel

If you want to see all duplicates at a glance, use one of the formulas to find duplicates in Excel that better suits your needs. Then select your table, switch to the Data tab, and click the Filter button. Alternatively, you can click Sort & Filter > Filter on the Home tab in the Editing group.

Apply Excel's auto filter to a table with identified duplicates

Tip. To have filtering enabled automatically, convert your data to a fully-functional Excel table. Just select all data and press the Ctrl + T shortcut.

After that, click the arrow Filtering arrow in the header of the Duplicate column and check the "Duplicate row" box to show duplicates. If you want to filter out, i.e. hide duplicates, select "Unique" to view only unique records:

Filtering out duplicates in Excel

And now, you can sort duplicates by the key column to group them for easier analysis. In this example, we can sort duplicate rows by the Order number column:
Sort duplicate rows for easier analysis.

How to filter duplicates by their occurrences

If you want to show 2nd, 3rd, or Nth occurrences of duplicate values, use the formula to count duplicate instances we discussed earlier:

=COUNTIF($A$2:$A2, $A2)

Then apply filtering to your table and select only the occurrence(s) you want to view. For example, you can filter the 2nd occurrences like in the following screenshot:
Use the formula to count duplicate instances and then filter the occurrences you want to view.

To display all duplicate records, i.e. occurrences greater than 1, click the filter arrow in the header of the Occurrences column (the column with the formula), and then click Number Filters > Greater Than.
Filter out all duplicate records.

Select "is greater than" in the first box, type 1 in the box next to it, and click the OK button:
Filter duplicate occurrences greater than 1.

In a similar manner, you can show 2nd, 3rd and all subsequent duplicate occurrences. Just type the required number in the box next to "is greater than".

Highlight, select, clear, delete, copy or move duplicates

After you've filtered duplicates like demonstrated above, you have a variety of choices to deal with them.

How to select duplicates in Excel

To select duplicates, including column headers, filter them, click on any filtered cell to select it, and then press Ctrl + A.

To select duplicate records without column headers, select the first (upper-left) cell, and press Ctrl + Shift + End to extend the selection to the last cell.

Tip. In most cases, the above shortcuts work fine and select filtered (visible) rows only. In some rare cases, mostly on very large workbooks, both visible and invisible cells may get selected. To fix this, use one of the above shortcuts first, and then press Alt + ; to select only visible cells, ignoring hidden rows.

How to clear or remove duplicates in Excel

To clear duplicates in Excel, select them, right click, and then click Clear Contents (or click the Clear button > Clear Contents on the Home tab, in the Editing group). This will delete the cell contents only, and you will have empty cells as the result. Selecting the filtered duplicate cells and pressing the Delete key will have the same effect.

To remove entire duplicate rows, filter duplicates, select the rows by dragging the mouse across the row headings, right click the selection, and then choose Delete Row from the context menu.

Removing entire duplicate rows in Excel

How to highlight duplicates in Excel

To highlight duplicate values, select the filtered dupes, click the Fill color button Fill Color button on the Home tab, in the Font group, and then select the color of your choosing.

Another way to highlight duplicates in Excel is using a built-in conditional formatting rule for duplicates, or creating a custom rule specially tailored for your sheet. Experienced Excel users won't have any problem with creating such a rule based on the formulas we used to check duplicates in Excel. If you are not very comfortable with Excel formulas or rules yet, you will find the detailed steps in this tutorial: How to highlight duplicates in Excel.

How to copy or move duplicates to another sheet

To copy duplicates, select them, press Ctrl + C, then open another sheet (a new or existing one), select the upper-left cell of the range where you want to copy the duplicates, and press Ctrl + V to paste them.

To move duplicates to another sheet, perform the same steps with the only difference that you press Ctrl + X (cut) instead of Ctrl + C (copy).

Duplicate Remover - fast and efficient way to locate duplicates in Excel

Now that you know how to use duplicate formulas in Excel, let me demonstrate you another quick, efficient and formula-free way - Duplicate Remover for Excel.

This all-in-one tool can search for duplicate or unique values in a single column or compare two columns. It can find, select and highlight duplicate records or entire duplicate rows, remove found dupes, copy or move them to another sheet. I think an example of practical use is worth many words, so let's get to it.

How to find duplicate rows in Excel in 2 quick steps

To test the capabilities of our Duplicate Remover add-in, I've created a table with a few hundred rows that looks like follows:
An Excel table to search for duplicates

As you see, the table has a few columns. The first 3 columns contain the most relevant information, so we are going to search for duplicate rows based solely on the data in columns A - C. To find duplicate records in these columns, just do the following:

  1. Select any cell within your table and click the Dedupe Table button on the Excel ribbon. After installing our Ultimate Suite for Excel, you will find it on the Ablebits Data tab, in the Dedupe group.
    Click the Dedupe Table button to quickly find duplicates in a list.
  2. The smart add-in will pick up the entire table and ask you to specify the following two things:
    • Select the columns to check for duplicates (in this example, these are the Order no., Order date and Item columns).
    • Choose an action to perform on duplicates. Because our purpose is to identify duplicate rows, I've selected the Add a status column
      Select the column(s) to check for duplicates and choose an action.

    Apart from adding a status column, an array of other options are available to you:

    • Delete duplicates
    • Color (highlight) duplicates
    • Select duplicates
    • Copy duplicates to a new worksheet
    • Move duplicates to a new worksheet

    Click the OK button and wait for a few seconds. Done!

As you can see in the below screenshot, all of the rows that have identical values in the first 3 columns have been located (first occurrences are not identified as duplicates).
Duplicate rows have been successfully identified.

If you want more options to dedupe your worksheets, use the Duplicate Remover wizard that can find duplicates with or without first occurrences as well as unique values. The detailed steps follow below.

Duplicate Remover wizard - more options to search for duplicates in Excel

Depending on a particular sheet you are working with, you may or may not want to treat the first instances of identical records as duplicates. One possible solution is using a different formula for each scenario, as we discussed in How to identify duplicates in Excel. If you are looking for a fast, accurate and formula-free method, try the Duplicate Remover wizard:

  1. Select any cell within your table and click the Duplicate Remover button on the Ablebits Data tab. The wizard will run and the entire table will get selected.
    Duplicate Remover wizard - advanced search for duplicates in Excel
  2. On the next step, you are presented with the 4 options to check duplicates in your Excel sheet:
    • Duplicates without 1st occurrences
    • Duplicates with 1st occurrences
    • Unique values
    • Unique values and 1st duplicate occurrences

    For this example, let's go with the second option, i.e. Duplicates + 1st occurrences:
    Choose to find duplicates and 1st occurrences.

  3. Now, select the columns where you want to check duplicates. Like in the previous example, we are selecting the first 3 columns:
    Select the columns where you want to check duplicates.
  4. Finally, choose an action you want to perform on duplicates. As is the case with the Dedupe Table tool, the Duplicate Remover wizard can identify, select, highlight, delete, copy or move duplicates.

    Because the purpose of this tutorial is to demonstrate different ways to identify duplicates in Excel, let's check the corresponding option and click Finish:
    Choose an action you want to perform on duplicates.

It only takes a fraction of a second for the Duplicate Remover wizard to check hundreds of rows, and deliver the following result:
Hundreds of rows have been checked and duplicates located.

No formulas, no stress, no errors - always swift and impeccable results :)

If you are interested to try these tools to find duplicates in your Excel sheets, you are most welcome to download an evaluation version below. Your feedback in comments will be greatly appreciated!

Available downloads

Identify Duplicates - formula examples (.xlsx file)
Ultimate Suite - trial version (.exe file)

262 comments

  1. Is there a way to find the exact location (using Index and Match) next to the first, second (and so on) duplicate value? Suppose Mary 100 and Donald 100 in a long list of names in column A and values in column B. Would it be possible using Index/Match to put "Mary" and "Donald" in the same order in Column C?

  2. Hi,
    I need to flag 1st duplicate and 2nd duplicate till nth duplicate with respect to date.
    for ex: 01/01/2010 is having data with duplicates and using COUNTIF it can return 1st duplicate and then 02/01/2020 is having same data and I need to flag second duplicate vice versa.

    I am using below formula
    "{=IF(COUNTIF($A$3:A3,A3)>1,"NX","X")}
    here "X" return with 1st duplicate value

  3. I need to find out the duplicates for the below...anybosy pl help me..
    For example..
    Apple
    Banana
    Apple
    Banana
    Apple
    Banana
    Apple
    Apple
    In the last 2 rows, word apple repeated...this need to be find out in the consecutive list....1 :1 ratio only allowed...pl help

  4. for same exact work or number finding duplicate is ok
    but i am looking for something like this
    apple,banana
    apple,mango
    mango,banana
    how to find same word in a cell for whole column

  5. Hi,
    How can i get duplicate value or text & unique value or text by using reference in excel.

  6. Thank you very much, I have gained a lot and I can identify easily the duplicates for following the formulas.

    Abdinasir

  7. Wondering if there is a formula to begin counting up every there is a change in the name column; as so:
    Name #
    1 1
    1 2
    1 3
    2 1
    2 2
    2 3
    3 1
    3 2
    3 3
    4 1
    5 1
    6 1
    6 2
    7 1
    7 2
    7 3
    8 1
    8 2
    8 3
    9 1
    9 2
    10 1
    11 1
    11 2
    11 3

  8. Please how do I check for duplicate interval. eg
    hole_id depth_from depth_to
    NGC12-018 0 1.5
    NGC12-018 1.5 2.3
    NGC12-018 2.3 3
    NGC12-018 3 8.2
    NGC12-018 8.2 10.7
    NGC12-018 10.7 17.3
    NGC12-018 17.3 20.6
    NGC12-018 20.6 23.5
    NGC12-018 20.6 23.5
    NGC12-018 23.5 27.9
    NGC12-018 27.9 31.7
    NGC12-018 31.7 36.7
    NGC12-018 36.7 43.4
    NGC12-018 36.7 43.4
    NGC12-018 43.4 48.2
    NGC12-018 48.2 49.5
    NGC12-018 49.5 64.5
    NGC12-018 64.5 67.5
    NGC12-018 67.5 72.6
    NGC12-018 72.6 81
    NGC12-018 81 86.55
    NGC12-018 86.55 90

  9. I am working on a list of not duplicate text cells but some are close.
    I want to know how to only find the cells that are incorrect.
    How do I do that?
    Here is an example.
    9086264 SENSOR RTD JACKET HEATING TETRA PAK ALLM O-RING 9531-4040-591 FALSE
    9086266 SEAL CYLINDER CLOSING TOOL SCRAPER ROD 9531-6131-516 FALSE
    9086267 ARM CASE SIDE CLOSING GASKET 9531-6130-516 FALSE
    9086270 TRAP STEAM DISC TD42H SPIRAX SARCO O-RING 9531-4021-591 FALSE
    I have a list of 20,000 items that I can not go through indivually. I just want to make sure the first few characters match.

  10. Kindly Solve My Query in below there is two value in a saprate cells , i wants comman value in output cell.

    Value 1 Value 2 Output (Comman No.)
    21452 23652 25

  11. Hi, I'm using the duplicate formula but trying to add an index part so that it shows up the duplicate reference. Where am I going wrong and how do I correct it? I have: =INDEX(E:E(IF(COUNTIF(F:F,[@WON])>1,"Duplicate","")),0)
    I want to show the contents of the duplicate cell from column E, if it has the same contents as another cell in column F. So if row 3 has the same column F value as row 5, I want B3 to show the cell value from E5.
    I hope this makes sense.
    Thanks

  12. 016230240
    016259070
    012350891

    If i would like to add a 6 in front of above number only, example 016 become 6016230240 , the back of 0 will appear 6 also if i find 0 and replace by 6, however i just like to have 6 infront of the number, what is the the process , pls help, thank you..

  13. Hi,

    How can I distinguish repeating brand names? For example:
    Gillette --> Gillette 1
    Gillette --> Gillette 2
    Pantene --> Pantene 1
    Gillette --> Gillette 3
    Head & Shoulders --> Head & Shoulders 1
    Pantene --> Pantene 2

  14. How can i arrange the Values of duplicate attendance number from below
    Attendace Value
    168755 41759002
    168755 41704067
    197119 40316326
    197119 40811539
    204786 41446987
    204786 41025753
    285943 41696614
    285943 41232806
    181907 40538480
    181907 40117598
    986727 40450723
    986727 41072614
    768565 40098263
    768565 40403845
    693968 40455014
    693968 40987284
    998263 40044440
    998263 40928398
    366864 41736203
    366864 41644887
    837218 40222382
    837218 40621245
    837218 4063258
    to
    Attendance Value 1 Value 2 Value3
    168755 41759002 41704067
    197119 40316326 40811539
    204786 41446987 41025753
    285943 41696614 41232806
    181907 40538480 40117598
    986727 40450723 41072614
    768565 40098263 40403845
    693968 40455014 40987284
    998263 40044440 40928398
    366864 41736203 41644887
    837218 40222382 40621245 4063258

  15. Hi
    am saikat patra from Howrah in west bengal.
    Can anyone help me about if count formula details given below.
    colum 1 colum 2
    78120 above10days
    78121 above10days
    78122 abovel0days
    78560 above5days
    78121 above10days
    How to count colum 2 tex wise to colum 1 shipment no without duplicate.
    ans should be if above10days basis is "3".
    please help me and very much gladfull to you for this.

  16. Hi,

    how can i get the duplication data for example i want the excel to read the data from 6 last alphabet of an email.

  17. Highlight duplicate values across multiple worksheets.
    I have a workbook with four worksheets. We are clearing out a storage center and listing the bins on worksheet "Empty Bins" as they become empty. Worksheets "Aisle 1", "Aisle 2", and "Aisle 3" list all the bins in the system.
    How do compare the data on worksheet "Empty Bins" to the data on the three other worksheets to find and highlight duplicates? Thank you.

  18. I have 55000 entries in a single column 10 digit numbers. I have to find duplicates. But the problem is the numbers may have difference by addition of excess 3 4 digits at the ending or starting.

  19. If duplicate is there, then I want result as first value in row1 against duplicate name. Any one pls. help to get result as mentioned in column3
    Eg, below.
    Column1---Column2---Column3(RESULT)
    1 -------Siva -------1
    2------- Kumar -------2
    3 -------Suresh ------3
    4 -------Siva ------1
    5 --------Kumar -----2

  20. I have a row with header in row1, for example; Boat1, Boat2, Boat3, Boat4, Boat5 and numbers in the next row, 5, 6, 7, 5, 4. I want to identify the duplicate headers or header/number, which in this case is Boat1, Boat4 or Boat1/5, Boat4/5. Happy for the result to be shown in two separate cells.

    Thank you

Post a comment



Thank you for your comment!
When posting a question, please be very clear and concise. This will help us provide a quick and relevant solution to
your query. We cannot guarantee that we will answer every question, but we'll do our best :)