Excel Remove Duplicates

Excel Remove Duplicates (Table of Contents)

• Remove Duplicates in Excel
• How to Remove Duplicates in Excel?
  • #1 – Using Conditional Formatting followed by Filter feature
  • #2 – Using Remove Duplicates feature in Excel
  • #3 – Using COUNTIf Function along with Filter feature in Excel

Remove Duplicates in Excel

Remove Duplicates in excel is used for removing the duplicate cells of one or multiple columns. This is very easy to implement. To remove duplicates from any column, first select the column/s from where we need to remove duplicate values, then from the Data menu tab, select Remove Duplicate under data tools. We will get the window for the same, where we can select and unselect the columns from where we want to remove duplicate values.

There are three methods of finding and removing duplicate data:

1. Using Conditional Formatting followed by the Filter feature of Excel.
2. Using the Remove Duplicate feature in Excel.
3. Using the COUNTIF function.

How to Remove Duplicates in Excel?

Let’s understand the work of removing excel duplicate values from a given dataset with the below examples.

You can remove duplicate records in a very simple and easy way to excel.

#1 – Using Conditional Formatting followed by Filter feature

For Conditional Formatting

• There are duplicate occurrences of data in the below table.

• Select a range of cells or tables. Go to the Home Tab in the Excel Ribbon. Click on the Conditional Formatting drop-down list. Select Highlight Cells Rules and then click on Duplicate Values.

• A duplicate Values dialog box will appear. Select either Duplicate or Unique option that you want to highlight. In this example, we have selected the Duplicate option.

• Choose the color and font of the highlighted cells in values with a drop-down list and then click on OK.

• After using the Conditional Formatting feature, the table will look like below:

• To clear Conditional formatting.

Select a range of cells or tables. Go to the Home Tab in the Excel Ribbon. Click on the Conditional Formatting drop-down list. Select Clear Rules and then click on Clear Rules from selected cells.

How to use Filter for finding Duplicate values in Excel?

The Filter feature allows a user to filter selected data in the spreadsheet. The Advance filter feature allows copying of the resulting filtered list to a new location.

• Select the column heading of the table.
• Go to the Data tab in the Excel Ribbon. Click on Filter.

The table will look like below:

• To remove duplicates from any column, click on the Filter drop-down icon in the column header. For example, click on Filter by Color and select Filter by Cell Color or Filter by Font Color.

This will show duplicated values which you may delete.

The output will be as shown below:

How to clear Filter?

Select the column header of the table. Click on Filter.

Then the filter will be removed.

Points to Remember:

• The deletion in the above process is done manually.
• Conditional formatting is used to highlight duplicate cells, whereas Filter->Filter by Cell Color or Filter by Font Color feature is used to filter highlighted duplicate cells in excel.

#2 – Using Remove Duplicates feature in Excel

• Select the range of cells or table. Next, go to the Data Tab in the Excel Ribbon. In the Data tool group Clicks on Remove Duplicates.

• Remove Duplicates dialog box will appear. To delete duplicate values, select one or more columns that contain possible duplicates. Here in the above example, we have selected Name and Code no columns, as both the columns contain duplicate values, and then click OK.

• A message box will be displayed, indicating the number of duplicate values that were found and removed and how many unique values remain. In case of no duplicate value, it will display the message. No duplicate values found, and then click OK.

• The output will be as shown below:

Points to be Remember:

• It is an inbuilt feature in the Data tool of MS-Excel.
• It removes Excel duplicate data permanently.

#3 – Using COUNTIf Function along with Filter feature in Excel

A COUNTIF function is an easy method of removal of duplicate values in excel. Depending on whether you want to find duplicate values with or without first occurrences, there will be a slight difference in writing the formula.

A formula to find duplicates in Excel, including the first occurrence:

• Duplicate in words

=COUNTIF(range, criteria)>1

Here, a range in column A and the topmost cell for criteria is A3. Input the formula shown below in the C3 cell. Then, select the C3 cell and drag to copy the formula till C11. The result will appear as True or False.

• Duplicate in numbers

=COUNTIF(range,criteria)

Here, Range is column A, and the topmost cell for criteria is A3. Input the formula shown below in the D3 cell. Select the D3 cell and drag to copy the formula till D11. The result will appear in the count, i.e. number.

A formula to find duplicates in Excel without first occurrence:

If you want to filter or remove excel duplicates after finding them, the above formula will create some confusion as it marks True to all the identical records. So, we have to use the following formula to keep the list’s unique values and delete all subsequent repetition of values. Let’s modify our Excel duplicate formula by using absolute (by freezing the cell by using $ sign), and relative cell references wherever appropriate.

• Duplicate in words

Here the unique value will be displayed as FALSE, whereas the subsequent duplicate values will be displayed as TRUE.

• Duplicate in numbers

Here the unique value will be numbered as 1, whereas duplicate values will be numbered as 2.

• Use Filter along with the above cases for finding Duplicate values in excel

Select the column header of the table. Go to the Data tab in the Excel Ribbon. Click on the Filter feature.

A dropdown arrow will appear beside the column header.

To remove excel duplicates, click on the filter drop-down icon in the column header. Deselect Select All. Select True and then click on Ok.

This will show duplicated values which you may delete.

The same procedure is to be followed while selecting the drop-down filter arrow of column Duplicates in Numbers. Here the difference is instead of True/False; the option will be given in numbers, i.e. 1,2.

Points to be Remember:

• Here, data are being removed manually using the correct formula.
• A filter is used to make the task easy.

Conclusion

It is always suggested to copy the original range of data or table to another worksheet or location before deleting or removing duplicates permanently from the worksheet.

Recommended Articles

This has been a guide to Remove Duplicates in Excel. Here we discuss how to remove duplicates in excel using three different methods along with practical examples and a downloadable excel template. You may also look at these useful excel tools –

1. Excel Data Filter
2. COUNTIF Excel Function
3. COUNTIF with Multiple Criteria
4. Relative Reference in Excel