How to Remove Duplicates from A Google Spreadsheet
September 7, 2010
If you've started using Google Spreadsheets as an alternative to the Non-Free Microsoft Excel, congratulations. The real benefit of cloud-based computing is that you never again have to ask where's the latest version of that spreadsheet! The bummer can be those nice little enterprise level tools like "pivot tables", "conditional formatting", "eliminate duplicates", etc. For today, I thought I'd help you learn how to remove duplicates from a Google spreadsheet.
What you must do first is determine the best column or columns for determining a duplicate record (this assumes you have your records in rows, with column headers like "First Name", "Last Name", "Email Address", "Phone", etc.). Using the example in parens, the best column is probably "Email Address". So, here's what you do:
NOTE 1: if your columns have dirty data (All Caps, lower case, and mixed), you'll want to perform the following operation before determining duplicates.
That's how you do it!
What you must do first is determine the best column or columns for determining a duplicate record (this assumes you have your records in rows, with column headers like "First Name", "Last Name", "Email Address", "Phone", etc.). Using the example in parens, the best column is probably "Email Address". So, here's what you do:
- sort by the column containing email addresses

- find the first empty column field to the right (see Note 1 below first)
- enter the following formula: =IF(D2=D3,1,0)

- Now copy the formula down the column
- Those rows with a "1" are duplicates and can be deleted (see Note 2 below)
NOTE 1: if your columns have dirty data (All Caps, lower case, and mixed), you'll want to perform the following operation before determining duplicates.
- copy the column with dirty data (just right click and hold until the entire column is highlighted)
- Ctrl-C or Apple-C to copy
- Ctrl-V or Apple-V to paste into the dialog box on the Case Converter website

- Select the appropriate text treatment (Upper Case, Lower Case, Proper Case, or Sentence Case)
- Highlight all items in dialog box on Case Converter
- Ctrl-C or Apple-C to copy
- Ctrl-V or Apple-V to paste into the appropriate column in your Google Spreadsheet (make sure you select the right field to begin the paste operation - you want everything to match, we are just trying to make the text treatment consistent)
That's how you do it!
Posted by John-Scott Dixon. Posted In : Web 2.0

I have over 16 years of experience managing and leading the Ecommerce efforts of medium and large companies. I have held sales, sales management, marketing, operations, IS/IT, legal and executive management positions in start-up to multi-billion dollar organizations. I have also served as an adjunct professor of Ecommerce for the MBA program of the University of Missouri (where I received an MBA concentrated in Direct Marketing in 1989). I led the Ecommerce initiative for Sprint PCS (PCS) and Sprint (FON) as Vice President of Ecommerce. I led the integrated marketing efforts for Insight (NSIT) as Senior Vice President of Marketing and Ecommerce. Today, I am the President of Aidan Taylor - a Web marketing company.

