Remove duplication from your dataset with our DeDupe App.


Data Duplication is an issue we all run into from time to time – no matter what industry or background, there will always be duplicated data. The trouble is that deduplication can be lengthy, tedious and really difficult to get right.

When it comes to de-duping data there aren’t many truly helpful solutions, with most only letting you de-dupe from one column. However our DeDupe App allows you to nominate as many columns as you wish to ensure the highest level of data integrity.

Simply load in your dataset as CSV, TAB or SHP, nominate your chosen columns, and receive back a clean dataset with a report of what was duplicated and has been removed.

How it works

  • Launch the App in the DataFlow Player
  • Define your chosen columns
  • Process your data
  • Output the cleaned dataset
Contact Us