BizNavi HubAanmelden

CSV tools

Remove duplicate CSV rows

Deduplicate a CSV in your browser by entire row or selected columns. Keep the first or last match. No account required.

Drop a CSV file here

Or choose one file. Nothing is uploaded automatically.

No file selected yet.

Duplicate mode
Keep policy
Output encoding

Limits: 1 file, 20 MB max, 200000 rows, 200 columns.

What duplicate CSV rows are

Duplicate CSV rows are data lines that match under your chosen rule. Exact duplicates share every column value. You can also treat rows as duplicates when selected columns match — for example the same email — even if other fields differ. This free tool helps you remove duplicate rows from CSV files without uploading them.

How to remove duplicates from a CSV

  1. Select or drop one CSV file.
  2. Choose entire-row matching or selected columns, then pick keep first or keep last.
  3. Tap Remove duplicates to process the file in your browser.
  4. Review the row counts and download deduplicated.csv.

Entire row vs selected columns

Entire row removes only rows that match on every column. Selected columns let you deduplicate CSV by column — useful for CRM exports where the same email appears with different names. Comparison is case-sensitive and whitespace-sensitive unless you enable optional trim.

Keep first vs keep last

Keep first retains the earliest matching row in file order. Keep last retains the latest. Relative order of retained rows is preserved either way.

Local browser processing

CSV is processed in the browser and not uploaded to BizNavi Hub for deduplication. Leaving or refreshing the page clears in-memory files.

Encoding and BOM

Input supports UTF-8 and UTF-8 with BOM. If UTF-8 decoding fails, some browsers can read Shift_JIS. Output defaults to UTF-8 with BOM for safer Excel interoperability; plain UTF-8 is available.

Limits

To keep browsers stable we limit file size, rows, and columns. If you hit a limit, split large datasets first.

Common business use cases

  • Clean export CSVs before importing into a CRM or spreadsheet.
  • Remove duplicate email or ID rows while keeping the newest update.
  • Deduplicate combined monthly files after a merge.

Limitations

This tool does not open Excel workbooks (.xlsx), does not fuzzy-match near-duplicates, and does not convert arbitrary encodings beyond UTF-8 and best-effort Shift_JIS. Very large files may fail on low-memory devices.

FAQ

How do I remove duplicate rows in a CSV online?
Upload is not required. Choose a CSV, pick entire row or selected columns, then download the cleaned file from your browser.
Can I deduplicate CSV by column?
Yes. Switch to Selected columns, check the key fields (for example email), and choose keep first or keep last.
Are my files uploaded?
No. Deduplication runs in your browser. BizNavi Hub does not receive CSV contents for this step.
Does the output work in Excel?
UTF-8 with BOM is the default to improve Excel opening on Windows. You can choose plain UTF-8 instead.
Is XLSX supported?
Not in this phase. Use CSV exports for now.

← All CSV tools