TabLab

Merge TSV files online

Merge multiple TSV files into a single file. Combine data from different sources quickly and easily.

Format

Files

Click anywhere to select filesor drag and drop files here
Accepts TSV files (.tsv)

Trusted by over 40,000 every month

TSV Merge Features

Multiple File Merging
Combine any number of files into a single consolidated file
Lightning-Fast Performance
Merge even large files instantly with optimized processing
Streamlined File Merging
Efficiently combine multiple files into a unified dataset
SQL-Powered Merging
Use SQL queries for advanced merging with custom join conditions
AI-Powered Assistance
Describe your merging needs in plain English for complex scenarios
Export Merged Data
Save your combined results in various formats

How to merge TSV files in Python

Here are three effective ways to merge multiple TSV files in Python using different libraries. Each approach has its own advantages depending on your specific needs and file sizes.

Merging TSV files with Pandas

Pandas provides a straightforward approach for merging files and works well for most common data tasks:

First, let's install pandas if you haven't already:

bash
pip install pandas

Now we can load your tsv files into dataframes:

python
import pandas as pd

Let's load your first file:

python
df1 = pd.read_csv('path/to/file1.tsv', sep='\t')

And your second file:

python
df2 = pd.read_csv('path/to/file2.tsv', sep='\t')

Great! Now we can merge the dataframes using the concat function:

python
merged_df = pd.concat([df1, df2], ignore_index=True)

Finally, let's save your newly merged data to a file:

python
merged_df.to_csv('path/to/merged_file.tsv', sep='\t', index=False)

Need to merge more than two files? No problem! Just add them to the list in the concat function:

python
merged_df = pd.concat([df1, df2, df3, df4], ignore_index=True)

Merging TSV files with DuckDB

DuckDB is an in-process SQL OLAP database that's perfect for larger files and analytical workloads:

Let's start by installing DuckDB for Python:

bash
pip install duckdb

Now we'll import the library and create a connection:

python
import duckdb
con = duckdb.connect()

Here's a simple DuckDB query that will merge your tsv files using UNION ALL:

python
query = """
COPY (
  SELECT * FROM 'path/to/file1.tsv'
  UNION ALL
  SELECT * FROM 'path/to/file2.tsv'
) TO 'path/to/merged_file.tsv' (FORMAT 'tsv')
"""

Just run this query to perform the merge:

python
con.execute(query)

Got more than two files? Simply add more UNION ALL statements like this:

python
query = """
COPY (
  SELECT * FROM 'path/to/file1.tsv'
  UNION ALL
  SELECT * FROM 'path/to/file2.tsv'
  UNION ALL
  SELECT * FROM 'path/to/file3.tsv'
) TO 'path/to/merged_file.tsv' (FORMAT 'tsv')
"""

What's great about DuckDB is that it's incredibly efficient for large files - it processes data in a columnar format and can handle files that don't fit in memory. Perfect for those bigger merging jobs!

Merging TSV files with ClickHouse

ClickHouse is a high-performance column-oriented database system that's excellent for large-scale data processing:

Let's begin by installing the ClickHouse Connect library for Python:

bash
pip install clickhouse-connect

Now we'll import the library and create a client connection:

python
import clickhouse_connect
client = clickhouse_connect.get_client(host='localhost')

Here's how you can merge your files using a single UNION ALL query:

python
query = f"""
CREATE TABLE merged_file AS
  SELECT * FROM file('path/to/file1.tsv', tsv)
  UNION ALL
  SELECT * FROM file('path/to/file2.tsv', tsv)
"""
client.command(query)

Then export your merged data to a file:

python
export_query = f"""
SELECT * FROM merged_file 
INTO OUTFILE 'path/to/merged_file.tsv'
FORMAT tsv
"""
client.command(export_query)

Need to merge more than two files? Just add more UNION ALL statements like this:

python
query = f"""
CREATE TABLE merged_file AS
  SELECT * FROM file('path/to/file1.tsv', tsv)
  UNION ALL
  SELECT * FROM file('path/to/file2.tsv', tsv)
  UNION ALL
  SELECT * FROM file('path/to/file3.tsv', tsv)
"""
client.command(query)

Want to skip the intermediate table? You can merge directly to a file in one step:

python
direct_query = f"""
SELECT * FROM file('path/to/file1.tsv', tsv)
UNION ALL
SELECT * FROM file('path/to/file2.tsv', tsv)
INTO OUTFILE 'path/to/merged_file.tsv'
FORMAT tsv
"""
client.command(direct_query)

ClickHouse really shines when you're working with massive datasets - it's a powerful columnar database that processes large volumes of data lightning fast, making it perfect for merging even the largest files.