Convert Arrow to Parquet
Convert Arrow to Parquet in seconds with this free online Arrow to Parquet converter
Accepts arrow
Arrow
Apache Arrow (.arrow) is a format that was designed for storing tabular data in memory (RAM). It was not designed for storing data as files on disk.
Arrow enforces a schema. Which means that every value in a column must have the same value.
Arrow was designed to work well between different data analysis systems without needing to be serialised or deserialized.
Arrow is a binary data format, which means that it can be easily read by computers. But it cannot be read by people. The easiest way to view arrow data is to convert it to CSV first.
It can be best to convert Arrow data to Parquet before saving to disk. Arrow was not designed for storing data to disk, so can be inefficient and slow to query.
Parquet
Apache Parquet (.parquet) is a format that was designed for storing tabular data on disk. It was designed based on the format used in Google's Dremel paper (Dremel later became Big Query).
Parquet files store data in a binary format, which means that they can be efficiently read by computers but are difficult for people to read.
Parquet files have a schema, so means that every value in a column must have the same type. The schema makes Parquet files easier to analyse than CSV files and also helps them to have better compression so they are smaller on disk.
Supercharge your data exploration
Open csv, parquet, arrow, json and tsv files straight from your desktop
Or
Share and embed
Share your graphs and data sets. Or embed them directly into web pages.
Work straight from Google Drive
Open csv, parquet, arrow, json and tsv files directly from Drive, Gmail and Classroom by installing the Google Workspace App
How to Convert Arrow to Parquet
- Select your input Arrow file
- Your Arrow file will be converted to Parquet
- Download your Parquet file
- Click the View button to view your file
How to Convert Arrow to Parquet in Python
We can convert Arrow to Parquet in Python using Pandas or DuckDB
How to Convert Arrow to Parquet using Pandas
First, we need to install pandas
pip install pandasThen we can load the Arrow file into a dataframe
df = pd.read_feather('path/to/file.arrow')Finally, we can export the dataframe to the Parquet format
df.to_parquet('path/to/file.parquet', index=False)How to Convert Arrow to Parquet using DuckDB
First, we need to install duckdb for Python
pip install duckdbThe following DuckDB query will read a Arrow file and output a Parquet file
duckdb.sql("""COPY (select * from 'path/to/file.arrow') TO 'path/to/file.parquet' (FORMAT 'parquet')""")Tabular Data Converters
Need to convert some data? Check out the converters below.
Parquet Tools
Use these Parquet Tools to work with Parquet files on Windows, Mac, Linux, ChromeOS and Android.
Parquet Viewer
View and filter Parquet files
Query Parquet With SQL
Write SQL to query your Parquet File
Explore
Find correlations in your Parquet File
Convert
File format converter
Parquet Compression Viewer
View the compression of a parquet file
Parquet Data Types Viewer
View the data types of a parquet file
Parquet Encoding Viewer
View the encoding of a parquet file
Parquet Metadata Viewer
View the metadata of a parquet file
Parquet Row Groups Viewer
View the row groups of a parquet file
Parquet Schema Viewer
View the schema a parquet file
Sample Parquet File
Download a sample parquet file for testing