Table of Contents
Exporting Logs to Apache Parquet Format
To enable the Parquet file format for your account, please reach out to your Beeswax Account Representative.
Beeswax allows customers to export Win and Attributed Conversion logs in the Apache Parquet file format (.parquet). Parquet is a columnar data storage format commonly used in Hadoop clusters, offering efficient storage and compression for large datasets. This format provides a significant advantage over the traditional gzipped CSV format typically used for logs.
Key Features of Apache Parquet:
- Efficient Storage: Designed for large datasets, Parquet optimizes storage space.
- Compression: Parquet files use Snappy compression to reduce file size while maintaining fast read/write speeds.
- Compatibility: Snappy is the most widely supported compression codec for Parquet files and is compatible with most applications that accept Parquet files.
Supported Log Types
Beeswax supports exporting the following types of logs to the Parquet file format:
- Win Logs
- Attributed Conversion Logs