Skip to main content
The compression block defines how Tangent compresses serialized records before they’re written to disk or uploaded to S3.
Compression can be configured globally under encoding, or inline within a specific sink.

​
Schema

​
string
required
Specifies which compression algorithm to use.Options
  • none — no compression
  • gzip — standard Gzip compression
  • zstd — modern Zstandard compression (fast, high ratio)
  • snappy — Snappy block compression (Avro-only)
  • deflate — Deflate stream compression (Avro-only)
​
int
Compression level (optional).
Defaults vary by algorithm:

​
Behavior

  • For NDJSON and JSON, Tangent compresses the entire file object.
  • For Avro and Parquet, compression applies to data blocks inside the file. The file itself is not additionally wrapped.
  • Tangent automatically appends appropriate file extensions:
    • .gz for Gzip
    • .zst for Zstd

​
Examples

​
Default (Zstandard level 3)

tangent.yaml

​
Gzip with level 9

tangent.yaml

​
No compression

tangent.yaml

​
Defaults Summary

​
See also