Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Decompressing large zst files

I have a 16gb compressed zst file. how would I decompress it on windows? I do not have the memory to handle the decompressed version, so it needs to be written straight to a file.

like image 373
RRKS101_1 TF2 Avatar asked Apr 17 '26 17:04

RRKS101_1 TF2


1 Answers

At the risk of sounding obvious, you need a windows decompressor that supports zstandard.

At the zstandard releases page, there are two prebuilt Windows executables, zstd-v1.5.5-win32.zip and zstd-v1.5.5-win64.zip available.

Regarding the amount of memory needed, zstandard will not decompress it completely into memory before writing to the filesystem -- it works in a streaming mode loop that operates like this pseudo-code

WHILE NOT at eof of zstd file
    read a small part of the compressed data into memory
    uncompressing it into memory
    writes the uncompressed data to disk
like image 173
pmqs Avatar answered Apr 20 '26 07:04

pmqs