Login
From:
Blog
(Uncensored)
subscribe
Creating Disk Partitioned Lakes with Dask using partition_on
https://docs.coiled.io/blog/dask-disk-partition-on.html
links
backlinks
This post explains how to create disk-partitioned Parquet lakes using partition_on and how to read disk-partitioned lakes with read_parquet and filters. Disk partitioning can significantly improve performance when used correctly.
Roast topics
Find topics
Find it!