Pyarrow Collection

◆

◆

◆

◆

🔮Psychic

★★★

“Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per second 🚀”

◆

◆

◆

◆

🔮Psychic

★★★

“the portable Python dataframe library”

◆

◆

◆

◆

🔮Psychic

★★

“Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code.”

◆

◆

◆

◆

🔮Psychic

★★

“Lightweight and extensible compatibility layer between dataframe libraries!”

◆

◆

◆

◆

🔥Fire

★

“🚀 GizmoSQL — High-Performance Database Server”

◆

◆

◆

◆

⚙️Steel

★

“Work with bioinformatic files using Arrow, Polars, and/or DuckDB”

◆

◆

◆

◆

🔮Psychic

★

“Command-line interface to quickly generate fake CSV and JSON data”

◆

◆

◆

◆

🔮Psychic

★

“Lightweight DataFrame validation decorators for Pandas, Polars, Modin, and PyArrow. No custom types required.”