Data Tools

A algorithmic tookit for working with trees in Python

Discover the power of Pydantic, Python's most popular data parsing, validation, and serialization library. In this hands-on tutorial, you'll learn how to make your code more robust, trustworthy, and easier to debug with Pydantic.

In this tutorial, you'll learn how to store and retrieve data using Python, SQLite, and SQLAlchemy as well as with flat files. Using SQLite with Python brings with it the additional benefit of accessing data with SQL. By adding SQLAlchemy, you can work with data in terms of objects and methods.

Loading complete JSON files into Python can use too much memory, leading to slowness or crashes. The solution: process JSON data one chunk at a time.

In this step-by-step tutorial, you'll learn how to connect to different database management systems by using various Python SQL libraries. You'll interact with SQLite, MySQL, and PostgreSQL databases and perform common database queries using a Python application.

The rise of Large Language Models (LLMs) has brought about a significant shift in technology, empowering developers to create applications…

the data loading library for python

A Python package for easy multiprocessing, but faster than multiprocessing - sybrenjansen/mpire: A Python package for easy multiprocessing, but faster than multiprocessing

:blue_book: dict subclass with keylist/keypath support, built-in I/O operations (base64, csv, ini, json, pickle, plist, query-string, toml, xls, xml, yaml), s3 support and many utilities. - fabioca...

Learn numpy - Filtering data with a boolean array

This tutorial demonstrates how to convert an image to grayscale in Python

PRQL is a modern language for transforming data — a simple, powerful, pipelined SQL replacement - GitHub - prql/prql: PRQL is a modern language for transforming data — a simple, powerful, pipelined...

Objectiv Bach provides Pandas-like DataFrames backed by SQL

Pydbantic inherits its’ name from pydantic, a library for “Data parsing and validation using Python type hints”.

SQL databases in Python, designed for simplicity, compatibility, and robustness. - GitHub - tiangolo/sqlmodel: SQL databases in Python, designed for simplicity, compatibility, and robustness.

Fastest library to load data from DB to DataFrames in Rust and Python - sfu-db/connector-x: Fastest library to load data from DB to DataFrames in Rust and Python

dplyr-style piping operations for pandas dataframes - kieferk/dfply

Query language for efficient data extraction from Wikipedia - zverok/wikipedia_ql

Rapid fuzzy string matching in Python using various string metrics - maxbachmann/RapidFuzz

Fuzzy String Matching in Python. Contribute to seatgeek/fuzzywuzzy development by creating an account on GitHub.

Get the gender from first name.

Histogramming for analysis powered by boost-histogram - scikit-hep/hist: Histogramming for analysis powered by boost-histogram

Flatten JSON objects

Minimal, super readable string pattern matching for python. - tfeldmann/simplematch