DuckDB + Pandas (dagster-duckdb-pandas)¶

This library provides an integration with the DuckDB database and Pandas data processing library.

class dagster_duckdb_pandas.DuckDBPandasTypeHandler(*args, **kwds)[source]¶

Stores and loads Pandas DataFrames in DuckDB.

To use this type handler, pass it to build_duckdb_io_manager

Example

from dagster_duckdb import build_duckdb_io_manager
from dagster_duckdb_pandas import DuckDBPandasTypeHandler

duckdb_io_manager = build_duckdb_io_manager([DuckDBPandasTypeHandler()])

@job(resource_defs={'io_manager': duckdb_io_manager})
def my_job():
    ...