o :i* @sddlmZmZddlmZddlmZGdddeZdedeeded e fd d Z d d defddZ GdddZ ddde efddZdeddded e def ddZdS)) NamedTupleSequence)ClickHouseType) check_arrowc@sFeZdZUdZeed<eed<dZeed<dZeed<e ddZ dS) TableColumnDefz? Simplified ClickHouse Table Column definition for DDL namech_typeN expr_typeexprcCs6|jd|jj}|jr|d|jd|j7}|S)N )rrr r )selfr r j/home/aiteam/pcaa-dev/dashboard-backend/venv/lib/python3.10/site-packages/clickhouse_connect/driver/ddl.pycol_exprszTableColumnDef.col_expr) __name__ __module__ __qualname____doc__str__annotations__rr r propertyrr r r rrs   r table_namecolumnsengine engine_paramscCsVd|dddd|Dd|d}|r)|D]\}}|d|d|7}q|S)Nz CREATE TABLE z (z, css|]}|jVqdSN)r).0colr r r szcreate_table..z ) ENGINE r )joinitems)rrrrstmtkeyvaluer r r create_tables (r$ arrow_typez pa.DataTypereturncCsnt}|j}||r dS||rdS||rdS||r"dS||r)dS||r0dS||r7dS| |r>dS| |sH| |rJd S| |rQd S| |rXd S||r_d S||rfd S||rt|dd}t|dd}|dkrd}|rd|dS|Sdddd}||d}|rd|d|dSd|dS||s||rdStd|)a  Best-effort mapping from common PyArrow types to ClickHouse type names. Covers core scalar and common date/time/timestamp types. For anything unknown, we raise, so the caller is aware that the automatic mapping is not implemented for that Arrow type. Int8Int16Int32Int64UInt8UInt16UInt32UInt64Float32Float64BoolDate32z DateTime64(3)unitstzNDateTimez DateTime('z') )msusnsz DateTime64(z, ')Stringz.Unsupported Arrow type for automatic mapping: )rtypesis_int8is_int16is_int32is_int64is_uint8 is_uint16 is_uint32 is_uint64 is_float16 is_float32 is_float64 is_boolean is_date32 is_date64 is_timestampgetattrget is_stringis_large_string TypeError)r%papatr3r5base scale_mapscaler r r_arrow_type_to_ch sX                   rYc@seZdZdZdefddZdS)_DDLTypea  Minimal helper used to satisfy TableColumnDef.ch_type. create_table() only needs ch_type.name when building the DDL string, so we'll wrap the ClickHouse type name in this tiny object instead of constructing full ClickHouseType instances here. rcCs ||_dSr)r)r rr r r__init__qs z_DDLType.__init__N)rrrrrr[r r r rrZisrZschemaz pa.SchemacCsXt}t||jstdt|g}|D]}t|j}|t|jt |dq|S)a  Convert a PyArrow Schema into a list of TableColumnDef objects. This helper uses an *optimistic non-null* strategy: it always produces non-nullable ClickHouse types, even though Arrow fields are nullable by default. Note that if the user inserts a table with nulls into a non-Nullable column, ClickHouse will silently convert those nulls to default values due to the default server setting input_format_null_as_default=1 and current lack of client-side validation on arrow inserts. zExpected pyarrow.Schema, got )rr) r isinstanceSchemarStyperYappendrrrZ)r\rTcol_defsfield ch_type_namer r rarrow_schema_to_column_defsus  rdcCst|}t||||S)z Helper function to build a CREATE TABLE statement from a PyArrow Schema. Internally: schema -> arrow_schema_to_column_defs -> create_table(...) )rdr$)rr\rrrar r rcreate_table_from_arrow_schemas reN)typingrr!clickhouse_connect.datatypes.baser!clickhouse_connect.driver.optionsrrrdictr$rYrZlistrdrer r r rs&  I