to_arrow_ipc

to_arrow_ipc()

to_arrow_ipc(input_path: str, output_path: str, batch_size: typing.SupportsInt | None = None, num_threads: typing.SupportsInt | None = None, guess_integer: bool = True, trim_ws: bool = True, escape_backslash: bool = False, decimal_mark: str = ‘.’, skip: typing.SupportsInt = 0) -> None

Convert a CSV file to Arrow IPC format.

NOTE: This function is not yet implemented. It will raise an error explaining that Arrow IPC output requires FlatBuffers integration. Use to_parquet() for columnar output instead.

Parameters

Name Type Description Default
input_path str Path to the input CSV file. required
output_path str Path to the output Arrow IPC file (.arrow or .feather). required
batch_size int Number of rows per record batch. Default is 65536. required
num_threads int Number of threads to use. Default is auto-detect. required
guess_integer bool Whether to infer integer types (INT32/INT64) instead of FLOAT64 for integer-like values. Default is True. required
trim_ws bool Whether to trim leading and trailing whitespace from field values. Default is True. required
decimal_mark str Decimal separator character (‘.’ or ‘,’). Default is ‘.’. required
skip int Number of lines to skip before the header row. Default is 0. required

Raises

Name Type Description
RuntimeError Always raised - Arrow IPC output is not yet implemented.