pyarrow#
- fkat.utils.pyarrow.iter_rows(table: Table, chunk_size: int) Iterator[dict[str, Any]][source]#
Generator function to iterate over rows of a PyArrow table in chunks.
- Parameters:
table (pa.Table) – PyArrow table.
chunk_size (int) – The number of rows per chunk for processing.
- Yields:
Dict[str, Any] – Dictionary representing each row.