\ qi!dZddlmZddlZddlmZmZmZddlm Z ddl m Z ddl m Z ddlmZdd lmZdd lmZdd lmZmZerddlZddlZdd lmZmZmZmZdd lm Z e dde j!dfd(dZ" d)ddddd*d'Z#dS)+z orc compat) annotationsN) TYPE_CHECKINGAnyLiteral)lib)import_optional_dependency) set_module)check_dtype_backend) default_index)arrow_table_to_pandas) get_handle is_fsspec_url) DtypeBackendFilePath ReadBuffer WriteBuffer) DataFramepandaspathFilePath | ReadBuffer[bytes]columnslist[str] | None dtype_backendDtypeBackend | lib.NoDefault filesystem=pyarrow.fs.FileSystem | fsspec.spec.AbstractFileSystem | Nonekwargsrreturnrc td}t|t|dd5}|j}t |rV|Ttd}td} | j|\}}n#t|jf$rYnwxYw|j d |||d|} dddn #1swxYwYt| | S) a Load an ORC object from the file path, returning a DataFrame. This method reads an ORC (Optimized Row Columnar) file into a pandas DataFrame using the `pyarrow.orc` library. ORC is a columnar storage format that provides efficient compression and fast retrieval for analytical workloads. It allows reading specific columns, handling different filesystem types (such as local storage, cloud storage via fsspec, or pyarrow filesystem), and supports different data type backends, including `numpy_nullable` and `pyarrow`. Parameters ---------- path : str, path object, or file-like object String, path object (implementing ``os.PathLike[str]``), or file-like object implementing a binary ``read()`` function. The string could be a URL. Valid URL schemes include http, ftp, s3, and file. For file URLs, a host is expected. A local file could be: ``file://localhost/path/to/table.orc``. columns : list, default None If not None, only these columns will be read from the file. Output always follows the ordering of the file and not the columns list. This mirrors the original behaviour of :external+pyarrow:py:meth:`pyarrow.orc.ORCFile.read`. dtype_backend : {'numpy_nullable', 'pyarrow'} Back-end data type applied to the resultant :class:`DataFrame` (still experimental). If not specified, the default behavior is to not use nullable data types. If specified, the behavior is as follows: * ``"numpy_nullable"``: returns nullable-dtype-backed :class:`DataFrame` * ``"pyarrow"``: returns pyarrow-backed nullable :class:`ArrowDtype` :class:`DataFrame` .. versionadded:: 2.0 filesystem : fsspec or pyarrow filesystem, default None Filesystem object to use when reading the orc file. .. versionadded:: 2.1.0 **kwargs Any additional kwargs are passed to pyarrow. Returns ------- DataFrame DataFrame based on the ORC file. See Also -------- read_csv : Read a comma-separated values (csv) file into a pandas DataFrame. read_excel : Read an Excel file into a pandas DataFrame. read_spss : Read an SPSS file into a pandas DataFrame. read_sas : Load a SAS file into a pandas DataFrame. read_feather : Load a feather-format object into a pandas DataFrame. Notes ----- Before using this function you should read the :ref:`user guide about ORC ` and :ref:`install optional dependencies `. If ``path`` is a URI scheme pointing to a local or remote file (e.g. "s3://"), a ``pyarrow.fs`` filesystem will be attempted to read the file. You can also pass a pyarrow or fsspec filesystem object into the filesystem keyword to override this behavior. Examples -------- >>> result = pd.read_orc("example_pa.orc") # doctest: +SKIP pyarrow.orcrbFis_textNpyarrowz pyarrow.fs)sourcerr)r) rr r handler FileSystemfrom_uri TypeError ArrowInvalid read_tabler ) rrrrrorchandlesr%papa_fspa_tables m/var/www/html/bestrading.cuttalo.com/services/ml-inference/venv/lib/python3.11/site-packages/pandas/io/orc.pyread_orcr3'sI` %] 3 3C &&& D$ . . .  '    :#5+I66B.|<%>t%D%D" FFr/    "3> 7z  EK                   ! G G GGs57B;)BB;BB;BB;;B?B?r$)engineindex engine_kwargsdf$FilePath | WriteBuffer[bytes] | Noner4Literal['pyarrow']r5 bool | Noner6dict[str, Any] | None bytes | Nonec||jjddu}|i}|jtt |st d|jjt d|dkrt dtd}td}|du}|rtj }|Jt|dd 5} |j |j || |jfi|n)#t|jf$r} t#d | d} ~ wwxYw dddn #1swxYwY|r0t%|tj sJ|SdS) aM Write a DataFrame to the ORC format. Parameters ---------- df : DataFrame The dataframe to be written to ORC. Raises NotImplementedError if dtype of one or more columns is category, unsigned integers, intervals, periods or sparse. path : str, file-like object or None, default None If a string, it will be used as Root Directory path when writing a partitioned dataset. By file-like object, we refer to objects with a write() method, such as a file handle (e.g. via builtin open function). If path is None, a bytes object is returned. engine : str, default 'pyarrow' ORC library to use. index : bool, optional If ``True``, include the dataframe's index(es) in the file output. If ``False``, they will not be written to the file. If ``None``, similar to ``infer`` the dataframe's index(es) will be saved. However, instead of being saved as values, the RangeIndex will be stored as a range in the metadata so it doesn't require much space and is faster. Other indexes will be included as columns in the file output. engine_kwargs : dict[str, Any] or None, default None Additional keyword arguments passed to :func:`pyarrow.orc.write_table`. Returns ------- bytes if no path argument is provided else None Raises ------ NotImplementedError Dtype of one or more columns is category, unsigned integers, interval, period or sparse. ValueError engine is not pyarrow. Notes ----- * Before using this function you should read the :ref:`user guide about ORC ` and :ref:`install optional dependencies `. * This function requires `pyarrow `_ library. * For supported dtypes please refer to `supported ORC features in Arrow `__. * Currently timezones in datetime columns are not preserved when a dataframe is converted into ORC files. Nrz{orc does not support serializing a non-default index for the index; you can .reset_index() to make the index into column(s)z9orc does not serialize index meta-data on a default indexr$zengine must be 'pyarrow'r wbFr")preserve_indexz6The dtype of one or more columns is not supported yet.)r5namesequalsr len ValueErrornamerioBytesIOr write_tableTable from_pandasr'r*ArrowNotImplementedErrorNotImplementedError isinstancegetvalue) r7rr4r5r6r/r-was_noner.es r2to_orcrPs x }q!-  8??=R11 2 2  F    x} TUUU 3444 #I . .B $] 3 3Ct|Hz||     D$ . . . '  CO$$R$>>        267   %H                   $ +++++}} 4s6E.D  E D2D--D22EE E) rrrrrrrrrrrr)N) r7rrr8r4r9r5r:r6r;rr<)$__doc__ __future__rrEtypingrrr pandas._libsrpandas.compat._optionalrpandas.util._decoratorsr pandas.util._validatorsr pandas.core.indexes.apir pandas.io._utilr pandas.io.commonr rfsspec pyarrow.fsr$pandas._typingrrrrpandas.core.framer no_defaultr3rPr&r2ras""""""  >>>>>>......777777111111111111  ,MMM,+++++ H!%25.PT `H`H`H`H`HJ26h"++/ hhhhhhhhr`