a =_)@sTdZddlZddlZddlmZddlmZddlmZm Z dZ Gdd d eZ dS) z!Here is defined the CArray class.N)Atom)Array)correct_byteorderSizeTypez1.1cs>eZdZdZdZdfdd Zdd Zd d Zd d ZZ S)CArraya This class represents homogeneous datasets in an HDF5 file. The difference between a CArray and a normal Array (see :ref:`ArrayClassDescr`), from which it inherits, is that a CArray has a chunked layout and, as a consequence, it supports compression. You can use datasets of this class to easily save or load arrays to or from disk, with compression support included. CArray includes all the instance variables and methods of Array. Only those with different behavior are mentioned here. Parameters ---------- parentnode The parent :class:`Group` object. .. versionchanged:: 3.0 Renamed from *parentNode* to *parentnode*. name : str The name of this node in its parent group. atom An `Atom` instance representing the *type* and *shape* of the atomic objects to be saved. shape The shape of the new array. title A description for this node (it sets the ``TITLE`` HDF5 attribute on disk). filters An instance of the `Filters` class that provides information about the desired I/O filters to be applied during the life of this object. chunkshape The shape of the data chunk to be read or written in a single HDF5 I/O operation. Filters are applied to those chunks of data. The dimensionality of `chunkshape` must be the same as that of `shape`. If ``None``, a sensible value is calculated (which is recommended). byteorder The byteorder of the data *on disk*, specified as 'little' or 'big'. If this is not specified, the byteorder is that of the platform. track_times Whether time data associated with the leaf are recorded (object access time, raw data modification time, metadata change time, object birth time); default True. Semantics of these times depend on their implementation in the HDF5 library: refer to documentation of the H5O_info_t data structure. As of HDF5 1.8.15, only ctime (metadata change time) is implemented. .. versionadded:: 3.4.3 Examples -------- See below a small example of the use of the `CArray` class. The code is available in ``examples/carray1.py``:: import numpy import tables fileName = 'carray1.h5' shape = (200, 300) atom = tables.UInt8Atom() filters = tables.Filters(complevel=5, complib='zlib') h5f = tables.open_file(fileName, 'w') ca = h5f.create_carray(h5f.root, 'carray', atom, shape, filters=filters) # Fill a hyperslab in ``ca``. ca[10:60, 20:70] = numpy.ones((50, 50)) h5f.close() # Re-open a read another hyperslab h5f = tables.open_file(fileName) print(h5f) print(h5f.root.carray[8:12, 18:22]) h5f.close() The output for the previous script is something like:: carray1.h5 (File) '' Last modif.: 'Thu Apr 12 10:15:38 2007' Object Tree: / (RootGroup) '' /carray (CArray(200, 300), shuffle, zlib(5)) '' [[0 0 0 0] [0 0 0 0] [0 0 1 1] [0 0 1 1]] ZCARRAYNTc s||_d|_d|_d|_|du|_} ||_d|_||_d|_d|_ d|_ d|_ d|_ d|_ d|_d|_d|_| rlt|tstdt||durtdz t|}Wn"tytdt|Yn0tdd|D|_|durlz t|}Wn$tytd t|Yn0t|t|krBtd ||fnt|d krXtd td d|D|_tt|||| ||| | dS)NTFzHatom parameter should be an instance of tables.Atom and you passed a %s.z"you must specify a non-empty shapez8`shape` parameter must be a sequence and you passed a %scss|]}t|VqdSNr.0sr,lib/python3.9/site-packages/tables/carray.py z"CArray.__init__..z=`chunkshape` parameter must be a sequence and you passed a %sz7the shape (%s) and chunkshape (%s) ranks must be equal.rz1chunkshape parameter cannot have zero-dimensions.css|]}t|VqdSr r r rrrrr)atomshapeZextdim _v_versionZ_v_new _v_new_title _v_convert _v_chunkshapeZ_startZ_stopZ_stepZ _nrowsreadZ_startbZ_stopbZ_rowZ_initZlistarr isinstancer ValueErrortypetuple TypeErrorlenminsuperr__init__) selfZ parentnodenamerrtitlefilters chunkshape byteorder_logZ track_timesnew __class__rrr!sd       zCArray.__init__cCs"t|jdkrtd||jS)z+Create a new array in file (specific part).rz,shape parameter cannot have zero-dimensions.)rrr_g_create_commonZnrows)r"rrr _g_creates zCArray._g_createcCst|_|jdur&|||j|jj|_||_|j durLt |jj t j |_ z| |j|_Wn|jddYn0|jS)z)Create a new array in file (common part).Nr)flush) obversionrrZ_calc_chunkshapeZrowsizersizeZ_calc_nrowsinbuf nrowsinbufr'rrsysZ_create_carrayrZ _v_objectidclose)r"Z expectedrowsrrrr,s     zCArray._g_create_commonc  Ks||||\}}}|j} t|j} tt|||| | <|j} dd|jD}d|_t|||j | |||| d}t|||| D]j}||| }||kr|}t ||||| <|||}|| }|| | kr| | }| t ||||<q~d|_t j|jtd|j j}||fS)z2Private part of Leaf.copy() for each kind of leaf.cSsg|]}td|dqS)rr)slice)r Zdimrrr rz-CArray._g_copy_with_stats..F)rrr$r%r&r(T)Zdtype)Z_process_range_readmaindimlistrrranger1rrrr4 __getitem__rnumpyZprodrr0)r"groupr#startstopstepr$r%r&r(kwargsr6rr1ZslicesobjectZstart2Zstop2Zstart3Zstop3nbytesrrr_g_copy_with_statss0     zCArray._g_copy_with_stats)NNrNNNTT) __name__ __module__ __qualname____doc__Z _c_classidr!r-r,rB __classcell__rrr*rrsgQ r) rFr2r:rrZarrayrZutilsrrr/rrrrrs