a ߙfbi@s@dZddlZddlZddlZddlZddlZddlmZddlm Z ddl m Z ddl m Z ddlmZddlZdd lmZgd Zeed d fZd ddd dZeddZddZddZddZd*ddZGdddZGdddZGdd d e Z!Gd!d"d"e!d#Z"Gd$d%d%e"Z#Gd&d'd'e#Z$Gd(d)d)e$Z%dS)+aThis module contains functions and methods that relate to the DataInfo class which provides a container for informational attributes as well as summary info methods. A DataInfo object is attached to the Quantity, SkyCoord, and Time classes in astropy. Here it allows those classes to be used in Tables and uniformly carry table column attributes such as name, format, dtype, meta, and description. N)StringIO)deepcopy)partial) OrderedDict)contextmanager)metadata)data_info_factorydtype_info_nameBaseColumnInfoDataInfo MixinInfoParentDtypeInfozUAll-NaN|Mean of empty slice|Degrees of freedom <= 0|invalid value encountered in sqrt)categorymessagestrZunicodebytes))FS)FU)Tr)Trccs*tj}|t_zdVW|t_n|t_0dS)avSet context for serialization. This will allow downstream code to understand the context in which a column is being serialized. Objects like Time or SkyCoord will have different default serialization representations depending on context. Parameters ---------- context : str Context name, e.g. 'fits', 'hdf5', 'parquet', 'ecsv', 'yaml' N)r _serialize_context)contextZ old_contextr6lib/python3.9/site-packages/astropy/utils/data_info.pyserialize_context_as0s rcCsJt|}|jdvr@td|jd}td|jf}||}n|j}|S)ahReturn a human-oriented string name of the ``dtype`` arg. This can be use by astropy methods that present type information about a data object. The output is mostly equivalent to ``dtype.name`` which takes the form [B] where is like ``int`` or ``bool`` and [B] is an optional number of bits which gets included only for numeric types. For bytes, string and unicode types, the output is shown below, where is the number of characters. This representation corresponds to the Python type that matches the dtype:: Numpy S U Python bytes str Parameters ---------- dtype : str, `~numpy.dtype`, type Input dtype as an object that can be converted via np.dtype() Returns ------- dtype_info_name : str String name of ``dtype`` )rrz(\d+)rT) npdtypekindresearchrgroupSTRING_TYPE_NAMESname)rlengthZ type_nameoutrrrr Es   r csfdd}|S)a4 Factory to create a function that can be used as an ``option`` for outputting data object summary information. Examples -------- >>> from astropy.utils.data_info import data_info_factory >>> from astropy.table import Column >>> c = Column([4., 3., 2., 1.]) >>> mystats = data_info_factory(names=['min', 'median', 'max'], ... funcs=[np.min, np.median, np.max]) >>> c.info(option=mystats) min = 1 median = 2.5 max = 4 n_bad = 0 length = 4 Parameters ---------- names : list List of information attribute names funcs : list List of functions that compute the corresponding information attribute Returns ------- func : function Function that can be used as a data info option c sg}tD]\}}z$t|tr0t||}n||}WntyV|dYq0z||dWqttfy|t|Yq0qtt|S)Nz--g) zip isinstancergetattr Exceptionappend TypeError ValueErrorr)datZoutsr!funcr#funcsnamesrrr-s   zdata_info_factory..funcr)r0r/r-rr.rr jsr cCs.i}|D] }t||d}|dur|||<q|S)a[ Get the values for object ``attrs`` and return as a dict. This ignores any attributes that are None and in Py2 converts any unicode attribute names or values to str. In the context of serializing the supported core astropy classes this conversion will succeed and results in more succinct and less python-specific YAML. N)r')objattrsr#attrvalrrr_get_obj_attrs_maps   r5cCsn|dkrt|j}nF|dkr*t|jj}n0|dkrN|jdd}|rH|nd}n t|j|}|durfd}t|S)zP Get a data object attribute for the ``attributes`` info summary method classrshaperN)type__name__r inforr7r'r)r,r3r4Zdatshaperrr_get_data_attributes  r<c@s&eZdZdddZddZddZdS) InfoAttributeNcCs||_||_dSN)r3default)selfr3r?rrr__init__szInfoAttribute.__init__cCs|dur |S|j|j|jSr>)_attrsgetr3r?r@instance owner_clsrrr__get__szInfoAttribute.__get__cCs |durtd||j|j<dSNcannot set unbound descriptor)r+rBr3r@rEvaluerrr__set__szInfoAttribute.__set__)Nr: __module__ __qualname__rArGrLrrrrr=s r=c@s$eZdZddZddZddZdS)ParentAttributecCs ||_dSr>r3)r@r3rrrrAszParentAttribute.__init__cCs|dur |St|j|jSr>)r'_parentr3rDrrrrGszParentAttribute.__get__cCs$|durtdt|j|j|dSrH)r+setattrrRr3rJrrrrLszParentAttribute.__set__NrMrrrrrPsrPcs(eZdZfddZfddZZS) DataInfoMetacs|dgt||||S)N __slots__) setdefaultsuper__new__)mclsr!basesdct __class__rrrXs zDataInfoMeta.__new__c st||||jD]n}||vrt||d}||jvr\d|vrt|tst||t|q|rjt|trt||t||j |qdS)Nattrs_from_parent) rWrA attr_namesr'r^r&rPrSr=_attr_defaultsrC)clsr!rZr[r3Zcls_attrr\rrrAs   zDataInfoMeta.__init__)r:rNrOrXrA __classcell__rrr\rrTs rTcseZdZdZgdZeZegdZde diZ eZ dZ gdZ dZdZd Zd%d d Zed dZddZddZddZddZd&ddZddZeee dde DdZeeeddeDdZd'd!d"Zfd#d$ZZ S)(r a Descriptor that data classes use to add an ``info`` attribute for storing data attributes in a uniform and portable way. Note that it *must* be called ``info`` so that the DataInfo() object can be stored in the ``instance`` using the ``info`` key. Because owner_cls.x is a descriptor, Python doesn't use __dict__['x'] normally, and the descriptor can safely store stuff there. Thanks to https://nbviewer.jupyter.org/urls/gist.github.com/ChrisBeaumont/5758381/raw/descriptor_writeup.ipynb for this trick that works for non-hashable classes. Parameters ---------- bound : bool If True this is a descriptor attribute in a class definition, else it is a DataInfo() object that is bound to a data object instance. Default is False. )ZmeanZstdminmax)r!unitrformat descriptionmetarO)rr7rerfrgr6) _parent_cls _parent_refrBrNFcCs|r i|_dSr>rBr@boundrrrrA3szDataInfo.__init__cCs6z |}Wnty YdS0|dur2td|S)Naxfailed access "info" attribute on a temporary object. It looks like you have done something like ``col[3:5].info``, i.e. you accessed ``info`` from a temporary slice object ``col[3:5]`` that only exists momentarily. This has failed because the reference to that temporary object is now lost. Instead force a permanent reference with ``c = col[3:5]`` followed by ``c.info``.)rkAttributeError)r@parentrrrrR:s   zDataInfo._parentcCsL|dur||_|S|jd}|dur<|jdd}|jd<t||_|S)Nr;Trn)rj__dict__rCr]weakrefrefrk)r@rErFr;rrrrGMs  zDataInfo.__get__cCs|durtdt|tr|jdd}|jd<|j}|j|jurR|t|j@}n||j|j@}||j |jD]}t t |||j|<qrnt ddS)NrITrqr;z)info must be set with a DataInfo instance) r+r&r r]rrr_setrB_attrs_no_copyr^rr'r*)r@rErKr;r_r3rrrrL\s  zDataInfo.__set__cCs|jSr>rlr@rrr __getstate__sszDataInfo.__getstate__cCs ||_dSr>rl)r@staterrr __setstate__vszDataInfo.__setstate__cCs|dur|j}t|j|S)z|Get the values for the parent ``attrs`` and return as a dict. By default, uses '_represent_as_dict_attrs'. N)_represent_as_dict_attrsr5rR)r@r2rrr_represent_as_dictyszDataInfo._represent_as_dictcs$fdd|jD}|j|iS)Ncsg|]}|qSr)pop.0r3maprr z1DataInfo._construct_from_dict..)_construct_from_dict_argsrj)r@rargsrrr_construct_from_dictszDataInfo._construct_from_dictcCsg|]}tt|dqS)rQ)rr<r~rrrrszDataInfo.)r0r/cCsg|]}ttd|qS)nan)r'r)rstatrrrrs attributesr8c Cs|dkrtj}|j}t}|jj}|dur2||d<t|ttfrD|n|g}|D]}t|t rt |d|rzt |d|}nt d |t8tD]}tjd i|q|||WdqN1s0YqNt |drt|j}n8ztt|t|B}Wnty(d}Yn0||d <zt||d <WnttfyZYn0|durj|S|D].\} } | dkrr|| d | tjqrdS) a Write summary information about data object to the ``out`` filehandle. By default this prints to standard output via sys.stdout. The ``option`` argument specifies what type of information to include. This can be a string, a function, or a list of strings or functions. Built-in options are: - ``attributes``: data object attributes like ``dtype`` and ``format`` - ``stats``: basic statistics: min, mean, and max If a function is specified then that function will be called with the data object as its single argument. The function must return an OrderedDict containing the information attributes. If a list is provided then the information attributes will be appended for each of the options, in order. Examples -------- >>> from astropy.table import Column >>> c = Column([1, 2], unit='m', dtype='int32') >>> c.info() dtype = int32 unit = m class = Column n_bad = 0 length = 2 >>> c.info(['attributes', 'stats']) dtype = int32 unit = m class = Column mean = 1.5 std = 0.5 min = 1 max = 2 n_bad = 0 length = 2 Parameters ---------- option : str, callable, list of (str or callable) Info option, defaults to 'attributes'. out : file-like, None Output destination, defaults to sys.stdout. If None then the OrderedDict with information attributes is returned Returns ------- info : `~collections.OrderedDict` or None `~collections.OrderedDict` if out==None else None r8Nr!Z info_summary_z,option={} is not an allowed information typeignoremaskrn_badr"z = )r) sysstdoutrRrr;r!r&listtuplerhasattrr'r+rfwarningscatch_warningsIGNORE_WARNINGSfilterwarningsupdaterZ count_nonzerorZisinfZisnanr(lenr* IndexErroritemswriteoslinesep) r@Zoptionr#r,r;r!ZoptionsZ ignore_kwargsrkeyr4rrr__call__sF7  .    zDataInfo.__call__cs.|jdurtSt}|j|d|S)N)r#)rRrW__repr__rrgetvalue)r@r#r\rrrs    zDataInfo.__repr__)F)N)rr8)!r:rNrO__doc__Z_statsrur^r_rrr`rvZ_info_summary_attrsrUr{rZ_represent_as_dict_primary_datarApropertyrRrGrLrxrzr|r staticmethodr Zinfo_summary_attributesZinfo_summary_statsrrrbrrr\rr sH     cr ) metaclasscseZdZdZejddgZeddgZdZ ddgZ e ddZ e j d dZ dfd d Zfd dZddZe ddZej ddZddZddZeddZddZZS)r ag Base info class for anything that can be a column in an astropy Table. There are at least two classes that inherit from this: ColumnInfo: for native astropy Column / MaskedColumn objects MixinInfo: for mixin column objects Note that this class is defined here so that mixins can use it without importing the table package. parent_tableindicesN _format_funcs _copy_indicescCs|jd}t|r|}|SNr)rBrCcallable)r@rKrrrrs zBaseColumnInfo.parent_tablecCs0|dur|jddnt|}||jd<dSr)rBr}rsrt)r@rrrrrs Fcstj|d|ri|_dS)Nrq)rWrArrmr\rrrA#szBaseColumnInfo.__init__cs6z|jsWdSWnty"Yn0t||dSr>)r7rorWrLrJr\rrrL+s   zBaseColumnInfo.__set__ccsL|j}|jdurddlm}n|jj}|j}||dddiD] }|Vq.rg333333?)Zastropy.table.sorted_arrayrr'r;rr&rrrrrrrZ get_slicerZ replace_rowsr))r@Z col_slicerrrZsmallrZ new_indexrrr slice_indicesus$     zBaseColumnInfo.slice_indicesc sddlm}fdd}fdd}||d}|ddD]}tj|||||d }q.warn_str_funccsfddDS)Ncs,i|]$}tj|ddur|tj|qSr>)r'r;r~rrr szJBaseColumnInfo.merge_cols_attributes..getattrs..rr)r2rrgetattrssz6BaseColumnInfo.merge_cols_attributes..getattrsrN)metadata_conflictsrrcss|]}|jddVqdS)rN)r7)rrrrr rz7BaseColumnInfo.merge_cols_attributes..zcolumns have different shapesr7r!)astropy.table.np_utilsrrmergeZ common_dtyperurr}) Zcolsrr!r2rrrr#rZ uniq_shapesr)r2r!rmerge_cols_attributess       z$BaseColumnInfo.merge_cols_attributescCstd|jddS)a  Return a list of arrays which can be lexically sorted to represent the order of the parent column. The base method raises NotImplementedError and must be overridden. Returns ------- arrays : list of ndarray zcolumn z is not sortableN)NotImplementedErrorr!rwrrrget_sortable_arrayss z"BaseColumnInfo.get_sortable_arrays)F)r:rNrOrr r_unionrurvrrUrrsetterrArLrrrrrrrrbrrr\rr s*       &* :r c@s&eZdZeddZejddZdS)r cCs |jdS)Nr!)rBrCrwrrrr!szMixinInfo.namecCs>|jdur0ddlm}||}|jj|j|||jd<dS)Nr)fix_column_namer!)rrrcolumnsZ_rename_columnr!rB)r@r!rnew_namerrrr!s   N)r:rNrOrr!rrrrrr s r c@seZdZdZedgZdS)rz&Mixin that gets info.dtype from parentrN)r:rNrOrrur^rrrrrsr)N)&rrrrrsriorcopyr functoolsr collectionsr contextlibrZnumpyrr8r__all__dictRuntimeWarningrr rr r r5r<r=rPr9rTr r r rrrrrsD       %3  yl