a ߙfbN6@sddlZddlZddlZddlmZddlmZddgZddZ d d Z d d Z Gd ddZ Gddde Z Gddde ZdS)N)get_index_by_names)AstropyUserWarning TableGroups ColumnGroupscCs8|dt||WdS1s*0YdS)NZdiscard_on_copy)Z index_mode_table_group_by)tablekeysr 3lib/python3.9/site-packages/astropy/table/groups.pytable_group_bys r cs,ddlm}ddlm}t|tr(|f}t|ttfr|D]B}|jvrVt d|j r:t |j r:t d|dq:jfdd|Dd d }t|}d }nXt|t j|fr|}t|tkrt d t|td }d }ntdt||st||r||}z(|d ur2|}n |jdd}d } Wn(tyl|}tdv} Yn0||}t d g|dd |d dkd gf} t | } | st| d d| dd D]\} } || | qȈ|}|| d d}t||r||jd<t|| |d|_|S)a2 Get groups for ``table`` on specified ``keys``. Parameters ---------- table : `Table` Table to group keys : str, list of str, `Table`, or Numpy array Grouping key specifier Returns ------- grouped_table : Table object with groups attr set accordingly rTablerepresent_mixins_as_columnszTable does not have key column zMissing values in key column z are not allowedcsg|] }|qSr r ).0keyrr r 3z#_table_group_by..F)copyTz9Input keys array length {} does not match table length {}NzHKeys input must be string, list, tuple, Table or numpy array, but got {}Z mergesort)kind)ZDarwinZWindowsgrouped_by_table_colsindicesr ) rr serializer isinstancestrlisttuplecolnames ValueErrormaskednpanymask __class__rndarraylenformat TypeErrortypeZ sorted_dataargsortplatformsystem concatenate flatnonzerozipsortmetar_groups)rr rrnameZ table_keysZ table_indexridx_sortZ stable_sortdiffsri0i1outZout_keysr rr rs\         ( "  rcCsddlm}ddlm}t||r2||}|}t|tjsPtdt |t |t |krxt d t |t || }||}tdg|dd|ddkdgf}t|}|||}t||||ddd |_|S) a= Get groups for ``column`` on specified ``keys`` Parameters ---------- column : Column object Column to group keys : Table or Numpy array of same length as col Grouping key specifier Returns ------- grouped_column : Column object with groups attr set accordingly rr rz(Keys input must be numpy array, but got z:Input keys array length {} does not match column length {}TNrr)rrrrrZas_arrayr$r(r+r,r)r"r*r-r0r1r'rr5)columnr rrr7r8rr;r r r column_group_byqs$     ( r=c@sHeZdZdZeddZddZddZeZdd Z d d Z d d Z dS) BaseGroupsa4 A class to represent groups within a table of heterogeneous data. - ``keys``: key values corresponding to each group - ``indices``: index values in parent table or column corresponding to group boundaries - ``aggregate()``: method to create new table by aggregating within groups cCst|tr|jS|jSN)rr parent_column parent_tableselfr r r parentszBaseGroups.parentcCs d|_|SNr) _iter_indexrBr r r __iter__szBaseGroups.__iter__cCsV|j}|t|jdkrN|j||j|d}}|jd7_|j||StdSNr)rFr)rrD StopIteration)rCZiir9r:r r r nexts zBaseGroups.nextc Cs|j}t|ttjfrN|j||j|d}}|||}|jj||j_n|jdd|jdd}}z||||}} Wn.t y} zt d| WYd} ~ n d} ~ 00tj t |t d} t|| D]\}}d| ||<q|| }|jj||j_tdgt| |g|j_|S)NrrzHIndex item for groups attribute must be a slice, numpy mask or int arraydtypeTr)rDrintr$Zintegerrgroupsr _keys Exceptionr+Zzerosr)boolr2r0Zcumsum_indices) rCitemrDr9r:r;Zindices0Zindices1i0si1serrr&r r r __getitem__s& zBaseGroups.__getitem__cCsd|jjd|jdS)N)r'__name__rrBr r r __repr__szBaseGroups.__repr__cCst|jdSrH)r)rrBr r r __len__szBaseGroups.__len__N) rZ __module__ __qualname____doc__propertyrDrGrJ__next__rWr[r\r r r r r>s r>c@s>eZdZd ddZeddZeddZdd Zd d ZdS) rNcCs||_|j|_||_||_dSr?)r@rArRrO)rCr@rr r r r __init__szColumnGroups.__init__cCs8|jr|jjjS|jdur.tdt|jgS|jSdSrE)rArNrrRr$arrayr)r@rBr r r rs   zColumnGroups.indicescCs|jr|jjjS|jSdSr?)rArNr rOrBr r r r s zColumnGroups.keysc s4ddlm}|jdd|jdd}}|jt|}td}tju}tju}zl|s|sj|sj|r|rtj |t |j} q|rtj |} n t fddt ||D} Wn@ty} z&tdjjjj| WYd} ~ n d} ~ 00j| jjjjjjjjjjd} | S) Nr) MaskedColumnrreduceatcs g|]\}}||qSr r )rr9r:funcZpar_colr r rrz*ColumnGroups.aggregate..z+Cannot aggregate column '{}' with type '{}')datar6 descriptionunitr*r4)r<rdrr@rhasattrr$sumZmeanaddreZdiffrcr2rPr+r*infor6rLr'rirjr4) rCrgrdrTrUr#reZsum_caseZ mean_caseZvalsrVr;r rfr aggregates<     $zColumnGroups.aggregatecCs8tjt|td}t|D]\}}||||<q||S)a Filter groups in the Column based on evaluating function ``func`` on each group sub-table. The function which is passed to this method must accept one argument: - ``column`` : `Column` object It must then return either `True` or `False`. As an example, the following will select all column groups with only positive values:: def all_positive(column): if np.any(column < 0): return False return True Parameters ---------- func : function Filter function Returns ------- out : Column New column with the aggregated rows. rK)r$emptyr)rQ enumerate)rCrgr&iZ group_columnr r r filterszColumnGroups.filter)NN) rZr]r^rbr`rr rorsr r r r rs    c@sJeZdZdddZeddZeddZdd Zd d Zed d Z dS)rNcCs||_||_||_dSr?)rArRrO)rCrArr r r r rb3szTableGroups.__init__cCs&t|jdidd}|r"|jjSdS)z^ Return the names of columns in the parent table that were used for grouping. r4rFr )getattrr getr!)rCrr r r key_colnames8s zTableGroups.key_colnamescCs(|jdurtdt|jgS|jSdSrE)rRr$rcr)rArBr r r rDs zTableGroups.indicesc Cs|jdd}g}|j}|jD]z}|jj|jvr@||}nRz|j |}Wn@t y}z(t t |tWYd}~q"WYd}~n d}~00||q"|j||jdS)a Aggregate each group in the Table into a single row by applying the reduction function ``func`` to group values in each column. Parameters ---------- func : function Function that reduces an array of values to a single value Returns ------- out : Table New table with the aggregated rows. Nr)r4)rrAcolumnsvaluesrnr6rvZtakerNror+warningswarnrrappendr'r4)rCrgrTZout_colsrAcolZnew_colrVr r r roKs " zTableGroups.aggregatecCs@tjt|td}|j}t|D]\}}|||||<q ||S)a Filter groups in the Table based on evaluating function ``func`` on each group sub-table. The function which is passed to this method must accept two arguments: - ``table`` : `Table` object - ``key_colnames`` : tuple of column names in ``table`` used as keys for grouping It must then return either `True` or `False`. As an example, the following will select all table groups with only positive values in the non-key columns:: def all_positive(table, key_colnames): colnames = [name for name in table.colnames if name not in key_colnames] for colname in colnames: if np.any(table[colname] < 0): return False return True Parameters ---------- func : function Filter function Returns ------- out : Table New table with the aggregated rows. rK)r$rpr)rQrvrq)rCrgr&rvrrZ group_tabler r r rsns zTableGroups.filtercCs|jSr?)rOrBr r r r szTableGroups.keys)NN) rZr]r^rbr`rvrrorsr r r r r r2s   #%)r.ryZnumpyr$indexrZastropy.utils.exceptionsr__all__r rr=r>rrr r r r s  \,9\