ꢩedYdZddlZddlZddlZddlmZddlmZddlm Z ddl Z da dadagdZd Zd Zd Z dd Zd ZdZdS)znThis utility lets you repack your data files in a flexible way. Pass the flag -h to this for help on usage. N)Path) perf_counter) process_timeFT)numericNumericnumarrayNumArray CharArrayc|j}|dD]V}|dkr |||}n3#tjj$r|||||}YnwxYw|}W|S)N/titlefilters)rootsplitget_nodetb exceptionsNoSuchNodeError create_group)dstfilehdstgrouprrgroupnodenamegroup2s 7lib/python3.11/site-packages/tables/scripts/ptrepack.py newdst_grouprs MENN3''   r>>  <&&uh77FF}, < < <**5(163:+<-A.-A.cn|j}|gkrts)tr td|jd|jddStr td|jd|jd|D]M}trtd|z|j|}|dLdSdS)Nz([I]Not regenerating indexes for table: ':'z$[I]Regenerating indexes for table: 'z([I]Indexing column: '%s'. Please wait...)r) _listoldindexes regoldindexesverboseprintfilename _v_pathnamecols_f_col create_index)tablerdsttablelistoldindexescolnamecolobjs rrecreate_indexesr01s*N  A((((*>*>*>@AAA F  = E$$$h&:&:&:< = = =% . .G L@7JKKK]))'22F     - - - - . .ctj|d|}||}|d}|t |dz kr |dd}n|dkr |d|}nd}||dzd}|dkr|j}t |r|stj|dt| } ||}t|tj j sr|ra|j }|j d}|j |dzd}|||||| }ndt!d nT#t"$rt%||||}Yn6wxYwtj|d ||t| }t%||d| } ||||||| | | | | ||| }n#t"$rt)j\}}}t-d|d|d|d|d t-d|d|t-d|||t!d wxYw|r||jdr|dnL|jdkrA|dt8vr%|dtjj|j dkrtC|||||dS)Nr allow_paddingr rr apytables_sys_attrsr5ryPlease check that the node names are not duplicated in destination, and if so, add the --overwrite-nodes flag if desired.wrrr:r5) r copyuserattrs overwritestatsstartstopstep chunkshapesortby check_CSI propindexesProblems doing the copy from 'r ' to 'r!The error was --> : !The destination file looks like: 1FLAVOR2.1TABLE)"r open_filerrindexlennameris_filecreatesysattrs isinstancerGroup _v_parentr'remover RuntimeError Exceptionrcopysysexc_infor%closeformat_version startswithdel_attrget_attr numpy_aliasesset_attrflavorinternal_flavor _c_classidr0)srcfiledstfilesrcnodedstnoderrr> overwritefile overwrtnodesr@rArBrCrDrErFrGupgradeflavorsr5srcfileh last_slashrdstleafrparent dstgroupnametype_value tracebacks r copy_leafryEs |GS FFFH((G$$JS\\!^##3B3< a;J;'j1noo&G"}}, G}}O}O<3A.;=== ;((22H h77 ; ;%/F!)!5!r?r@rArBrCrDrErFrG use_hardlinksrHr rIr!rJrKrLzPlease check that the node names are not duplicated in destination, and if so, add the --overwrite-nodes flag if desired. In particular, pay attention that root_uep is not fooling you.LeafrMrNrOTable)%rrQrrrUrVrrWrrXrYr'rRrZrr[rrr_v_attrs_f_copy_f_copy_childrenr\r^r_r%r` _f_walknodesrarbrcrdrerfrgrhr0)!rjrksrcgrouprrr|rr>rnror@rArBrCrDrErFrGrpr5r}rqcreated_dstgrouprrtrrrurvrwrxrmr+r,s! r copy_childrenrs|GS8*7999H}H G}}! }! <3A.;=== ;((22Hh77 ; ;%/F!)!5!>$$Xry/HIII&&w//44$$Xu/@AA(3333 NN NNs#D (D54D5 #F//BI ctjd}|dddd|dd dd d |d dddd|ddddd|dddd|ddddd |d!ddd"d#|d$dd%d& |d'td(d)*|d+d,d-d./|d0td1d23|d4td1d53|d6td1d73|d8dd9d: |d;d|d?dd@dA |dBdddCdD|dEdFdGH|dIddJ|dKddL|dMddNdO |dPdQdRH|dSdTdUH|S)VNaThis utility is very powerful and lets you copy any leaf, group or complete subtree into another file. During the copy process you are allowed to change the filter properties if you want so. Also, in the case of duplicated pathnames, you can decide if you want to overwrite already existing nodes on the destination file. Generally speaking, ptrepack can be useful in may situations, like replicating a subtree in another file, change the filters in objects and see how affect this to the compression degree or I/O performance, consolidating specific data in repositories or even *importing* generic HDF5 files and create true PyTables counterparts.) descriptionz-vz --verbose store_truezshow verbose information)actionhelpz-oz --overwriternzoverwrite destination file)rdestrz-Rz--rangerngRANGEzselect a RANGE of rows (in the form "start,stop,step") during the copy of *all* the leaves. Default values are "None,None,1", which means a copy of all the rows.)rmetavarrz--non-recursive store_falseTr|z/do not do a recursive copy. Default is to do it)rdefaultrrz --dest-titlerr z?title for the new file (if not specified, the source is copied))rrrz--dont-create-sysattrsrVz-do not create sys attrs (default is to do it)z--dont-copy-userattrsr>z0do not copy the user attrs (default is to do it)z--overwrite-nodesrozSoverwrite destination nodes if they exist. Default is to not overwrite themz --complevelrzLset a compression level (0 for no compression, which is the default))typerrz --complib)zliblzobzip2bloscz blosc:blosclzz blosc:lz4z blosc:lz4hcz blosc:zlibz blosc:zstdblosc2zblosc2:blosclzz blosc2:lz4z blosc2:lz4hcz blosc2:zlibz blosc2:zstdrzWset the compression library to be used during the copy. Defaults to %(default)s)choicesrrz --shuffle)rr6zOactivate or not the shuffle filter (default is active if complevel > 0))rrrz --bitshufflez=activate or not the bitshuffle filter (not active by default)z --fletcher32zPwhether to activate or not the fletcher32 filter (not active by default)z--keep-source-filters keepfilterszuse the original filters in source files. The default is not doing that if any of --complevel, --complib, --shuffle --bitshuffle or --fletcher32 option is specifiedz --chunkshapekeepzset a chunkshape. Possible options are: "keep" | "auto" | int | tuple. A value of "auto" computes a sensible value for the chunkshape of the leaves copied. The default is to "keep" the original value)rrz--upgrade-flavorsrpzwhen repacking PyTables 1.x or PyTables 2.x files, the flavor of leaves will be unset. With this, such a leaves will be serialized as objects with the internal flavor ('numpy' for 3.x series)z--dont-regenerate-old-indexesr#zddisable regenerating old indexes. The default is to regenerate old indexes as they are foundz--sortbyCOLUMNzdo a table copy sorted by the index in "column". For reversing the order, use a negative value in the "step" part of "RANGE" (see "-r" flag). Only applies to table objects)rrz --checkCSIz7force the check for a CSI index for the --sortby columnz --propindexeszpropagate the indexes existing in original tables. The default is to not propagate them. Only applies to table objectsz--dont-allow-paddingdont_allow_paddingzremove the possible padding in compound types in source files. The default is to propagate it. Only applies to table objectssrczsourcefile:sourcegroupzsource file/groupdstzdestfile:destgroupzdestination file/group)argparseArgumentParser add_argumentint)parsers r _get_parserrs  $    F  k, '  mL )  ieW -  >  Wb N    <   t  ?  L~,  C   #    #v  S& L S&   =F  G L7GH  ' t F  HC  \ F  D  | !J   /6I  +2J Mr1c t}|}|jrF td|jzdz|_n%#t$r|dYnwxYw|js|jdrt|j|_|j dks |j dkr|d|j dd }|j dd }t|d kr |dd }}n|\}}t|d kr |dd }}n|\}}|d krd }|d krd }tjd t jj |jr%tjd t jj |j |j|j|j|jf}|dks|jrd} n|j d|_ |j|j dkrd|_nd|_|jd|_|jrd|_|jd|_|jd|_t j|j |j|j|j|j} d\} } } |jr$|jj|jj|jj} } } |ja|j a |j!a!tE} tG}t>rtIdtId|j%tId| |j&*tId|j&tId|j'|j(rtIdtId|d|d|d|tId|j) }t!j*|d|}|+|}|,dddddd}t[|t j.j/rtta||||fid|j1d |j%d!| d"|j2d#|j3d$|j4d%|d&| d'| d(| d)|jd*|j&d+|j'd,|j(d-|jd.|d/dnKtk||||f|j1| |j2|j3|j4|| | | |j|j&|j'|j(|j|d0tE}tG}|| z }||z }t>r|d1}|d2}|d3}|d4}|d5}||z|z|z}tId6|d7|d8|d9||j2rtId:ntId;tId<|d=z d>tId?|d>d@|d>dA||z dBtIdC||z dDtIdE||z d=z dFdSdS)GNzslice()z'Error when getting the range parameter.(r z9invalid "complevel" value, it sould be in te range [0, 9]r r6r r ignore)category)NNNNTFr) complevelcomplibshuffle bitshuffle fletcher32)NNr6z<+=++=++=++=++=++=++=++=++=++=++=++=++=++=++=++=++=++=++=++=+zRecursive copy:zApplying filters:zSorting table(s) by column:zForcing a CSI creation:z%Recreating indexes in copied table(s)zStart copying z to r3r4)groupsleaveslinksbytes hardlinksrr|rr>rnror@rArBrCrDrErFrGrpr5r})rrr>rnror@rArBrCrDrErFrGrpr5rrrrrzGroups copied:z, Leaves copied:z, Links copied:z, Hard links copied:zUser attrs copiedzUser attrs not copiedzKBytes copied: iz.3fzTime copying: z s (real) z s (cpu) z.0%zCopied nodes/sec: z.1fzCopied KB/s : z.0f)6r parse_argsrevalr\errorrDisdigitrbrrrsplitrrSwarningsfilterwarningsrrOldIndexWarningrp FlavorWarningrrrrrleafFiltersrArBrCr$r#rVclockcpuclockr%r|rEcheckCSIrGrrQrr`rWrrXrrr>rnrory)rargsrrrjrlrkrm filter_paramsrrArBrCt1cpu1r5 h5srcfile srcnodeobjectr@t2cpu2tcopycpucopyngroupsnleavesnlinks nhardlinks nbytescopiednnodess rmainrs6 ]]F     D xD DHtx/#566DHH D D D LLB C C C C C D   0DO$>$>s$C$C0t// ~T^a// G   (//#q ! !C (//#q ! !C 3xx1}}q63 3xx1}}q63"}}"}} Hr}/LMMMM P2=3NOOOO      M $$(8$ > !DN < ~!!# $ ? "#DO ? ! DL < !DL ? "#DO'//DN*., -1_-1_">> &E4 xI HNDHM48=TtlG&M(N B ::D  j 000 !7+++ ; " / = = = +T] ; ; ;   ; 9 : : : IwIIIIgIIIIJJJ j//M WcGGGI&&w//MOOAAA N NE-00  Wgw ** (, @G ,, =A777888 @|e3d:@@@AAAAA/BBsA A-,A-)T)__doc__rr^rpathlibrtimerrrrtablesrr$r#rVrerr0ryrrrr1rrs  &&&&&&))))))   $...(\\\F@D ^^^^BHHHVmBmBmBmBmBr1