HR-eddlZddlZddlZddlZddlmZddlmZm Z m Z m Z ddl m Z ddlmZmZddlmZmZmZmZmZgdZGd d eZGd d ZGd deZGddeeZGddZdS)N)Header)_is_dask_array_is_int_is_pseudo_integer _pseudo_zero) VerifyWarning) isiterable lazyproperty) BITPIX2DTYPEDELAYED DTYPE2BITPIX ExtensionHDU _ValidHDU)Section PrimaryHDUImageHDUcteZdZdZdddddddd Z d'fd ZedZedZ edZ edZ edZ e j dZ edZej dZdZd(dZd)dZ d*dZd+fd ZdZd,fd Zd Zd!Zd"Zd#Zd$Zd%Zfd&ZxZS)- _ImageBaseHDUz{FITS image HDU base class. Attributes ---------- header image header data image data zconforms to FITS standardzImage extensionzarray data typeznumber of array dimensionsz has groupsznumber of parametersznumber of groups)SIMPLEXTENSIONBITPIXNAXISGROUPSPCOUNTGCOUNTNFTc ddlm}t|||tur|t dnz*_ImageBaseHDU.__init__..osJ    L  Ws4!8}}4a 8 8   BLANKnameverF)$groupsrsuper__init__r ValueError isinstancerstandard_keyword_commentsappendcopyrextendr)_do_not_scale_image_data_uint _scale_backr*_bzero_bscalerange_axes_bitpix_gcount_pcount_blank _verify_blank _orig_bitpix _orig_blank _orig_bzero _orig_bscaler3r4 _modified_data_needs_rescaler)r.rr do_not_scale_image_datauint scale_back ignore_blankkwargsrc0cardsorigbzero_in_headerbscale_in_header __class__s` r/r7z_ImageBaseHDU.__init__.s &%%%%% d6222 7??~ !:;;;$ -- P '4+I*+UVd&DX&NO1d>DD #XtXXX zRN4NNN!% f 9 DJJ( 8DLDLDKDKdj))DJ J        * *4: 6 6 6!L L; s BB7c|js*|jjs|jr|j|jjksdS|jdd}d|jvr|jd}n|jjd}|jd|j |d|jrL|j|jjkr7t|jj|_ |j d|jvr|jjd}n |jd}|jdt|j |dt|j D]f\}}dt|dzz}||jvr ||j|<.|dkrd}ndt|z}|j|||gt!t|j dz|dzD]+} |jdt|z=#t"$rY(wxYwd|jvr|jd|_|d|_dS) zD Update the header keywords to agree with the data. Nrrrafterr r2F)rNr) _has_datarirr*r:commentssetrEr|rDr}ro enumerater+rCKeyErrorrH!_update_pseudo_int_scale_keywords)r. old_naxisbitpix_comment naxis_commentidxr-naxisnrs r/rmz_ImageBaseHDU.update_headerBsq N |%  $(:#@#@ FL$$Wa00 4< ' '!;HENN!\28 !djDIO;;dio..DJ J    dl " " L1':MM :7CM #dj//=QQQ #4:.. < rLrM_dtype_for_bitpixkindr@r)r;rrr3rArBrEpoprH)r.rskeywords r/rrz'_ImageBaseHDU._update_header_scale_infos6&  (    ! !d&71&<&< F =**,,E   c!!!"%)%5%= F*  G L) ##%%%%     =**,,E  %1%*%=DL "  |H- l&&w55 s!A:: BBoldc:|||||ddS)ao Scale image data by using ``BSCALE``/``BZERO``. Call to this method will scale `data` and update the keywords of ``BSCALE`` and ``BZERO`` in the HDU's header. This method should only be used right before writing to the output file, as the data will be scaled and is therefore not very usable after the call. Parameters ---------- type : str, optional destination data type, use a string representing a numpy dtype name, (e.g. ``'uint8'``, ``'int16'``, ``'float32'`` etc.). If is `None`, use the current data type. option : str, optional How to scale the data: ``"old"`` uses the original ``BSCALE`` and ``BZERO`` values from when the data was read/created (defaulting to 1 and 0 if they don't exist). For integer data only, ``"minmax"`` uses the minimum and maximum of the data to scale. User-specified ``bscale``/``bzero`` values always take precedence. bscale, bzero : int, optional User-specified ``BSCALE`` and ``BZERO`` values N)typeoptionbscalebzeroblank)_scale_internal)r.rrrrs r/scalez_ImageBaseHDU.scales66 fV5      r1rc|jdS|t|j}tt|}|||}|}n[||}d}nS|d}|}nK|dkr|j|j|j}|j}n'|dkrt|tjst|jrW|j } |j } nRtj |jj} tj|jj} |tjkr | }| | z dz }n-| | zdz }d|jz} | | z d| zd z z }nd}d}|dkrRt|jr|j|z |_n#t j|j| |jd ||jd <n |jd =n#t*$rYnwxYw|r |dkr|j|z |_||jd <n |jd =n#t*$rYnwxYw|Et|tjr+||jt j|j<||jd<|jjj|kr2t jt j|j||_t8|jjj|_|jd d|_|jd d|_ ||_!|j|jd<|j|_"|j|_|j |_|j!|_#dS)a This is an internal implementation of the `scale` method, which also supports handling BLANK properly. TODO: This is only needed for fixing #3865 without introducing any public API changes. We should support BLANK better when rescaling data, and when that is added the need for this internal interface should go away. Note: the default of ``blank=0`` merely reflects the current behavior, and is not necessarily a deliberate choice (better would be to disallow conversion of floats to ints without specifying a BLANK if there are NaN/inf values). Nrr rminmaxgo@g@r"unsafe)outcastingr&r'r2rsr)$rr rEgetattrrwrMrL issubclassfloatingrmincomputemaxminimumreduceflatmaximumuint8itemsizeaddr)rintegerisnanrsrryaroundrr3r*rArBrHrJrK) r.rrrrr_type_scale_zerorrnbytess r/rz_ImageBaseHDU._scale_internals" 9  F < -DD!!  %"3FEE  FEE  FEE eOO!- ,&F$EE x   5"+(F(F di(( 8immoo--//immoo--//j'' 77j'' 77  ) 3sc)UUWW--)V a8FE A::di(( K I- ty5&diJJJJ$)DL ! ! L))      fkk F*DI%+DL " " L**      E2:!>!> .3DIbhty)) *$)DL ! 9? 5 ( (49!5!5UCCCDI$DIO$89 l&&w22 |''!44  !% X !L; L;s$1G:: HH-H66 IIwarnc||t|Srk)rmrIr6_verify)r.rrZs r/rz_ImageBaseHDU._verifyQs?  wwv&&&r1c8|jdSg}t|js4|d|jd|_|jdks|dd|_|D]}t j|tdS)Nz~Invalid value for 'BLANK' keyword in header: {!r} The 'BLANK' keyword must be an integer. It will be ignored in the meantime.rz|Invalid 'BLANK' keyword in header. The 'BLANK' keyword is only applicable to integer data, and will be ignored in this HDU.)rHrr;formatrEwarningsrr)r.messagesmsgs r/rIz_ImageBaseHDU._verify_blankYs ;  Ft{##  OO++16$++>+>    DK|a OO    DK . .C M#} - - - - . .r1c|jr,|t|j|j||s|jr|j}t ||S)N)r) r@rr rJrKrmrOrr6 _prewriteto)r.checksuminplace_rZs r/rz_ImageBaseHDU._prewritetous     T./t7G !     43  Aww""8W555r1c d}|j|St|jr||Stjdkrd}nd}t |jjrJtj|jt|jjz d|jjj }d}n|j}|jj d}||v}|r|j j r[|d |||dnX#|dwxYw||dn||||j|j zz }|S) Nrlittle<=rz>irFT)rr_writeinternal_dasksys byteorderrrsrwryrrr+flags writeablebyteswap writearraysize)r.fileobjr swap_typesoutput should_swaprs r/_writedata_internalz!_ImageBaseHDU._writedata_internals 9 K DI & && ++G44 4}((' # !$)/22 6I TY_ = ==9ty799$ "L,Q/ ':5  +<) ?OOD))).**6222--------&&vu'='=>>>>""6*** FK&/1 1DKs .DD0c tjdkrd}nd}t|jjrt d|j}|jjd}||v}|r:ddlm}| |j d |j d}| }|j }|||zd z |d ||jd vrt%|jd } d} n |j} d} t+j| ||zt*j} t1j|j|j|| } || dd| r| | n/#| r| | wxYw|||z|S)Nrrrz/This dtype isn't currently supported with dask.r)MFSr )rb+zwb+zab+r)modeT)lengthaccess)rirsoffsetbuffer)lockr)rrrrrsr\r+ dask.utilsr map_blocksr newbyteordertellrseekwriteflush fileobj_modeopenr3_filemmapfileno ACCESS_WRITErwrxristoreclose) r.rrrrrrinitial_positionn_bytesfp should_closeoutmmapoutarrs r/rz!_ImageBaseHDU._writeinternal_dasks =H $ $#JJJ dio . . 2%&WXX XYF (+I#z1K   $ $ $ $ $ $ &&qz599DDF#<<>>-  %/!3444 e   '< < <gl///BLLB L i $4w$>tGXGZll' F LLdDL 9 9 9  MMOOOO  MMOOOO  %/000s "A0F==,G)c|j}|jr|jdkr|dkr|jdkrt jdSdt jdfdt jdfd t jd ffD] \}}||kr|jd|dz zkr|cS!|dkrt jd S|d krt jd SdS)z Determine the dtype that the data should be converted to depending on the BITPIX value in the header, and possibly on the BSCALE value as well. Returns None if there should not be any change. r r"iint8uint16 uint32@uint64float64rfloat32N)rJr?rMrLrwrs)r.bitpixbitsrss r/rz_ImageBaseHDU._dtype_for_bitpixs " : !$+q00{{t/477x'''RXh''(RXh''(RXh''(  ! ! e T>>d&6!q/&I&I LLL B;;8I&& & aZZ8I&& &Zr1c|}|J|jdkrA|jdz}tj||}|tjd|dz zz}|SdSdS)aW Handle "pseudo-unsigned" integers, if the user requested it. Returns the converted data array if so; otherwise returns None. In this case case, we don't need to handle BLANK to convert it to NAN, since we can't do NaNs with integers, anyway, i.e. the user is responsible for managing blanks. Nrr"rr )rrrrwryr)r.rrsrs r/_convert_pseudo_integerz%_ImageBaseHDU._convert_pseudo_integer sz&&((  s!2!2 >A%D8D...D BIaD1Ho.. .DK  !2!2r1ct|j}||||}|jd|_|js|jdkr|jdkr |j|S |j j rtdn#t$rYnwxYwd}|jdkr |jdks| |}|/d}|jW|jdkrL|j|jk}|t#|dz krt%j|}|}|t%j||}nK|j !|j jr|}n#|jjs|}n|}~|jdkrt%j||j||jdkr ||jz }|jrt$j|j|<|S)z Internal function for reading image data from a file and apply scale factors to it. Normally this is used for the entire image, but it supports alternate offset/shape for Section support. >rr Nz`Cannot load a memory-mapped image: BZERO/BSCALE/BLANK header keywords present. Set memmap=False.r"r)r rJ _get_raw_datarsrr>rLrMrHr strict_memmapr8AttributeErrorrrErsumrorwwhererrymemmapr<rrmultiplynan)r.rricoderaw_datarblanks new_dtypes r/rpz$_ImageBaseHDU._get_scaled_image_data!s% D-.%%eT6::!44S99  (    ! !d&71&<&<ATO z'  (      D  A%%$*;q*@*@//99D < F{&4rMrLrrgrhr4ror))r. class_namerrris r/_summaryz_ImageBaseHDU._summaryks(^,    Ay - S 1 1A 5 7 78z c$*oo &dl3 A5 A&!++t/?1/D/D 2244 (@y~@@@@Fhtz**++ 48ZT\1B1BE6SUVVr1cp|jr|j}t|jjrGt j|jt |jjz d|jjj}|jjddkrz|j j r7d}| d}|j d|_n9| d}|j d|_d}nd}| |tj}|rMt|jjs4| d|j d|_|St#S)zJ Calculate the value for the ``DATASUM`` card in the HDU. irrrTFr)rrrrsrwryrrr+rrrr_compute_checksumflattenviewrr6_calculate_datasum)r.d byteswappedcsrZs r/r"z _ImageBaseHDU._calculate_datasums >* 0 A"$)/22 HI TY_ = ==8dio688w{1~$$7$ ("&K 4((Ag22377AGG 5))Ag22377AG"'KK# '' (8(8(B(BCCB 4#5dio#F#F 4 4   '..s33I 77--// /r1)NNFTFFrk)NrNN)NrNNrr)FF)r __module__ __qualname____doc__r:r7 classmethodr^propertyrcrerir setterr rrmrrrrrrIrrrrrrprr" __classcell__rZs@r/rrs  .%#-($!! % @-@-@-@-@-@-D""["XX4++X+X ]] \* [@@[@DBBBH76767676r    @GHq'q'q'q'f''''''...8 6 6 6 6 6 6+++Z???B'''2.HHHT!W!W!WF.0.0.0.0.0.0.0.0.0r1rc:eZdZdZdZedZdZdZdS)ra Class enabling subsets of ImageHDU data to be loaded lazily via slicing. Slices of this object load the corresponding section of an image array from the underlying FITS file, and applies any BSCALE/BZERO factors. Section slices cannot be assigned to, and modifications to a section are not saved back to the underlying file. See the :ref:`astropy:data-sections` section of the Astropy documentation for more details. c||_dSrk)hdu)r.r1s r/r7zSection.__init__s r1c|jjSrk)r1rirbs r/riz Section.shapesx~r1ct|ts|f}t|jj}t d|Dot||k}t d|Ds |tfz }td|D}t||z |ks|dkrtdtdt|tfzD}|d|tdf|t|z dzzz||dzdz}t d|Dot||k}g}d }t|D]h}|jj|} t||| } || z| jz}t||s|| jni| j} t|dz|D]^} |jj| } t|| | } || j| j| kr | jr|| z}\d } _| r[t|pd }|jj} |jj|t+| zd zz}|j||}n||}|r|}n|r|}|S) a@Returns a slice of HDU data specified by `key`. If the image HDU is backed by a file handle, this method will only read the chunks of the file needed to extract `key`, which is useful in situations where the file is located on a slow or remote file system (e.g., cloud storage). c3XK|]%}t|ttjfV&dSrkr9intrwrr,ks r/ z&Section.__getitem__..3>>Q 1sBJ/00>>>>>>r1c3(K|] }|tuVdSrkEllipsisr7s r/r9z&Section.__getitem__..s&..Q1=......r1c$g|] }|tu |Srar<r7s r/r0z'Section.__getitem__..s>>>AX a r1r ztoo many indices for arrayc32K|]\}}|tu|VdSrkr<)r,rr8s r/r9z&Section.__getitem__..s*OOAh1OOr1Nc3XK|]%}t|ttjfV&dSrkr5r7s r/r9z&Section.__getitem__..r:r1rF)r r")r9rgror1riranyr= IndexErrornextrslicerC _IndexInforrr;npts contiguousrJrqabsrp_getdataitemsqueeze)r.keynaxis return_scalarellipsis_countr return_0dimdimsrr-indx is_contiguousjdxrrs r/ __getitem__zSection.__getitem__s#u%% &CDHN## >>#>>> > > T3s88uCT ..#.....  H; C>>>>>?? s88n $u , ,0B0B9:: :OO3(+>#>>> > > T3s88uCT <<  C8>#&Dc#h--Dd]T[0F3s8$$  DI&&&  q%(( & &C8>#&Dc#h--D KK " " "yD  T_ $ %  &;;&$DX*FX*Vc&kk-AQ-FFF82264@@DD==%%D  "99;;DD  "<<>>D r1cttjjD]m\\}}t |t rt ||}n3t|r#tj |t|}nnfd|D}tddzdDrtj |Stjd|DS)NrcTg|]$}d|fzdzdz%S)Nr ra)r,r8rkeysr.s r/r0z$Section._getdata..#s>FFFaT$3$Z1$&cAgii89FFFr1c3^K|](}t|tpt|V)dSrk)r9rDr )r,rLs r/r9z#Section._getdata..%s7TTSz#u%%8CTTTTTTr1r c6g|]}tj|Sra)rw atleast_1d)r,rys r/r0z$Section._getdata..*s""J"J"JE2=#7#7"J"J"Jr1)rzipr1rir9rDrCindicesr rwaranger6rAry concatenate)r.rXrLr-ksrrs`` @r/rIzSection._getdatas )#dDHN*C*C D D   C#t#u%% CKK--.C Yt3///4  GFFFFF2FFF TTDqOTTT T T L8D>> !>"J"JT"J"J"JKK Kr1N) rr'r(r)r7r+rirUrIrar1r/rrso  X @@@DLLLLLr1rc`eZdZdZdZ d fd ZedZfdZd fd Z xZ S) rz! FITS primary HDU class. PRIMARYNFTct|||||||D|jd}|dkrd}|jdddt |zdSdS) aA Construct a primary HDU. Parameters ---------- data : array or ``astropy.io.fits.hdu.base.DELAYED``, optional The data in the HDU. header : `~astropy.io.fits.Header`, optional The header to be used (as a template). If ``header`` is `None`, a minimal header will be provided. do_not_scale_image_data : bool, optional If `True`, image data is not scaled using BSCALE/BZERO values when read. (default: False) ignore_blank : bool, optional If `True`, the BLANK header keyword will be ignored if present. Otherwise, pixels equal to this value will be replaced with NaNs. (default: False) uint : bool, optional Interpret signed integer data where ``BZERO`` is the central value and ``BSCALE == 1`` as unsigned integer data. For example, ``int16`` data with ``BZERO = 32768`` and ``BSCALE = 1`` would be treated as ``uint16`` data. (default: True) scale_back : bool, optional If `True`, when saving changes to a file that contained scaled image data, restore the data to the original type and reapply the original BSCALE/BZERO values. This could lead to loss of accuracy if scaling back to integer values after performing floating point operations on the data. Pseudo-unsigned integers are automatically rescaled unless scale_back is explicitly set to `False`. (default: None) )rr rPrQrSrRNrrrEXTENDTr)r6r7r)rr+) r.rr rPrSrQrRdimrZs r/r7zPrimaryHDU.__init__4s\ $;%!     >,w'Caxx L  Xt7SXX3E  F F F F F >r1c\|jd}|jdkod|vp |dduo|jS)NrrrT)rVrvalue)r]r cards r/r^zPrimaryHDU.match_headerrsD|A LH $ 'G6(+;4+G   r1c td|jvrYt|jr%dt t|jz}nd}|jd|dSdS)Nrdrr)r6rmr)rorDr+r)r.rrZs r/rmzPrimaryHDU.update_header}s  t| # #4: #c$*oo"6"66 L  XU  3 3 3 3 3 $ #r1rct|}d|jvr9|jdd}|d|dzdd|||S)Nrrdrrc,t|tSrk)r9boolvs r/z$PrimaryHDU._verify..sz!T/B/Br1Tr6rr)r* req_cardsr.rerrsrMrZs r/rzPrimaryHDU._verifysswwf-- t| # #L$$Wa00E NN%!)%B%BD&RV    r1)NNFFTNr&) rr'r(r) _default_namer7r*r^rmrr-r.s@r/rr-sM % <G<G<G<G<G<G|  [  4 4 4 4 4          r1rcXeZdZdZdZ d fd ZedZd fd ZxZ S) rz) FITS image extension HDU class. r!NFTc Xt|||||||dS)a Construct an image HDU. Parameters ---------- data : array The data in the HDU. header : `~astropy.io.fits.Header` The header to be used (as a template). If ``header`` is `None`, a minimal header will be provided. name : str, optional The name of the HDU, will be the value of the keyword ``EXTNAME``. do_not_scale_image_data : bool, optional If `True`, image data is not scaled using BSCALE/BZERO values when read. (default: False) uint : bool, optional Interpret signed integer data where ``BZERO`` is the central value and ``BSCALE == 1`` as unsigned integer data. For example, ``int16`` data with ``BZERO = 32768`` and ``BSCALE = 1`` would be treated as ``uint16`` data. (default: True) scale_back : bool, optional If `True`, when saving changes to a file that contained scaled image data, restore the data to the original type and reapply the original BSCALE/BZERO values. This could lead to loss of accuracy if scaling back to integer values after performing floating point operations on the data. Pseudo-unsigned integers are automatically rescaled unless scale_back is explicitly set to `False`. (default: None) ver : int > 0 or None, optional The ver of the HDU, will be the value of the keyword ``EXTVER``. If not given or None, it defaults to the value of the ``EXTVER`` card of the ``header`` or 1. (default: None) )rr r3rPrQrRr4N)r6r7) r.rr r3rPrQrRr4rZs r/r7zImageHDU.__init__sFn $;!      r1c|jd}|j}t|tr|}|jdko ||jkS)Nrr)rVrgr9r+rstripr _extension)r]r rhxtensions r/r^zImageHDU.match_headersN|A: h $ $ )((H|z)Hh#..HHr1rct|}|jdd}|d|dzdd|||S)z) ImageHDU verify method. rkrrrrlc,t|o|dkS)Nr)rros r/rqz"ImageHDU._verify..sGAJJ,A16r1rrrts r/rzImageHDU._verifysgwwf--   !,,  eai!B!BAvt    r1)NNNFTNNr&) rr'r(r)r{r7r*r^rr-r.s@r/rrsJ  %  ? ? ? ? ? ? BII[I          r1rceZdZdZdS)rEct|rE|dkr||z}d|cxkr|krnnd|_||_d|_dSt d|dt |t r:||\}}}||z |z|_||_|dk|_dSt|r$t||_d|_d|_dSt d|)Nrr TzIndex z out of range.FzIllegal index ) rrFrrGrBr9rDr]r ro)r.rRrMstartstopsteps r/r7z_IndexInfo.__init__s  4== 6axxe|D    5      " "& !>$!>!>!>??? e $ $ 6 $ U 3 3 E4$.DIDK"aiDOOO    6D DIDK#DOOO4d4455 5r1N)rr'r(r7rar1r/rErEs#66666r1rE)rrrnumpyrwastropy.io.fits.headerrastropy.io.fits.utilrrrrastropy.io.fits.verifyr astropy.utilsr r baser r rrr__all__rrrrrErar1r/rs )))))) 10000022222222NNNNNNNNNNNNNN / / /d0d0d0d0d0Id0d0d0NkLkLkLkLkLkLkLkL\ggggggggT\\\\\}l\\\~6666666666r1