o q::jV@s(ddlmZddlZddlZddlmZmZddlZddlZ ddl mZ ddl Z ddl mZer6ddlmZ  dOdPddZdQddZdRddZdQddZdRddZdSdTd"d#ZdUd%d&ZdVdWd)d*ZdXd.d/Z dYdZd3d4Zd[d8d9ZdVd\d;d<Zd]d@dAZ dYd^dCdDZ Ed_d`dKdLZdadMdNZ dS)b) annotationsN) TYPE_CHECKINGAny)helper)SequenceTupx np.ndarraysaturatebool round_modestrreturncCstj|tjd}|tj}|d?d@}|tj}|dk}tj|tjd}d||<|}|dkr|d@dktj} |d@dktj} |d@dktj} |dktj} | d k| d k| d kB| d kB@} t|}d || |@<|r|d k| @|@}d||<||7}n/|d kr|d @dk}||@} |r|d k| @}d | |<|| tj7}n |dkrnt d||tj}||||<|t j S)arConvert float32 NumPy array to float8e8m0 representation. If the input is not a float32 array, it will be cast to one first. Args: x: Input array to convert. saturate: Whether to saturate at max/min float8e8m0 value. round_mode: "nearest", "up", or "down". Returns: np.ndarray: Array of ml_dtypes.float8_e8m0fnu values. dtypenearesti@ri iriFdownzUnsupported rounding mode: ) npasarrayfloat32viewuint32astypeuint16 zeros_likeuint8 ValueError ml_dtypesfloat8_e8m0fnu)rr r x_f32f_bitsexponent special_maskoutput normal_maskgrslsbround_up incrementmax_mask has_fractionr1X/home/nk/hobo-godmode/plappi-mvp/.venv/lib/python3.10/site-packages/onnx/numpy_helper.py to_float8e8m0sF           r3datanpt.NDArray[np.uint8]dims Sequence[int]c Cstj|jdg|jd}|td@}|td@}|tdL}||ddd<||ddd<t|}|j|dkrA|dd }||jkr[td |jd |jd t|d |d |j |dd|S)aConvert a packed uint4 array to unpacked uint4 array represented as uint8. Args: data: A numpy array. dims: The dimensions are used to reshape the unpacked buffer. Returns: A numpy array of int8/uint8 reshaped to dims. rrNrzPacked 4-bit data ( bytes, 8 elements unpacked) is too small for the declared shape  ( elements required).Frefcheck) remptysizerrmathprodr listresize)r4r6result array_low array_highexpected_elementsr1r1r2 _unpack_4bit`s&    rMarraycCsx|tj}|j}|ddk}|r|j|dgdd|dM}|ddddK<|ddd|dddBS) z[Convert a numpy array to flatten, packed int4/uint4. Elements must be in the correct range.r8rFrAr9Nr;rravelrrrcopyrDrH)rN array_flatrD odd_sizedr1r1r2 _pack_4bitx2s rTc Cstj|jdg|jd}|d@|ddd<|d?d@|ddd<|d?d@|ddd<|d?d@|ddd<t|}|j|krF|d|}||jkr`td |jd |jd t|d |d |j|dd|S)aConvert a packed uint2 array to unpacked uint2 array represented as uint8. Args: data: A numpy array. dims: The dimensions are used to reshape the unpacked buffer. Returns: A numpy array of int8/uint8 reshaped to dims. r;rrNr8rzPacked 2-bit data (r=r>r?r@FrA) rrCrDrrErFr rGrH)r4r6rIrLr1r1r2 _unpack_2bits$     rWcCs|tj}|j}|d}|r|j|d|gdd|dM}|ddddK<|ddddK<|ddddK<|d dd|dddB|dddB|dddBS) z[Convert a numpy array to flatten, packed int2/uint2. Elements must be in the correct range.r;FrArUrNr8rVrrO)rNrRrDpad_lenr1r1r2 _pack_2bitx4s8rYtensoronnx.TensorProtobase_dirc Cs|dr td|jtjjkrtd|j}t|}tt |}t |}|j }|jtjj krJt ||}dd|D}t|||Stj|rWtj|||dr|j} tjdkrotj| |d} |tjjtjjtjjhvrtj| tjd} t| | |S|tjj!tjj"hvrtj| tjd} t#| | |Stj| |d|S|tjj$tjj%tjj&tjj'hvrtj(|j)tj*d tj+tj,| |S|tjj-tjj.tjj/tjj0tjj1tjj2hvrtj(|j)tj*d tj+tj ||S|tjjtjjtjjhvr,tj(|j)tj*d tj+tj} t| | |S|tjj!tjj"hvrPtj(|j)tj*d tj+tj} t#| | |St ||} |tjj3tjj4fvrntj(| |dj |d|Stj| |d||S) a6Converts a tensor def object to a numpy array. This function uses ml_dtypes if the dtype is not a native numpy dtype. Args: tensor: a TensorProto object. base_dir: if external tensor exists, base_dir can help to find the path to it Returns: arr: the converted array. segmentz*Currently not supporting loading segments.z2The element type in the input tensor is UNDEFINED.cSsg|]}|dqS)utf-8)decode).0r+r1r1r2 szto_array..raw_databigr)5HasFieldr data_typeonnx TensorProto UNDEFINED TypeErrorrtensor_dtype_to_np_dtype$tensor_dtype_to_storage_tensor_dtypetensor_dtype_to_fieldr6STRINGgetattrrrrreshapeexternal_data_helperuses_external_dataload_external_data_for_tensorrcsys byteorder frombufferbyteswaptobytesINT4UINT4 FLOAT4E2M1rrMrUINT2INT2rWBFLOAT16FLOAT16INT16UINT16rN int32_dataint32rr FLOAT8E4M3FNFLOAT8E4M3FNUZ FLOAT8E5M2FLOAT8E5M2FNUZ FLOAT8E8M0BOOL COMPLEX64 COMPLEX128) r[r] tensor_dtypenp_dtypestorage_np_dtype storage_fieldr6 utf8_stringsssrcr4r1r1r2to_arrays           rbytescCs<|jjdkstjdkr|jjdkr||jd}|S)zConverts an array into bytes in little endian byte order. Args: array: a numpy array. Returns: bytes: Byte representation of passed array in little endian byte order. .. versionadded:: 1.20 >rd=<)rrurtr newbyteorderrx)rNr1r1r2tobytes_little_endian-s rname str | NonecCst}|j|j|r||_|jtkst |jtj rPtjj |_ | }|D]%}t|tr9|j|dq(t|trE|j|q(tdt||St|j}|tjjtjjtjjhvrgt|}|tjjtjjhvrut|}t||_ ||_ |S)zConverts an array into a TensorProto including Args: array: a numpy array. name: (optional) the name of the tensor. Returns: TensorProto: the converted tensor def. r_zMUnrecognized object in the object array, expect a string, or array of bytes: )!rgrhr6extendshaperrobjectr issubdtypestr_rnrfflatten isinstancer string_dataappendencoderNotImplementedErrortypernp_dtype_to_tensor_dtyperyrzr{rTr|r}rYrrc)rNrr[ flat_arrayerr1r1r2 from_arrayAs>        rsequenceonnx.SequenceProto list[Any]cCs~|j}|tjjkrdd|jDS|tjjkrdd|jDS|tjjkr-dd|jDS|tjj kr;dd|j DSt d)zConverts a sequence def to a Python list. Args: sequence: a SequenceProto object. Returns: list: the converted list. cSg|]}t|qSr1rravr1r1r2rbzto_list..cSrr1rrr1r1r2rbrcSrr1)to_listrr1r1r2rbrcSrr1)to_dictrr1r1r2rbrz8The element type in the input sequence is not supported.) elem_typerg SequenceProtoTENSOR tensor_values SPARSE_TENSORsparse_tensor_valuesSEQUENCEsequence_valuesMAP map_valuesrj)rrr1r1r2r{s    rlstr int | Nonec s0t}|r ||_|dur|}n'tdkr3d}t|tr$tjj}nt|tr.tjj}n tjj }ntjj }||_ tdkrOt fddDsOt d|tjj krhD]}|j tt|gqW|S|tjjkr~D] }|jt|gqp|S|tjjkrD] }|jt|gq|St d)a]Converts a list into a sequence def. Args: lst: a Python list name: (optional) the name of the sequence. dtype: (optional) type of element in the input list, used for specifying sequence values when converting an empty list. Returns: SequenceProto: the converted sequence def. Nrc3s"|] }t|tdVqdS)rN)rr)raelemrr1r2 s zfrom_list..zqThe element type in the input list is not the same for all elements and therefore is not supported as a sequence.zZThe element type in the input list is not a tensor, sequence, or map and is not supported.)rgrrlenrdictrrGrrrallrjrrrrrr from_listr from_dict) rrrrr first_elemr[seqmappingr1rr2rsB      "   r map_proto onnx.MapProtodict[Any, Any]cCsfg}|jtjjkrt|j}nt|j}t|j}t |t |kr*t d|j dt t ||ddS)zConverts a map def to a Python dictionary. Args: map_proto: a MapProto object. Returns: The converted dictionary. z2Length of keys and values for MapProto (map name: z) are not the same.F)strict)key_typergrhrnrG string_keyskeysrvaluesr IndexErrorrrzip)rkey_list value_listr1r1r2rs     rdict_cs$t}|r ||_|stdt|}t|dt}tj j tj j tj j tj j tj jtj jtj jtj jh}tfdd|DsHtdt|}t|dtfdd|Dsdtdt|}||_|tj jkrx|j|n||vr|j|ntd||j||S) zConverts a Python dictionary into a map def. Args: dict_: Python dictionary name: (optional) the name of the map. Returns: MapProto: the converted map def. z/Cannot convert an empty dictionary to MapProto.rc3|] }t|kVqdSNr result_type)rakey) raw_key_typer1r2rzfrom_dict..zfThe key type in the input dictionary is not the same for all keys and therefore is not valid as a map.c3rrr)raval)raw_value_typer1r2rrzjThe value type in the input dictionary is not the same for all values and therefore is not valid as a map.zUnsupported map key type: )rgMapProtorr rGrrrrrhINT8rINT32INT64UINT8rUINT32UINT64rrjrrrrnrrrCopyFrom)rrrrrvalid_key_int_typesr value_seqr1)rrr2rsH      roptionalonnx.OptionalProto Any | NonecCs|j}|tjjkr dS|tjjkrt|jS|tjjkr!t|jS|tjj kr,t |j S|tjj kr7t |jS|tjjkrBt|jStd)zConverts an optional def to a Python optional. Args: optional: an OptionalProto object. Returns: opt: the converted optional. Nz8The element type in the input optional is not supported.)rrg OptionalProtorirr tensor_valuersparse_tensor_valuerrsequence_valuerr map_valueOPTIONAL to_optionaloptional_valuerj)rrr1r1r2rs           roptcCst}|r ||_|dur|tjjvrt|d|}n!t|tr)tjj}nt|t r3tjj }n |durs@     K   r  : 9  9 4