o j9:j> @sddlZddlmZddlZddlmZddlmZgdZ Gdddej j Z dd ej j d e d ed eej jej jffd dZdej j de d e fddZ  ddejjej j Bdeej jgefdBde d e fddZdS)N)Callable)map_arg) split_module)FoldedGraphModuleget_unique_attr_name_in_modulesplit_const_subgraphsc sfeZdZdZ   ddejjdejjdejjdBde dBde f fd d Z fd d Z d dZ Z S)ra FoldedGraphModule is a GraphModule which also contains another `const_subgraph_module` representing a subgraph which has all const attr inputs and which can be run once before running the main standard `graph`. The `const_output_names` are the ordered list names of attrs which represent what each respective output from the const_subgraph should be set on which attrs. Ncudarootgraphconst_subgraphfx_const_folded_attrs_namedevice_for_folded_attrscs@t|||dur dntj|||_d|_||_||_dS)NF) super__init__torchfx GraphModuleconst_subgraph_modulehas_folding_been_runr r )selfr r r r r  __class__g/home/nk/hobo-godmode/plappi-mvp/.venv/lib/python3.10/site-packages/torch/fx/experimental/const_fold.pyrs  zFoldedGraphModule.__init__cs|js|tj|SN)r run_foldingr__call__)rargskwargsrrrr-s zFoldedGraphModule.__call__cs~jdus jdur dSjrtdd_}fddt|tr2tjfdd|Dn|}t j|dS)NzFolding has already been runTcsNtjjt|ts|n t|gjj dt|tjr#|j dSddS)N)deviceF) requires_grad) rnn Parameter isinstanceintdetachcloneTensortor r )i)rrr _create_paramDsz4FoldedGraphModule.run_folding.._create_paramcsg|]}|qSrr).0r))r*rr Msz1FoldedGraphModule.run_folding..) rr rAssertionErrorr#tuplerr! ParameterListsetattr)r folded_attrsparamsr)r*rrr2s    zFoldedGraphModule.run_folding)NNr)__name__ __module__ __qualname____doc__rr!ModulerGraphstrrrr __classcell__rrrrrs$   rTgminline_mod_namerun_dcereturnc st||}t|tjjstdt|d}|jj D]}|j dkr.|j |kr.|}nq|dur:td||j }|j }id}fdd} |jj D]} | j dkrj| j|vr_|| jn||| <|d 7}qN| j d kr| j d} t| | } g} t| ttfrddlfd d |jD} || | D](}|j d }t|tstd t||| ||j|| ||<qqN|j||j| | }Wdn1swY|| <qN|j||r|jS)a Given `gm` and some graph module which is called with target name `inline_mod_name`, this helper will inline all of the nodes from that called graph module into `gm`. Returns a mapping from subgraph nodes to the newly created/mapped nodes in gm. zExpected GraphModule, got N call_modulez$Could not find call_module node for rcs|}|j|_|Sr)metacopy)nodenew_node)replacement_mappingrrreplacement_fnqs z&_inline_module..replacement_fn placeholderoutputcs6g|]}|jdkr|jjurt|jdtr|qS) call_functionrG)optargetgetitemr#rr$)r+user)operatorrrr,s  z"_inline_module..zExpected int index, got )dict named_modulesr#rrrr-typer nodesrJrKrrnamerlistr.rNusersreplace_all_uses_withr$ erase_nodeinserting_before node_copyeliminate_dead_code)r;r<r= inline_modcall_mod_node_to_replacerB call_mod_argscall_mod_kwargsph_countrE inline_nodeoutputsoutput_replacements getitem_usersrMidxrCr)rNrDr_inline_moduleTsd                  re mod_tracedrScCstdd|}|drd|}t||r>td|}|dur&|d}n|dd\}}|dt|d}t||s|S) zP Make sure the name is unique (in a module) and can represents an attr. z[^0-9a-zA-Z_]+_rz (.*)_(\d+)$N_1rG)resubisdigithasattrmatchgroupr$)rfrSrnbasenumrrrrs      rcpumoduleskip_folding_node_fnr c sddl}t|tjjstj|}n|}dtjjdtffdd td}|jj D]S}|j dvr2q*|j d kr@t|j  s@q*|rG||rGq*| rLq*t|jd d|jrXq*|j d krq||j}rqt|tjjrq|rqq*||j d kr}d }q*|st||jSd tjjffdd }t|||} d\} } | jt| | d} } | r| jj ngD]}|j d krt| |jt| |jq| jj D]}|j d krt| |jt| |jqd}| jj D]}|j d kr|j| kr|j}nq|durtdtj| | j}d}|jj D]t}|j dkrt|jdt}q|j dkrq|t|kr3td|dt|d||}|d7}|j d krItd|j |j||j|j}Wdn 1sbwY|j !|_ |"||j#|qdt$vrtdt%|d}t| ||rtj&'ntj&(| jj D]9}|j d kr|j| kr|j||j|}Wdn 1swY|j !|_ |"|nqt)| | rt*| | | j+t| | j|j||S)aJ Looks through `module` for any nodes that have all constant attribute inputs and separates them out into their own constant subgraph, and returns a FoldedGraphModule which runs that constant subgraph on the first run to set attributes on the module prior to running the non-constant portion of the graph. rNrsr>cstt|tjjs td|jjD](}|jdkr|rdS|jdkr7| |j }r7t|tjjr7|SqdS)z` Return True if a GraphModule type subgraph contains any impure op, else False. zDcaller should only pass GraphModule to subgraph_has_impure_ops checkrITr?F) r#rrrr-r rRrJ is_impure get_submodulerK)rsrB submodule)_subgraph_has_impure_opsrrrxs    z7split_const_subgraphs.._subgraph_has_impure_opsF>rHrFget_attr fill_valuer?TrBcs|vrdSdS)NrrGr)rB) const_nodesrr mod_partitionsz,split_const_subgraphs..mod_partition)submod_0submod_1z,Could not find call_module node for const_gmrHrFzPlaceholder index z out of range for args (len=)rGzExpected get_attr, got multiple_outputsz multiple_outputs not set in loop_FX_CONST_FOLDED_ATTRS),sympyr#rrrsymbolic_traceboolsetr rRrJall_input_nodesissubsetrurgetExprrvrKaddrNoderr}getattrr0rr-r.lenrXryr@rArVrWlocalsrr!r/r"rmrerZ)rsrtr rrffound_const_foldingrB target_modr|splitconst_mod_namenon_const_mod_nameconst_gm non_const_gmcall_const_gm_args root_const_gmph_idxrin_noderCr r1r)rxr{rrs                             r)T)Nrr)rjcollections.abcrtorch.fxr torch.fx.nodertorch.fx.passes.split_moduler__all__rrrr9rrOrrerr!r7rrrrrs:   D Z