o j9:j @sddlmZmZddlZddlmZddlmZddlm Z ddl m Z m Z m Z ddlmZgdZed d d e d ed e dede f ddZed d GdddeZed d  dd e deejdBddfddZed d de defddZed d d e de defddZdS))Any NamedTupleN) compatibility)Graph) GraphModule)map_argNodeTarget) ShapeProp)replace_target_nodes_with size_bytesget_size_of_all_nodesget_tensor_metaget_size_of_nodeF)is_backward_compatible fx_moduleold_op old_targetnew_op new_targetc st}i|jjD]U}|j|krR|j|krRt|jfdd}t|jfdd}t|t s7t dt |t|t sEt dt || |||||j|<q ||fdd|<q ||_dS)z Modifies all nodes in fx_module.graph.nodes which match the specified op code and target, and updates them to match the new op code and target. c|SNnval_mapri/home/nk/hobo-godmode/plappi-mvp/.venv/lib/python3.10/site-packages/torch/fx/passes/graph_manipulation.py%z+replace_target_nodes_with..crrrrrrrr&rzExpected tuple, got zExpected dict, got crrrrrrrr/rN)rgraphnodesoptargetrargskwargs isinstancetupleAssertionErrortypedict create_nodename node_copy) rrrrr new_graphnoder$r%rrrr s       r c@seZdZUeed<eed<dS)r output_size total_sizeN)__name__ __module__ __qualname__int__annotations__rrrrr 3s  r r$returncCsD|dur t|j||jjD]}|jdkrdSt|||_qdS)zGiven a fx graph module, update each node with its total size (weights + bias + output) and its output_size(output). For a non-module node, the total size is the output size. return total sizeNoutput)r propagater r!r"rr )rr$r/rrrr 9s  r r/cCs$|jd}|std|d|S)N tensor_metazNode zQ has no tensor metadata associated with it! Check that shape propagation has run.)metaget RuntimeError)r/r:rrrrKs  rc Csd}|jdkr#t|}||j}|}|D] \}}||7}qt|}|j} || 7}|jr>t j g|j d } n t j g|j d } | |} | | } t| | S)zGiven a node with node.dtype and node.shape, return its total size and its output size. total_size = weights + bias + output_size r call_module)dtype)r"r* named_modulesr#named_parametersnumelrshape is_quantizedtorch_empty_affine_quantizedr? element_sizetensorr ) rr/total_num_of_elemssubmodule_dict submodule parameters_namepr: output_elemsize_per_elem_bytesr1r0rrrrXs(      rr)typingrrrEtorch.fx._compatibilityrtorch.fx.graphrtorch.fx.graph_moduler torch.fx.noderrr torch.fx.passes.shape_propr __all__strr r listTensorr rrrrrrsF