o Ďih@sddlmZddlmZddlmZmZmZmZm Z m Z m Z er&ddl m Z  dCdDd dZ      dEdFddZ          dGdHd&d'Z ( ( ( ( ( ( ) dIdJd7d8Z ( ( ( ( ( ( ( )dKdLd;d<Z )dMdNd?d@Z )dMdOdAdBZdS)P) annotations) TYPE_CHECKING)AttributeProto GraphProto ModelProto TensorProtocheckerhelperutils)MutableMappingNg1rg2io_maplist[tuple[str, str]] | Nonereturnlist[tuple[str, list[str]]]cCs>t|ts tdt|tstdddd}dd dd}g}|s#g}dd|D}||||||d}|r>|d|f|dd|jDdd|jD}|rX|d|f|dd|jDdd|jD}|rr|d|f|dd|jDdd|jD|dd|jDdd|jD}|r|d|f|S)!aChecks whether there are name collisions between two graphs Returns a list of tuples where the first element represents the member containing overlapping names (One of: "node", "edge", "value_info", "initializer", "sparse_initializer"), and the second element contains a list of names that appear in both graphs on that category. Optionally, it takes an io_map, representing the output/inputs to be connected. It provided, overlapping present in the io_map argument will be ignored. g1 argument is not an ONNX graph g2 argument is not an ONNX graphc1 list[str]c2rcSstt|t|@SN)listset)rrrH/home/jeff/fluffinator/venv/lib/python3.10/site-packages/onnx/compose.py _overlapping'sz-check_overlapping_names.._overlappingNgraphrexcludeset[str] | NonecSsn|durt}g}|jD](}|jD]}|dkr ||vr ||q|jD]}|dkr3||vr3||q$q |S)N)rnodeinputappendoutput)rredgesniorrr _edge_names*s     z,check_overlapping_names.._edge_namescSh|]}|dqSr).0elemrrr ;z*check_overlapping_names..)redgecSg|]}|jqSrnamer-errr Cz+check_overlapping_names.. value_infocSr2rr3r5rrrr7Ir8 initializercSg|]}|jjqSrvaluesr4r5rrrr7Or0cSr;rr<r5rrrr7Pr0cSr;rindicesr4r5rrrr7Rr0cSr;rr>r5rrrr7Sr0sparse_initializer)rrrrrrr)rrrrrr) isinstancer TypeErrorr#r9r:r@)r r rrr)result io_map_inputsoverlaprrrcheck_overlapping_namessF     rFlist[tuple[str, str]]inputslist[str] | Noneoutputsprefix1 str | Noneprefix2r4 doc_stringc st|ts tdt|tstdsrDr(t} | || }t|d}r:t} | || }t|d}fdd|D}dd|Ddd|Dd d |Dd d|jD} d d|jD} |sn|r |sd d|jD} dd|jD}nt|fdd|jD} fdd|jD}|sdd|jD}dd|jD}nt|fdd|jD}fdd|jD}t| t|jkst|t|jkrt t |}| | |j}t|t|jkst|t|jkr t t |}| ||j}|D]\}}|| vrtd|d|| vr)td|dq t|||}t|dkrO|d\}}td|dd|ddt}|j|jt|j}|j|jt|j}d6fd&d' ||||rt||jfd(d|jD|jfd)d|jDn|j|j|jfd*d|jD|rt||jfd+d|jD|jfd,d|jDn|jfd-d|jD|j|j|j|j|jfd.d|jD|j|j|jfd/d|jD|j|j|jfd0d|jD|d1ur0|nd2|j|jg|_|d1ur\d3|jd4|jd|jd5|jd5|jd5|j}||_|S)7aCombines two ONNX graphs into a single one. The combined graph is defined by connecting the specified set of outputs/inputs. Those inputs/outputs not specified in the io_map argument will remain as inputs/outputs of the combined graph. Arguments: g1 (GraphProto): First graph g2 (GraphProto): Second graph io_map (list of pairs of string): The pairs of names [(out0, in0), (out1, in1), ...] representing outputs of the first graph and inputs of the second to be connected inputs (list of string): Optional list of inputs to be included in the combined graph By default, all inputs not present in the ``io_map`` argument will be included in the combined model outputs (list of string): Optional list of outputs to be included in the combined graph By default, all outputs not present in the ``io_map`` argument will be included in the combined model prefix1 (string): Optional prefix to be added to all names in g1 prefix2 (string): Optional prefix to be added to all names in g2 name (string): Optional name for the combined graph By default, the name is g1.name and g2.name concatenated with an underscore delimiter doc_string (string): Optional docstring for the combined graph If not provided, a default docstring with the concatenation of g1 and g2 docstrings is used Returns: GraphProto rrprefixc<g|]}r |dn|dr|dn|dfqSrr,rr-iorKrMrrr7 z merge_graphs..cSr*)rrrSrrrr/r0zmerge_graphs..cSr*r+rrSrrrr/r0cSsi|]\}}||qSrr)r-out_namein_namerrr sz merge_graphs..cSh|]}|jqSrr3r-r(rrrr/r8cSrZrr3r-r'rrrr/r8cSr2rr3r\rrrr7r8cSr2rr3r\rrrr7r8cg|] }|jvr|jqSrr3r\ input_setrrr7cs&g|]}|jvs|jvr|jqSrr3r\)r_ io_map_g2_insrrr7 cSr2rr3r[rrrr7r8cSr2rr3r[rrrr7r8cs&g|]}|jvs|jvr|jqSrr3r[)io_map_g1_outs output_setrrr7rbcr]rr3r[rdrrr7r`zOutput z is not present in g1zInput z is not present in g2rz=Cant merge two graphs with overlapping names. Found repeated z names: ,  zYConsider using ``onnx.compose.add_prefix`` to add a prefix to names in one of the graphs. sub_graphrstartintendrNonecsvt||D]3}|j|}|jD]}|jtjkr"|jdt|jjqt|j D]\}}|vr7||j |<q(qdSNr) ranger! attributetyperGRAPHglen enumerater")rhrirknode_idxr!attrindexname_) connect_ioreversed_io_maprrrys   z merge_graphs..connect_iocg|] }|jvr|qSrr3r\r^rrr7cr{rr3r\r^rrr7r|cg|] }|jvr|qSrr3r\rarrr7r|cr{rr3r[rerrr7r|cr{rr3r[rerrr7r|cr}rr3r[)rcrrr7r|cr}rr3r-initr~rrr7r|csg|] }|jjvr|qSrr<rr~rrr7s  cr}rr3)r-vir~rrr7 r|N_zGraph combining  and z )rhrrirjrkrjrrl)rArrBCopyFromadd_prefix_graphr$r"rrsr Extractorr make_model extract_modelr ValueErrorrFjoinr!extendr:r@r9r4rN)r r rrHrJrKrMr4rNg1_copyg2_copyg1_outsg2_ins g1_inputs g2_inputs g1_outputs g2_outputse1e2 g1_out_name g2_in_nameoverlapping_namescategorynamesrrg2_nodes_begin g2_nodes_endr)ryr_rcrardrKrMrzr merge_graphs[s &         $&         "  ronnx.compose.merge_models1.0r r,m1rm2 producer_nameproducer_versiondomain model_version int | Nonec  s2t|ts tdt|tstd|j|jkr%td|jd|jd|j} i}t|jt|j}|D]$}|j|vrT||j}|j|krStd|jd|jq6|j||j<q6s_rrqt}| ||}t |d}rt}| ||}t |d}fd d |D}t |j |j |||||d }t j|| | | | || d }i}|jD]}|j||j<q|jD](}|j|vr||j}||jkrtd |jd|d|jdq|j||j<qt ||tdd|jDdd|jD@}|rtdd||j|j|j|jt||S)a>Combines two ONNX models into a single one. The combined model is defined by connecting the specified set of outputs/inputs. Those inputs/outputs not specified in the io_map argument will remain as inputs/outputs of the combined model. Both models should have the same IR version, and same operator sets imported. Arguments: m1 (ModelProto): First model m2 (ModelProto): Second model io_map (list of pairs of string): The pairs of names [(out0, in0), (out1, in1), ...] representing outputs of the first graph and inputs of the second to be connected inputs (list of string): Optional list of inputs to be included in the combined graph By default, all inputs not present in the ``io_map`` argument will be included in the combined model outputs (list of string): Optional list of outputs to be included in the combined graph By default, all outputs not present in the ``io_map`` argument will be included in the combined model prefix1 (string): Optional prefix to be added to all names in m1 prefix2 (string): Optional prefix to be added to all names in m2 name (string): Optional name for the combined graph By default, the name is g1.name and g2.name concatenated with an underscore delimiter doc_string (string): Optional docstring for the combined graph If not provided, a default docstring with the concatenation of g1 and g2 docstrings is used producer_name (string): Optional producer name for the combined model. Default: 'onnx.compose' producer_version (string): Optional producer version for the combined model. Default: "1.0" domain (string): Optional domain of the combined model. Default: "" model_version (int): Optional version of the graph encoded. Default: 1 Returns: ModelProto z m1 argument is not an ONNX modelz m2 argument is not an ONNX modelzIR version mismatch z != z-. Both models should have the same IR versionzPCan't merge two models with different operator set ids for a given domain. Got: rrOcrQrRrrSrUrrr7urVz merge_models..)rHrJr4rN)rrrr opset_imports ir_versionzaCan't merge models with different values for the same model metadata property. Found: property = z, with values .cSrZrr3)r-frrrr/r8zmerge_models..zPCan't merge models with overlapping local function names. Found in both graphs: rf)rArrBrrr opset_importrversionr add_prefixrrr rmetadata_propsvaluekeyset_model_props functionsr MergeFromr check_model)rrrrHrJrKrMr4rNrrrrropset_import_maprentry found_versionm1_copym2_copyrmodel model_props meta_entryrfunction_overlaprrUr merge_modelss 1                  rTFrrPstr rename_nodes bool | None rename_edges rename_inputsrename_outputsrename_initializersrename_value_infosinplacename_mapdict[str, str] | Nonec Cst|ts td|st} | |n|} d dd} | dur!i} |rBd d | jD} | jD]} | jD] }|| vr@| ||| |<q3q.|rS| jD] }| ||j| |j<qG|rd| jD] }| ||j| |j<qX|r| jD]} | || j| _| jD]}|j rt |j |d | d quqi|r| j D] }| ||j| |j<q| j D]}| ||j j| |j j<| ||jj| |jj<q|r| jD] }| ||j| |j<q| jD]2} t| jD]\}}| j|| vr| || j|<qt| jD]\}}| j|| vr| || j|<qq| jD]}|j| vr | |j|_q| jD]}|j| vr| |j|_q| j D]}|j| vr/| |j|_q!| j D]!}|j j| vrE| |j j|j _|jj| vrT| |jj|j_q4| jD]}|j| vrg| |j|_qY| S)aAdds a prefix to names of elements in a graph: nodes, edges, inputs, outputs, initializers, sparse initializer, value infos. It can be used as a utility before merging graphs that have overlapping names. Empty names are not prefixed. Arguments: graph (GraphProto): Graph prefix (str): Prefix to be added to each name in the graph rename_nodes (bool): Whether to prefix node names rename_edges (bool): Whether to prefix node edge names rename_inputs (bool): Whether to prefix input names rename_outputs (bool): Whether to prefix output names rename_initializers (bool): Whether to prefix initializer and sparse initializer names rename_value_infos (bool): Whether to prefix value info names inplace (bool): If True, mutates the graph directly. Otherwise, a copy will be created name_map: (Dict): shared name_map in subgraph Returns: GraphProto #graph argument is not an ONNX graphrPrr4rcSst|dkr ||S|Srm)rs)rPr4rrr _prefixedsz#add_prefix_graph.._prefixedNcSrZrr3r[rrrr/r8z#add_prefix_graph..T)rr)rPrr4rrr)rArrBrr$r!r"r4rorrrr:r@r=r?r9rt)rrPrrrrrrrrrrrgraph_output_namesr&r6rror sparse_initr'r$input_in_descout_descr:r@r9rrrrs "                           rrrename_functionsc  Cst|ts td| st} | || }t|j|||||||dd |rci} |jD]} || j} | | | j<| | _q*|jD]} | jD] }|j | vrO| |j |_ qBq=|jjD] }|j | vrb| |j |_ qU|S)aAdds a prefix to names of elements in a graph: nodes, edges, inputs, outputs, initializers, sparse initializer, value infos, and local functions. It can be used as a utility before merging graphs that have overlapping names. Empty names are not _prefixed. Arguments: model (ModelProto): Model prefix (str): Prefix to be added to each name in the graph rename_nodes (bool): Whether to prefix node names rename_edges (bool): Whether to prefix node edge names rename_inputs (bool): Whether to prefix input names rename_outputs (bool): Whether to prefix output names rename_initializers (bool): Whether to prefix initializer and sparse initializer names rename_value_infos (bool): Whether to prefix value info nanes rename_functions (bool): Whether to prefix local function names inplace (bool): If True, mutates the model directly. Otherwise, a copy will be created Returns: ModelProto #model argument is not an ONNX modelT)rrrrrrr) rArrBrrrrr4r!op_type)rrPrrrrrrrrm f_name_mapr new_f_namer&rrrr)sD "            rdim_idxrjc Cst|ts td|st}||n|}dd|jD}|jD]2}t|jD]\}}||vr:|d||j|<q(t|jD]\}}||vrR|d||j|<q@q!|jd} |j t j dg| g| dt j | dt jd g|gd d tt|jD]E} |jd } | jd|} |j t j d | | g| jgd| jddd| jjjjD} | |d |j t | j| jjj| q|S)aEInserts an extra dimension with extent 1 to each output in the graph. Inserts an Unsqueeze node for each output. It can be used as a utility before merging graphs, for example when the second one expects a batch dimension. Arguments: graph (GraphProto): Graph dim_idx (int): Index of the dimension to be inserted. A negative value means counting dimensions from the back. inplace (bool): If True, mutates the model directly. Otherwise, a copy will be created Returns: GraphProto rcSr2rr3)r-r$rrrr7r8z(expand_out_dim_graph.._collapsed_dim__expand_out_dim_idxConstantz -constantz-valuer,)r4 data_typedimsvals)rHrJr4rr Unsqueezez unsqueeze-)rHrJr4cSr2r) dim_value)r-drrrr7r8)rArrBrr$r!rtr"r4r#r make_node make_tensorrINT64rnrspoprp tensor_typeshapediminsertmake_tensor_value_info elem_type)rrrrrorig_out_namesr&r'outinp expand_dim_krr( prev_output new_shaperrrexpand_out_dim_graphssj       rcCs>t|ts td|st}|||}t|j|dd|S)aEInserts an extra dimension with extent 1 to each output in the graph. Inserts an Unsqueeze node for each output. It can be used as a utility before merging graphs, for example when the second one expects a batch dimension. Arguments: model (ModelProto): Model dim_idx (int): Index of the dimension to be inserted. A negative value means counting dimensions from the back. inplace (bool): If True, mutates the model directly. Otherwise, a copy will be created Returns: ModelProto rT)r)rArrBrrr)rrrrrrrexpand_out_dims  rr)r rr rrrrr)NNNNNN)r rr rrrGrHrIrJrIrKrLrMrLr4rLrNrLrr) NNNNNNrrr r,)rrrrrrGrHrIrJrIrKrLrMrLr4rLrNrLrrLrrLrrLrrrr)TTTTTTFN)rrrPrrrrrrrrrrrrrrrrrrr)TTTTTTTF)rrrPrrrrrrrrrrrrrrrrrrr)F)rrrrjrrrr)rrrrjrrrr) __future__rtypingronnxrrrrrr r collections.abcr rFrrrrrrrrrrsb  $  I H  | M S