o ;ήc=@sXddlZddlZddlZddlZddlZddlZddlZddlZddl m Z m Z ddl m Z ddlmZGdddejZded ed efd d Zd ejdejejded edef ddZdejdejdejdejeeffddZd ejdejejded edejdedededejeefdejejfddZddZd d!Zed"kredSdS)#N)files_from_file_or_dirpath_match_suffix_ignore_case)get_optimization_level)create_config_from_modelsc@seZdZdZdZdS)OptimizationStylerrN)__name__ __module__ __qualname__FixedRuntimer r S/tmp/pip-target-vg8gfxp4/lib/python/onnxruntime/tools/convert_onnx_models_to_ort.pyrsroptimization_level_stroptimization_stylesuffixcCs2d|dkr d|nd|tjkrd|Sd|S)Nz{}{}{}all.z.with_runtime_opt)formatrr )rrrr r r_optimization_suffixs rmodel_path_or_dir output_direnable_type_reductioncCsVd|rdndt||d}|r|p||S|d|}|dur)||jS|S)Nz{}{}required_operators_and_typesrequired_operatorsz.configr)rris_dir with_suffixname)rrrrr config_namemodel_config_pathr r r_create_config_file_path!s    r!optimization_leveloutput_model_pathcustom_op_librarysession_options_config_entriescCsLt}t||_||_|r|t||D] \}}|||q|S)N)ortSessionOptionsstroptimized_model_filepathgraph_optimization_levelregister_custom_ops_libraryitemsadd_session_config_entry)r"r#r$r%sokeyvaluer r r_create_session_options8s r1create_optimized_onnx_modelallow_conversion_failurestarget_platformreturnc  Cs|r|n|j} |p | }t|} dtjfdd} t|| } t| dkr+td|dg} d}| t j j kr=|dkr=dg}g}| D]}z~| | }||jj d d d ||t||d }|r||t||d }t| |||}|tjkr}|d dtd||t jt||| |d}t| |||}|dd|tjkr|d dtd||t jt||| |d}||WqAty}ztd|||sԂWYd}~qAd}~wwtdt|t| |S)N file_pathcSs0t|dsdSt|drtd|ddSdS)Nz.onnxF.optimized.onnxz Ignoring ''T)rprint)r6r r ris_model_file_to_convert\s  z*_convert..is_model_file_to_convertrz!No model files were found in '{}'CPUExecutionProvideramd64NchwcTransformerT)parentsexist_okz.ortr7(optimization.minimal_build_optimizationsapplyz$Saving optimized ONNX model {} to {}) sess_options providersdisabled_optimizerszsession.save_model_formatORTsavez9Converting optimized ONNX model {} to ORT format model {}zError converting {}: {}z$Converted {}/{} models successfully.)rparentrpathlibPathrlen ValueErrorrr&GraphOptimizationLevelORT_ENABLE_ALL relative_tomkdirrrr1rr r-r9InferenceSessionr(append Exception)rrrrr$r2r3r4r% model_dirr"r:modelsrCoptimizer_filterconverted_modelsmodelrelative_model_pathort_target_pathoptimized_target_pathr._er r r_convertKsh             r]cCstjtjtdd}|jdtjdd|jddt j j t j j gdd t Dd t j j d t j j d t j j d t j j d d|jdddd|jdtjddd|jdddd|jdddd|jdt dddgdd|jd tjd!d|S)"Na Convert the ONNX format model/s in the provided directory to ORT format models. All files with a `.onnx` extension will be processed. For each one, an ORT format model will be created in the given output directory, if specified, or the same directory. A configuration file will also be created containing the list of required operators for all converted models. This configuration file should be used as input to the minimal build via the `--include_ops_by_config` parameter. ) descriptionz --output_dirzProvide an output directory for the converted model/s and configuration file. If unspecified, the converted ORT format model/s will be in the same directory as the ONNX model/s.)typehelpz--optimization_style+cSsg|]}|jqSr )r).0r\r r r szparse_args..zStyle of optimization to perform on the ORT format model. Multiple values may be provided. The conversion will run once for each value. The general guidance is to use models optimized with 'z(' style when using NNAPI or CoreML and 'z' style otherwise. 'zv': Run optimizations directly before saving the ORT format model. This bakes in any platform-specific optimizations. 'aP': Run basic optimizations directly and save certain other optimizations to be applied at runtime if possible. This is useful when using a compiling EP like NNAPI or CoreML that may run an unknown (at model conversion time) number of nodes. The saved optimizations can further optimize nodes not assigned to the compiling EP at runtime.)nargsdefaultchoicesr`z--enable_type_reduction store_truezAdd operator specific type information to the configuration file to potentially reduce the types supported by individual operator implementations.)actionr`z--custom_op_libraryzNProvide path to shared library containing custom operator kernels to register.)r_rer`z--save_optimized_onnx_modelz~Save the optimized version of each ONNX model. This will have the same level of optimizations applied as the ORT format model.z--allow_conversion_failuresz@Whether to proceed after encountering model conversion failures.z--target_platformarmr<zSpecify the target platform where the exported model will be used. This parameter can be used to choose between platform-specific options, such as QDQIsInt8Allowed(arm), NCHWc (amd64) and NHWC (arm/amd64) format, different optimizer level options, etc.)r_rerfr`rzProvide path to ONNX model or directory containing ONNX model/s to convert. All files with a .onnx extension, including those in subdirectories, will be processed.)argparseArgumentParserospathbasename__file__ add_argumentrHrIrr rr r( parse_args)parserr r rrqst    rqcCst}d}|jdur|js|jjdd|jjdd}dd|jD}tdd}|j}|j r8|j nd}|sI| sIt d ||rV| sVt d |i}|j d krbd |d <nd |d <|D]~}td |j|t||||||j|j|j |d }tW} |tjkr|r|n|j} | tj| dd} |} d| d<td|t|| |tj|d|j|j | d 7}td |j|t|||||j} t|| |jWdn1swYqhdS)NT)r>)strictcSsg|]}t|qSr )r)rb style_strr r rrcsz.convert_onnx_models_to_ort..1ORT_CONVERT_ONNX_MODELS_TO_ORT_OPTIMIZATION_LEVELrz+Model path '{}' is not a file or directory.z+Unable to find custom operator library '{}'ri1zsession.qdqisint8allowed0z=Converting models with optimization style '{}' and level '{}') rrrrr$r2r3r4r%z.without_runtime_opt)dirrrAr@zConverting models again without runtime optimizations to generate a complete config file. These converted models are temporary and will be deleted.FzYGenerating config file from ORT format models with optimization style '{}' and level '{}') rqrrrOresolverrlgetenvrr$is_fileFileNotFoundErrorrr4r9rr]save_optimized_onnx_modelr3 contextlib ExitStackrr rG enter_contexttempfileTemporaryDirectorycopyr r!rr)argsroptimization_stylesrrr$r%rrV context_stackrStemp_output_dir4session_options_config_entries_for_second_conversion config_filer r rconvert_onnx_models_to_ort s          r__main__) rjr~enumrlrHrtyping onnxruntimer& file_utilsrronnx_model_utilsrort_format_modelrEnumrr(rrIOptionalboolr!rLDictr1Listr]rqrrr r r rsv         hW`