Add trace_via_export option and allow exporting funcs

[gmagogsfm]

cc @voznesenskym @penguinwu @EikanWang @jgong5 @Guobing-Chen @XiaobingSuper @zhuhaozhe @blzheng @wenzhe-nrv @jiayisunx @chenyang78 @kadeng @chauhang

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/124431

• 📄 Preview Python docs built from this PR
• 📄 Preview C++ docs built from this PR
• ❓ Need help or want to give feedback on the CI? Visit the bot commands wiki or our office hours

Note: Links to docs will display an error until the docs builds have been completed.

❌ 46 New Failures, 1 Unrelated Failure

As of commit c9db07c with merge base 21f7cbd ():

NEW FAILURES - The following jobs have failed:

• inductor / cuda12.1-py3.10-gcc9-sm86 / test (inductor, 1, 1, linux.g5.4xlarge.nvidia.gpu) (gh)
  AttributeError: forward
• Lint / lintrunner-noclang / linux-job (gh)
  >>> Lint for torch/jit/_trace.py:
• pull / linux-focal-cuda12.1-py3.10-gcc9 / test (default, 1, 5, linux.4xlarge.nvidia.gpu) (gh)
  test_cpp_api_parity.py::TestCppApiParity::test_torch_nn_Conv1d
• pull / linux-focal-cuda12.1-py3.10-gcc9 / test (default, 2, 5, linux.4xlarge.nvidia.gpu) (gh)
  test_tensorexpr.py::TestTensorExprFuser::test_add_const_rhs
• pull / linux-focal-cuda12.1-py3.10-gcc9 / test (default, 3, 5, linux.4xlarge.nvidia.gpu) (gh)
  dynamo/test_dynamic_shapes.py::DynamicShapesReproTests::test_jit_trace_errors_dynamic_shapes
• pull / linux-focal-cuda12.1-py3.10-gcc9 / test (default, 4, 5, linux.4xlarge.nvidia.gpu) (gh)
  dynamo/test_misc.py::TestTracer::test_jit_save
• pull / linux-focal-cuda12.1-py3.10-gcc9 / test (default, 5, 5, linux.4xlarge.nvidia.gpu) (gh)
  test_ops_jit.py::TestJitCUDA::test_variant_consistency_jit__chunk_cat_cuda_complex64
• pull / linux-focal-cuda12.1-py3.10-gcc9 / test (deploy, 1, 1, linux.4xlarge.nvidia.gpu) (gh)
  TypeError: ExportedProgram.module() takes 1 positional argument but 2 were given
• pull / linux-focal-cuda12.1-py3.10-gcc9-sm86 / test (default, 1, 5, linux.g5.4xlarge.nvidia.gpu) (gh)
  test_cpp_api_parity.py::TestCppApiParity::test_torch_nn_Conv1d
• pull / linux-focal-cuda12.1-py3.10-gcc9-sm86 / test (default, 2, 5, linux.g5.4xlarge.nvidia.gpu) (gh)
  test_tensorexpr.py::TestTensorExprFuser::test_add_const_rhs
• pull / linux-focal-cuda12.1-py3.10-gcc9-sm86 / test (default, 3, 5, linux.g5.4xlarge.nvidia.gpu) (gh)
  dynamo/test_dynamic_shapes.py::DynamicShapesReproTests::test_jit_trace_errors_dynamic_shapes
• pull / linux-focal-cuda12.1-py3.10-gcc9-sm86 / test (default, 4, 5, linux.g5.4xlarge.nvidia.gpu) (gh)
  dynamo/test_interop.py::InteropTests::test_trace_fn
• pull / linux-focal-cuda12.1-py3.10-gcc9-sm86 / test (default, 5, 5, linux.g5.4xlarge.nvidia.gpu) (gh)
  dynamo/test_misc.py::TestTracer::test_jit_save
• pull / linux-focal-py3.11-clang10 / test (crossref, 1, 2, linux.2xlarge) (gh)
  test_tensorexpr.py::TestTensorExprFuser::test_add_const_rhs
• pull / linux-focal-py3.11-clang10 / test (crossref, 2, 2, linux.2xlarge) (gh)
  test_ops_jit.py::TestJitCPU::test_variant_consistency_jit___getitem___cpu_complex64
• pull / linux-focal-py3.11-clang10 / test (default, 1, 3, linux.2xlarge) (gh)
  test_tensorexpr.py::TestTensorExprFuser::test_add_const_rhs
• pull / linux-focal-py3.11-clang10 / test (default, 2, 3, linux.2xlarge) (gh)
  dynamo/test_dynamic_shapes.py::DynamicShapesReproTests::test_jit_trace_errors_dynamic_shapes
• pull / linux-focal-py3.11-clang10 / test (default, 3, 3, linux.2xlarge) (gh)
  test_ops_jit.py::TestJitCPU::test_variant_consistency_jit__chunk_cat_cpu_float32
• pull / linux-focal-py3.11-clang10 / test (dynamo, 1, 3, linux.2xlarge) (gh)
  distributions/test_distributions.py::TestJit::test_entropy
• pull / linux-focal-py3.11-clang10 / test (dynamo, 2, 3, linux.2xlarge) (gh)
  test_cpp_api_parity.py::TestCppApiParity::test_torch_nn_Conv1d
• pull / linux-focal-py3.11-clang10 / test (dynamo, 3, 3, linux.2xlarge) (gh)
  test_jit_fuser_te.py::TestTEFuserStatic::test_adaptive_avg_pool2d
• pull / linux-focal-py3.12-clang10 / test (default, 1, 3, linux.2xlarge) (gh)
  test_tensorexpr.py::TestTensorExprFuser::test_add_const_rhs
• pull / linux-focal-py3.12-clang10 / test (default, 2, 3, linux.2xlarge) (gh)
  dynamo/test_dynamic_shapes.py::DynamicShapesReproTests::test_jit_trace_errors_dynamic_shapes
• pull / linux-focal-py3.12-clang10 / test (default, 3, 3, linux.2xlarge) (gh)
  test_ops_jit.py::TestJitCPU::test_variant_consistency_jit__chunk_cat_cpu_float32
• pull / linux-focal-py3.12-clang10 / test (dynamo, 2, 3, linux.2xlarge) (gh)
  test_cpp_api_parity.py::TestCppApiParity::test_torch_nn_Conv1d
• pull / linux-focal-py3.12-clang10 / test (dynamo, 3, 3, linux.2xlarge) (gh)
  test_jit_fuser_te.py::TestTEFuserStatic::test_adaptive_avg_pool2d
• pull / linux-focal-py3.8-clang10 / test (crossref, 1, 2, linux.2xlarge) (gh)
  test_tensorexpr.py::TestTensorExprFuser::test_add_const_rhs
• pull / linux-focal-py3.8-clang10 / test (crossref, 2, 2, linux.2xlarge) (gh)
  test_ops_jit.py::TestJitCPU::test_variant_consistency_jit_abs_cpu_complex64
• pull / linux-focal-py3.8-clang10 / test (default, 1, 3, linux.2xlarge) (gh)
  test_tensorexpr.py::TestTensorExprFuser::test_add_const_rhs
• pull / linux-focal-py3.8-clang10 / test (default, 2, 3, linux.2xlarge) (gh)
  dynamo/test_dynamic_shapes.py::DynamicShapesReproTests::test_jit_trace_errors_dynamic_shapes
• pull / linux-focal-py3.8-clang10 / test (default, 3, 3, linux.2xlarge) (gh)
  test_ops_jit.py::TestJitCPU::test_variant_consistency_jit__chunk_cat_cpu_float32
• pull / linux-focal-py3.8-clang10 / test (dynamo, 1, 3, linux.2xlarge) (gh)
  distributions/test_distributions.py::TestJit::test_cdf
• pull / linux-focal-py3.8-clang10 / test (dynamo, 2, 3, linux.2xlarge) (gh)
  test_cpp_api_parity.py::TestCppApiParity::test_torch_nn_Conv1d
• pull / linux-focal-py3.8-clang10 / test (dynamo, 3, 3, linux.2xlarge) (gh)
  test_jit_fuser_te.py::TestTEFuserStatic::test_adaptive_avg_pool2d
• pull / linux-focal-py3.8-clang10-onnx / test (default, 1, 2, linux.2xlarge) (gh)
  onnx/test_utility_funs.py::TestUnconvertibleOps::test_it_returns_empty_list_when_all_ops_convertible_traced
• pull / linux-focal-py3.8-clang10-onnx / test (default, 2, 2, linux.2xlarge) (gh)
  onnx/test_pytorch_onnx_onnxruntime.py::TestONNXRuntime_opset_version_7_is_script_True_keep_initializers_as_inputs_True::test_div_rounding_mode
• pull / linux-jammy-py3.10-clang15-asan / test (default, 1, 6, linux.4xlarge) (gh)
  test_tensorexpr.py::TestTensorExprFuser::test_add_const_rhs
• pull / linux-jammy-py3.10-clang15-asan / test (default, 2, 6, linux.4xlarge) (gh)
  dynamo/test_dynamic_shapes.py::DynamicShapesReproTests::test_jit_trace_errors_dynamic_shapes
• pull / linux-jammy-py3.10-clang15-asan / test (default, 3, 6, linux.4xlarge) (gh)
  test_ops_jit.py::TestJitCPU::test_variant_consistency_jit___getitem___cpu_complex64
• pull / linux-jammy-py3.10-clang15-asan / test (default, 4, 6, linux.4xlarge) (gh)
  test_ops_jit.py::TestJitCPU::test_variant_consistency_jit__segment_reduce_offsets_cpu_float32
• pull / linux-jammy-py3.10-clang15-asan / test (default, 5, 6, linux.4xlarge) (gh)
  test_ops_jit.py::TestJitCPU::test_variant_consistency_jit__chunk_cat_cpu_complex64
• pull / linux-jammy-py3.10-clang15-asan / test (default, 6, 6, linux.4xlarge) (gh)
  dynamo/test_misc.py::TestTracer::test_jit_save
• pull / linux-jammy-py3.8-gcc11 / test (default, 1, 3, linux.2xlarge) (gh)
  test_tensorexpr.py::TestTensorExprFuser::test_add_const_rhs
• pull / linux-jammy-py3.8-gcc11 / test (default, 2, 3, linux.2xlarge) (gh)
  test_jit_fuser_te.py::TestTEFuserStatic::test_adaptive_avg_pool2d
• pull / linux-jammy-py3.8-gcc11 / test (default, 3, 3, linux.2xlarge) (gh)
  dynamo/test_dynamic_shapes.py::DynamicShapesReproTests::test_jit_trace_errors_dynamic_shapes
• pull / linux-jammy-py3.8-gcc11 / test (jit_legacy, 1, 1, linux.2xlarge) (gh)
  test_jit_legacy.py::TestTracer::test_call_traced_fn_from_traced_module

FLAKY - The following job failed but was likely due to flakiness present on trunk:

• pull / linux-jammy-py3.8-gcc11 / test (docs_test, 1, 1, linux.2xlarge) (gh)
  Process completed with exit code 2.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[github-actions]

Looks like this PR hasn't been updated in a while so we're going to go ahead and mark this as Stale.
Feel free to remove the Stale label if you feel this was a mistake.
If you are unable to remove the Stale label please contact a maintainer in order to do so.
If you want the bot to never mark this PR stale again, add the no-stale label.
Stale pull requests will automatically be closed after 30 days of inactivity.