[dynamo][compile-time] Manually implement nn.Module.__getattr__ to reduce compile time

[anijain2305]

Stack from ghstack (oldest at bottom):

• [DONT MERGE][dynamo] Turn on inlining of inbuilt nn modules #128148
• [dynamo][compile-time][inlining-inbuilt-nn-modules] Manually implement nn.Module._call_impl #129285
• -> [dynamo][compile-time] Manually implement nn.Module.__getattr__ to reduce compile time #129315
• [dynamo][unspecialized-nn-modules] Remove dead (also incorrect) code #129316

Compile time for eager backend

AlbertForMaskedLM

No inlining - 3.65 seconds
Inlining on main - 7.48 seconds
Inlining + this PR - 6.70 seconds

MobileBertForMaskedLM

No inlining - 26.90 seconds
Inlining on main - 48.21 seconds
Inlining + this PR - 43.85 seconds

Next PR in the stack makes the total compile time better/comparable to no inlining

cc @voznesenskym @penguinwu @EikanWang @jgong5 @Guobing-Chen @XiaobingSuper @zhuhaozhe @blzheng @wenzhe-nrv @jiayisunx @chenyang78 @kadeng @chauhang

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/129315

• 📄 Preview Python docs built from this PR
• 📄 Preview C++ docs built from this PR
• ❓ Need help or want to give feedback on the CI? Visit the bot commands wiki or our office hours

Note: Links to docs will display an error until the docs builds have been completed.

✅ You can merge normally! (2 Unrelated Failures)

As of commit 760e970 with merge base 94dc325 ():

FLAKY - The following job failed but was likely due to flakiness present on trunk:

• pull / linux-jammy-py3.8-gcc11 / test (distributed, 1, 2, linux.2xlarge) (gh) (similar failure)
  Process completed with exit code 1.

UNSTABLE - The following job failed but was likely due to flakiness present on trunk and has been marked as unstable:

• inductor / rocm6.1-py3.8-inductor / test (inductor, 1, 1, linux.rocm.gpu.2, unstable) (gh) (#128871)
  'test/inductor/test_max_autotune.py::TestTuningProcess::test_tuning_pool_multiple_devices'

This comment was automatically generated by Dr. CI and updates every 15 minutes.