[In Progress] FSDP2 + NF4Tensor

[weifengpy]

Stack from ghstack (oldest at bottom):

• -> [In Progress] FSDP2 + NF4Tensor #651

pytorch part: ghstack checkout pytorch/pytorch#119378
torhAO part: pytorch/ao#118
torchtune part: this PR

tune run --nnodes 1 --nproc_per_node 2 lora_finetune_fsdp2.py --config configs/llama2/7B_qlora_single_device.yaml max_steps_per_epoch=10

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/torchtune/651

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 14 New Failures

As of commit 6fed0a5 with merge base 8183b42 ():

NEW FAILURES - The following jobs have failed:

• Build Docs / build_docs (3.11) (gh)
  Process completed with exit code 2.
• Lint / lint (3.10) (gh)
  recipes/lora_finetune_single_device.py:20:1: F401 'torchtune.modules.peft.peft_utils.validate_state_dict_for_lora' imported but unused
• Multi-GPU Recipe Tests / recipe_test_multi_gpu (3.10) (gh)
  Process completed with exit code 4.
• Multi-GPU Recipe Tests / recipe_test_multi_gpu (3.11) (gh)
  ##[error]The operation was canceled.
• Multi-GPU Recipe Tests / recipe_test_multi_gpu (3.8) (gh)
• Multi-GPU Recipe Tests / recipe_test_multi_gpu (3.9) (gh)
  ##[error]The operation was canceled.
• Recipe Tests / recipe_test (3.10) (gh)
  ##[error]The operation was canceled.
• Recipe Tests / recipe_test (3.11) (gh)
  ##[error]The operation was canceled.
• Recipe Tests / recipe_test (3.8) (gh)
  Process completed with exit code 4.
• Recipe Tests / recipe_test (3.9) (gh)
  ##[error]The operation was canceled.
• Unit Test / unit_tests (3.10) (gh)
  ##[error]The operation was canceled.
• Unit Test / unit_tests (3.11) (gh)
• Unit Test / unit_tests (3.8) (gh)
  Process completed with exit code 4.
• Unit Test / unit_tests (3.9) (gh)
  Process completed with exit code 4.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[weifengpy]

propose new PR: #909