Uh oh!
There was an error while loading. Please reload this page.
Doc update and added SFT integ test - #6018
Conversation
- Moved Nova-only CPT notebook from open-weight section to Nova section. - Renamed "Customizing Models" → "Model Customization (Foundation Models)". - Consolidated deployment docs under "Deploy Models for Inference" (including Bedrock). - Added SFT SMTJ serverful integ test
**Description** **Testing Done**
| unique_id = f"{int(time.time())}-{random.randint(1000, 9999)}" | ||
| sft_trainer = SFTTrainer( | ||
| model="amazon.nova-2-lite-v1", |
There was a problem hiding this comment.
Can we use nova micro for SFT serverful instead. It may support chepaer g5/g6 instances? Getting P5 capacity is difficult and using p5 might make it hard for this test to be picked up.
How long did it take for the test to get picked up when you tried it out manually?
There was a problem hiding this comment.
We can use P5 for RLVR instead. As I don't think there are recipes for g5/g6 for rlvr.
There was a problem hiding this comment.
yes updated to micro model. Uses g6 instance instead
| {"schemaVersion": "nova-sft-2025-01-01", "messages": [{"role": "user", "content": [{"text": "What is machine learning?"}]}, {"role": "assistant", "content": [{"text": "Machine learning is a subset of artificial intelligence that enables systems to learn and improve from experience without being explicitly programmed."}]}]} | ||
| {"schemaVersion": "nova-sft-2025-01-01", "messages": [{"role": "user", "content": [{"text": "Explain what AWS is."}]}, {"role": "assistant", "content": [{"text": "AWS (Amazon Web Services) is a comprehensive cloud computing platform that provides on-demand computing resources and services."}]}]} | ||
| {"schemaVersion": "nova-sft-2025-01-01", "messages": [{"role": "user", "content": [{"text": "What is Python used for?"}]}, {"role": "assistant", "content": [{"text": "Python is a versatile programming language used for web development, data analysis, artificial intelligence, scientific computing, and automation."}]}]} | ||
| {"schemaVersion": "nova-sft-2025-01-01", "messages": [{"role": "user", "content": [{"text": "What is machine learning?"}]}, {"role": "assistant", "content": [{"text": "Machine learning is a subset of artificial intelligence that enables systems to learn and improve from experience without being explicitly programmed."}]}]} |
There was a problem hiding this comment.
Nice, this makes the test easy to port across accounts.
| @@ -0,0 +1,172 @@ | |||
| # Copyright Amazon.com, Inc. or its affiliates. All Rights Reserved. | |||
There was a problem hiding this comment.
We also need test for OSS + Serverful. But that will be a different PR.
Uh oh!
There was an error while loading. Please reload this page.