- Notifications
You must be signed in to change notification settings - Fork 81
Question about loss spike in training #47
Copy link
Copy link
Open
Description
Met4physics
opened on Apr 20, 2026
Issue body actions
I'm training SIT-XL-2 with global bs = 1024 and bf16 and I meet this kind of loss spike. Is this a normal behaviour or some kind of errors?Reactions are currently unavailable
Activity
Metadata
Metadata
Assignees
Labels
No labels