Architecture Modification / Research · Python
deep-chaos-scheduler
Sticky-block topology lottery scheduler for transformer fine-tuning.
What it is
The repository introduces a sticky-topology chaos scheduler (DeepChaos) for transformer fine-tuning that removes dead and identity layers during training to improve speed and reduce VRAM usage, paired with a diagnostic suite (BoL scans) for model analysis.
- amd
- fine-tuning
- llm
- lora
- machine-learning
- pytorch
- rocm
- transformers
- vram-optimization
- weights-and-biases
Where it counts
- NLP & LLMs90%
- Machine Learning80%
- MLOps30%
- Data Science10%
How much of the project is about each field, as scoring counts it. It ranks in the field it is most about.
Around it on the NLP & LLMs board
Whole board- 12llmastsearchAI Developer Tool · Rust62.0AdvancedLuiz Cesar SpiesNLP & LLMs
- 13sub-zeroAI Developer Tool · Python61.7AdvancedRickNLP & LLMs
- 14deep-chaos-schedulerArchitecture Modification / Research · Python61.0AdvancedRickNLP & LLMs
- 15gemma-servant-voice-suppression-tuningTraining Experiment · Python60.8AdvancedRickNLP & LLMs
- 16c3pa-explorerAI Developer Tool · JavaScript59.8AdvancedJarad PeckenpaughNLP & LLMs