Educational Implementation · Python
LM-From-Scratch
A in-depth doc on how to make your own pre-train model from scratch.
What it is
LM-From-Scratch is an educational guide that walks through the process of designing and building a transformer-based language model from scratch using PyTorch. The repository includes documentation on architectural decisions and a code implementation of core components such as attention, feedforward networks, and training loops.
Merit describes the code at this commit. Later pushes count once the owner rescans. How merit is scored
Where it counts
- NLP & LLMs95%
- Machine Learning90%
- Data Science30%
- MLOps20%
How much of the project is about each field, as scoring counts it. It ranks in the field it is most about.
Around it on the NLP & LLMs board
Whole board- 33c3pa-explorerAI Developer Tool · JavaScript59.8AdvancedJarad PeckenpaughNLP & LLMs
- 34, shared rankAgent-BrowserML Application · Python59.6AdvancedCryptostonerNLP & LLMs
- 34, shared rankLM-From-ScratchEducational Implementation · Python59.6AdvancedFlameF0XNLP & LLMs
- 36, shared rankmgvsCompetition Solution · Python59.3AdvancedkarimsNLP & LLMs
- 36, shared rankzotero-redisearch-ragML Application · TypeScript59.3AdvancedJens MittelbachNLP & LLMs
