Architecture Modification / Research · Python
open-i3
A novel hybrid language model combining RWKV time-mixing and standard Multi-Head Attention for efficient training on consumer hardware.
What it is
The repository provides implementations of hybrid RWKV-Transformer models for BERT-style masked language modeling, language generation, and CLIP-style zero-shot image classification, including training and inference scripts.
Merit describes the code at this commit. Later pushes count once the owner rescans. How merit is scored
Where it counts
- Machine Learning92%
- NLP & LLMs85%
- Computer Vision35%
- MLOps15%
- Data Science10%
How much of the project is about each field, as scoring counts it. It ranks in the field it is most about.
Around it on the Machine Learning board
Whole board- 65, shared rankViralCutterML Application · Python52.9ImplementationYudhis PratamaMachine Learning
- 71AgroADASML Application · Python52.6ImplementationSuceveanu Mircea Dan SanduMachine Learning
- 72open-i3Architecture Modification / Research · Python52.5ImplementationFlameF0XMachine Learning
- 73ml-from-scratchEducational Implementation · Jupyter Notebook51.9ImplementationPop AlexandruMachine Learning
- 74, shared rankgenerative-lbracketML Application · Jupyter Notebook50.9ImplementationkarimsMachine Learning