Skip to content

Architecture Modification / Research · Python

open-i3

A novel hybrid language model combining RWKV time-mixing and standard Multi-Head Attention for efficient training on consumer hardware.

What it is

The repository provides implementations of hybrid RWKV-Transformer models for BERT-style masked language modeling, language generation, and CLIP-style zero-shot image classification, including training and inference scripts.

Scored at4d7d8068 Nov 2026Changes since

Merit describes the code at this commit. Later pushes count once the owner rescans. How merit is scored

Where it counts

  • Machine Learning92%
  • NLP & LLMs85%
  • Computer Vision35%
  • MLOps15%
  • Data Science10%

How much of the project is about each field, as scoring counts it. It ranks in the field it is most about.

Around it on the Machine Learning board

Whole board
  1. 65, shared rankViralCutterML Application · Python52.9/100ImplementationYudhis Pratama
  2. 71AgroADASML Application · Python52.6/100ImplementationSuceveanu Mircea Dan Sandu
  3. 72open-i3Architecture Modification / Research · Python52.5/100ImplementationFlameF0X
  4. 73ml-from-scratchEducational Implementation · Jupyter Notebook51.9/100ImplementationPop Alexandru
  5. 74, shared rankgenerative-lbracketML Application · Jupyter Notebook50.9/100Implementationkarims

More from FlameF0X