Architecture Modification / Research · Python
jordan-spectral-attention
What it is
This repository implements Jordan-Spectral Attention (JSA), a spectral-shift replacement for Transformer self-attention in language modeling. It includes training scripts for baseline and JSA models, along with experimental results showing JSA's effectiveness in reducing perplexity with fewer parameters.
Where it counts
- NLP & LLMs90%
- Machine Learning70%
- MLOps30%
- Data Science20%
How much of the project is about each field, as scoring counts it. It ranks in the field it is most about.
Around it on the NLP & LLMs board
Whole board- 18deep-chaos-schedulerArchitecture Modification / Research · Python61.0AdvancedRickNLP & LLMs
- 19gemma-servant-voice-suppression-tuningTraining Experiment · Python60.8AdvancedRickNLP & LLMs
- 20, shared rankwhatsapp-mcpAI Developer Tool · JavaScript60.3AdvancedVaishnavSPillai03NLP & LLMs
- 20, shared rankjordan-spectral-attentionArchitecture Modification / Research · Python60.3AdvancedkarimsNLP & LLMs
- 22c3pa-explorerAI Developer Tool · JavaScript59.8AdvancedJarad PeckenpaughNLP & LLMs
