21% of Atlas Score
The repository provides a library for training JumpReLU sparse autoencoders (SAEs) per transformer layer with an event-aware optimizer scheduler and augmented Lagrangian sparsity control. It includes tools for activation capture, checkpointing, and diagnostics, demonstrated by training a 35-layer SAE atlas for Gemma-4-E2B-it.