AI Developer Tool · Python
vram-lend
Allow inference engines to lend then reclaim VRAM resources. Lend to other models without losing your session.
What it is
VRAM Lend is a tool that enables inference engines to lend GPU memory to other processes while continuing to serve requests, consisting of a borrower CLI, documentation for engine integration, and benchmarks/tests. It is designed for use with large Mixture of Experts models on consumer GPUs.
- deepseek-v4-1-flash
- glm-5-3-flash
- inference-engine
- local-ai
- project-maya
- strata
2 newer commits are not scored yet. They count once the owner rescans. How merit is scored
Where it counts
- NLP & LLMs80%
- Machine Learning70%
- MLOps50%
- AI Agents40%
- Computer Vision30%
- Data Science10%
How much of the project is about each field, as scoring counts it. It ranks in the field it is most about.
Around it on the NLP & LLMs board
Whole board- 17gguf-editorAI Developer Tool · Python66.1AdvancedMaster MindNLP & LLMs
- 18TheLuxApp-Ai-ChatBotML Application · TypeScript65.7AdvancedMaster MindNLP & LLMs
- 19vram-lendAI Developer Tool · Python65.0AdvancedTacoTakumiNLP & LLMs
- 20EuchreGameDataset / Data Pipeline · Python63.4AdvancedJarad PeckenpaughNLP & LLMs
- 21kvidcacheTraining Experiment · Python62.7AdvancedkarimsNLP & LLMs
