imp

by kekzl · Agent Tool · ★ 29

About imp

From-scratch CUDA inference engine for the NVIDIA RTX 5090 (sm120a). The best single-GPU backend for agentic AI — tool calling, long-context loops, reasoning and concurrent sub-agents, on top of the fastest single-user inference on the 5090: faster decode than llama.cpp (+37–72% dense GGUF), at-or-ahead of vLLM on NVFP4, and the only engine running native NVFP4 on consumer Blackwell. 97k lines, 100% written by Claude Code. What is imp A C++20/CUDA inference engine that targets exactly one architecture: the NVIDIA RTX 5090 / RTX PRO 6000 (GB202, ).

blackwellcppcudafp4gated-deltanetggufinference-enginellama-cppllmllm-inference

Quick Facts

Stars29
Forks2
LanguageCuda
CategoryAgent Tool
LicenseMIT
Quality Score62.0996217167065/100
Last Updated2026-07-08
Created2026-02-23
Platformsclaude-code
Est. Tokens~19k

Compatible Skills

These tools work well together with imp for enhanced workflows:

  • flock — semantic(0.41)+complementary+rare_topics+similar_pop+shared_platform (68%)
  • Terradev — semantic(0.32)+complementary+rare_topics+similar_pop+shared_platform (65%)
  • Turbo-LLM — semantic(0.35)+complementary+rare_topics+similar_pop+shared_platform (61%)
  • TurboLLM — semantic(0.35)+complementary+rare_topics+similar_pop+shared_platform (61%)

More Agent Tool Tools

Explore other popular agent tool tools:

View all Agent Tool tools →

Frequently Asked Questions

What is imp?

imp is From-scratch C++/CUDA inference engine for the NVIDIA RTX 5090 (sm_120a) — the best single-GPU backend for agentic AI: tool calling, long-context loops, reasoning and concurrent sub-agents on top of t. It is categorized as a Agent Tool with 29 GitHub stars.

What programming language is imp written in?

imp is primarily written in Cuda. It covers topics such as blackwell, cpp, cuda.

How do I install or use imp?

You can find installation instructions and usage details in the imp GitHub repository at github.com/kekzl/imp. The project has 29 stars and 2 forks, indicating an active community.

What license does imp use?

imp is released under the MIT license, making it free to use and modify according to the license terms.

View on GitHub → Browse Agent Tool tools