Infer Lab
Popular repositories Loading
-
inferlab-showcase
inferlab-showcase PublicAn official CUDA showcase of reproducible vLLM and SGLang serving workflows with InferLab.
-
cutile-rs
cutile-rs PublicForked from NVlabs/cutile-rs
cuTile Rust provides a safe, tile-based kernel programming DSL for the Rust programming language. It features a safe host-side API for passing tensors to asynchronously executed kernel functions.
Rust 1
-
cuda-oxide
cuda-oxide PublicForked from NVIDIA/cuda-rust
cuda-oxide is an experimental Rust-to-CUDA compiler that lets you write (SIMT) GPU kernels in safe(ish), idiomatic Rust. It compiles standard Rust code directly to PTX — no DSLs, no foreign languag…
Rust
-
smg
smg PublicForked from smg-project/smg
Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing,…
Rust
-
vllm-runtime
vllm-runtime PublicDocumentation for ghcr.io/infer-lab/vllm-runtime: vLLM runtime images for NVIDIA Blackwell (SM120) and Hopper (SM90), built from source and gated before publishing.
Repositories
- sglang-runtime Public
Documentation for ghcr.io/infer-lab/sglang-runtime: SGLang runtime images for NVIDIA Blackwell (SM120) and Hopper (SM90), built from source and gated before publishing.
- vllm-runtime Public
Documentation for ghcr.io/infer-lab/vllm-runtime: vLLM runtime images for NVIDIA Blackwell (SM120) and Hopper (SM90), built from source and gated before publishing.
- inferlab-showcase Public
An official CUDA showcase of reproducible vLLM and SGLang serving workflows with InferLab.
- smg Public Forked from smg-project/smg
Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.
- cutile-rs Public Forked from NVlabs/cutile-rs
cuTile Rust provides a safe, tile-based kernel programming DSL for the Rust programming language. It features a safe host-side API for passing tensors to asynchronously executed kernel functions.
- cuda-oxide Public Forked from NVIDIA/cuda-rust
cuda-oxide is an experimental Rust-to-CUDA compiler that lets you write (SIMT) GPU kernels in safe(ish), idiomatic Rust. It compiles standard Rust code directly to PTX — no DSLs, no foreign language bindings, just Rust.
Top languages
Loading…
Most used topics
Loading…