Skip to content
@Infer-Lab

Infer Lab

Popular repositories Loading

  1. InferLab InferLab Public

    Make inference experiments replayable

    Rust 8 2

  2. inferlab-showcase inferlab-showcase Public

    An official CUDA showcase of reproducible vLLM and SGLang serving workflows with InferLab.

    3

  3. cutile-rs cutile-rs Public

    Forked from NVlabs/cutile-rs

    cuTile Rust provides a safe, tile-based kernel programming DSL for the Rust programming language. It features a safe host-side API for passing tensors to asynchronously executed kernel functions.

    Rust 1

  4. cuda-oxide cuda-oxide Public

    Forked from NVIDIA/cuda-rust

    cuda-oxide is an experimental Rust-to-CUDA compiler that lets you write (SIMT) GPU kernels in safe(ish), idiomatic Rust. It compiles standard Rust code directly to PTX — no DSLs, no foreign languag…

    Rust

  5. smg smg Public

    Forked from smg-project/smg

    Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing,…

    Rust

  6. vllm-runtime vllm-runtime Public

    Documentation for ghcr.io/infer-lab/vllm-runtime: vLLM runtime images for NVIDIA Blackwell (SM120) and Hopper (SM90), built from source and gated before publishing.

Repositories

Showing 7 of 7 repositories

Top languages

Loading…

Most used topics

Loading…