Thomas Viehmann
@t-vi
About
Principal Research Engineer at @Lightning-AI Mathematics and Inference at @MathInf I do a lot of @PyTorch work
Skills & Technologies
Projects & Repositories
Recent public projects and repositories from this profile.
pytorch-tvmisc
Jupyter NotebookTotally Versatile Miscellanea for Pytorch
smg
Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across SGLang, vLLM, TRT-LLM, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.
dynamo
A Datacenter Scale Distributed Inference Serving Framework
interesting-rates
Jupyter NotebookEconomic models and things in Pytorch
candlegp
Jupyter NotebookGaussian Processes in Pytorch
warp-ctc
CudaPyTorch bindings for Warp-CTC