Carlos Hung

AI job matching platform with local Ollama parsing, Turso DB vector embeddings, SQLite Recursive CTE graph ontology, Fastify OTel, and Next.js.

SGLang is a high-performance serving framework for large language models and multimodal models.

LLM inference in C/C++

Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

A Datacenter Scale Distributed Inference Serving Framework

QVAC - Local AI SDK and libraries for building private, cross-platform, peer-to-peer AI applications. Run LLMs, speech-to-text, translation, and more locally on Linux, macOS, Windows, Android, and iOS.