Cody Yu
@comaniac
About
LLM systems
Skills & Technologies
Projects & Repositories
Recent public projects and repositories from this profile.
latex-proj-tool
PythonA toolset to traverse and manipulate a Latex project with multiple .tex files.
NeMo
NeMo: a toolkit for conversational AI
vllm
PythonA high-throughput and memory-efficient inference and serving engine for LLMs
ray
PythonRay is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
epoi
Jupyter NotebookBenchmark PyTorch Custom Operators
sglang
PythonSGLang is a fast serving framework for large language models and vision language models.