Wei Feng

Ongoing research training transformer models at scale

Flexible parameter sharding and distributed optimization utilities for PyTorch training

A native PyTorch Library for large model training

An experimental implementation of compiler-driven automatic sharding of models across a given device mesh.

This repository hosts code that supports the testing infrastructure for the PyTorch organization. For example, this repo hosts the logic to track disabled tests and slow tests, as well as our continuation integration jobs HUD/dashboard.

verl: Volcano Engine Reinforcement Learning for LLMs