Projects

A framework that turns static GitHub repository into a dynamic runnable environments to evaluate the performance of code-generating systems, both static and interactive

A General Solution to Rollback Attacks in TEEs

Automatically Rewriting Distributed Protocols for Scalability

Enabling Replicated State Machines to Communicate Efficiently

The SVR3 project aims to store client-side secrets server-side protected by a human-remembered (and thus, low-entropy) pin.

Let orchestrators run your workloads on your cloud resources without handing over your cloud credentials and data.

A Framework for Deploying On-Demand Distributed Trust

Training Neural Networks on Tiny Devices with Integrated Rematerialization and Paging

A Fast & Accurate Oracle for Object Placement

Holistic and Contamination Free Evaluation of Large Language Models for Code

Blazing Fast Bulk Data Transfers Between Any Cloud

“Retrieval-Augmented Fine-Tuning” combines the benefits of Retrieval-Augmented Generation and Fine-Tuning for better domain adaptation

An Automatic Pipeline to Build High-Quality LLM Benchmarks with High Separability and Agreement to Human Preference from Live Data

SGLang is a structured generation language designed for large language models (LLMs). It makes your interaction with LLMs faster and more controllable by co-designing the frontend language and the runtime system.

Building the fastest and easiest-to-use inference engine for LLMs

An Open-Source Chatbot Impressing GPT-4 with 90%* ChatGPT Quality

An Open Platform for Evaluating LLMs by Human Preference

A Runtime for LLM-Generated Actions like Code, API Calls, and More.

A Totally Ordered, High Throughput, Pub/Sub System with Disaggregated Memory

Gorilla is an open-source, state-of-the-art LLM that invokes API calls to interact with services!

The Hydro Project at UC Berkeley is developing cloud-native programming models that allow anyone to develop scalable and resilient distributed applications.

Teach LLMs to manage their own memory for unbounded context!

SkyPilot is a framework for running LLMs, AI, and batch jobs on any infrastructure, offering maximum cost savings, highest GPU availability, and managed execution.