Projects

A Benchmark for Table-Augmented Generation

An Efficient Collective Communication Library for GPUs

Give your generative models a vibe check 😀

Next-Generation Open Vision and AI

Train your own O1 preview model within $450

LSP client library in Python to build applications around language servers

A New Framework for End-to-End Querying of Geospatial Videos

Encrypted Semantic Search with High Accuracy

The Framework For Programming—Not Prompting—Foundation Models

Easily Build Knowledge-Intensive LLM Applications That Reason Over Your Data With LOTUS!

Serving Thousands of Concurrent LoRA Adapters

A Framework for Serving and Evaluating LLM Routers – Save LLM Costs Without Compromising Quality!

We introduce Stylus, which efficiently selects and automatically composes task-specific adapters based on a prompt’s keywords.

VideoArena establishes the first dynamic leaderboard for SOTA text-to-video generation models.

Elevating LLM Function Calling with Versatile API Integration

Function-Calling Capability of Different LLMs

A Dynamic Framework for Evaluating AI Coding Systems

A General Solution to Rollback Attacks in TEEs

Automatically Rewriting Distributed Protocols for Scalability

Enabling Replicated State Machines to Communicate Efficiently

The SVR3 project aims to store client-side secrets server-side protected by a human-remembered (and thus, low-entropy) pin.

Let orchestrators run your workloads on your cloud resources without handing over your cloud credentials and data.

A Framework for Deploying On-Demand Distributed Trust

Training Neural Networks on Tiny Devices with Integrated Rematerialization and Paging

A Fast & Accurate Oracle for Object Placement

Holistic and Contamination Free Evaluation of Large Language Models for Code

Blazing Fast Bulk Data Transfers Between Any Cloud

“Retrieval-Augmented Fine-Tuning” combines the benefits of Retrieval-Augmented Generation and Fine-Tuning for better domain adaptation

An Automatic Pipeline to Build High-Quality LLM Benchmarks with High Separability and Agreement to Human Preference from Live Data

A Fast Serving Framework For Large Language Models and Vision Language Models

Building the fastest and easiest-to-use inference engine for LLMs

An Open-Source Chatbot Impressing GPT-4 with 90%* ChatGPT Quality

An Open Platform for Evaluating LLMs by Human Preference

A Runtime for LLM-Generated Actions like Code, API Calls, and More.

A Totally Ordered, High Throughput, Pub/Sub System with Disaggregated Memory

Gorilla is an open-source, state-of-the-art LLM that invokes API calls to interact with services!

Pioneering Cloud-Native Programming for Scalable Distributed Applications

Teach LLMs to manage their own memory for unbounded context!

SkyPilot is a framework for running LLMs, AI, and batch jobs on any infrastructure, offering maximum cost savings, highest GPU availability, and managed execution.