B

Baseten

51-200 employees· US·Website ↗

AI inference infrastructure company that builds and operates model serving platforms for production ML applications.

Technology
Share:
Get the full context.

Sign up to read complete case studies, access detailed metrics, and unlock all use cases.

Use Cases (1)

B
Baseten
5x
throughput improvement for high-traffic endpoints

Baseten, the AI inference platform pooling GPUs from 10+ cloud providers for some of the world’s fastest-growing AI companies, adopted NVIDIA Blackwell GPUs on Google Cloud alongside NVIDIA Dynamo and TensorRT-LLM. The result: 5x higher throughput for high-traffic endpoints, up to 225% better price-performance serving DeepSeek-R1 and Llama 4, and 38% lower latency for large language model serving.

TechnologyNDNVIDIA DynamoNTNVIDIA TensorRT-LLM
Baseten AI Use Cases & Strategy | Applied