Skip to content

Composable for

Groq

Groq is a fully integrated inference provider and execution environment in which language models run. Groq created the first Language Processing Unit™ (LPU™) Inference Engine. It is an end-to-end processing unit system that provides extremely fast inference for computationally intensive applications with a sequential component to them.
Groq-600x240

Groq Integration

The integration with Groq offers unique benefits to Composable users

Composable-Prompts-Screenshot-Synthetic-LLM
  • Powerful prompt studio
  • Execution and management UI
  • Easily port part of your workloads to Groq without application code changes

Features of the environment

Environments are the execution runtime environment for the generative model
  • Portable Task Model

    Execute a task on any model and inference provider with zero changes

  • Single Execution Interface

    For all models and providers, including streaming

  • Virtualization Layer

    Integrate different models and providers into a single virtualized environment

  • Fine-Tuning

  • Storage, Indexing & Search

  • Load- Balancing

Get started with a free trial of Composable