Artificial Intelligencedocker-ready

Text Generation WebUI: the best Open Source alternative to OpenAI API in 2026

Text Generation WebUI (oobabooga) is a very complete interface for running open source text models with multiple backends, extensions and a compatible API, all local.

License AGPL-3.0 ~42k stars (estimated)Website GitHub Repository

Technical profile

License: AGPL-3.0
Category: Artificial Intelligence
Replaces: OpenAI API
Tech stack: PythonPyTorch

Preview

Public image provided by Text Generation WebUI on its own website.

Key features

Supports multiple backends (llama.cpp, ExLlama, Transformers)
Community extensions
OpenAI-compatible API

Text Generation WebUI vs. OpenAI API

Pros

Very flexible for experimenting with different model formats

Things to consider

Requires a powerful GPU for the largest models

Quick Docker installation guide

Copy this docker-compose.yml, adjust the example passwords and run docker compose up -d on your server. See the full step-by-step guide →

docker-compose.yml

version: "3.9"
services:
  text-generation-webui:
    image: atinoda/text-generation-webui:latest
    restart: unless-stopped
    ports:
      - "7860:7860"
    volumes:
      - tgw_models:/app/models
    deploy:
      resources:
        reservations:
          devices:
            - driver: nvidia
              count: 1
              capabilities: [gpu]
volumes:
  tgw_models: