add airbyte docker compose
This commit is contained in:
@@ -1,10 +1,14 @@
|
||||
# 04-ingestion: Airbyte Data Ingestion
|
||||
|
||||
Airbyte OSS for data ingestion and ETL (standalone deployment).
|
||||
Airbyte OSS for data ingestion and ETL (multi-container deployment).
|
||||
|
||||
## Services
|
||||
|
||||
- **airbyte**: All-in-one Airbyte container (webapp + server + worker + temporal)
|
||||
- **airbyte-proxy**: Public entrypoint (UI/API gateway)
|
||||
- **server**: Airbyte backend
|
||||
- **worker**: Runs sync jobs and launches connector containers
|
||||
- **webapp**: Airbyte UI
|
||||
- **airbyte-temporal**: Workflow engine
|
||||
|
||||
## Run
|
||||
|
||||
@@ -15,14 +19,11 @@ docker compose --env-file ../.env.global up -d
|
||||
## Access
|
||||
|
||||
- Web UI: http://localhost:8000
|
||||
- Configure in Nginx to route domain to `airbyte:8000`
|
||||
- Configure in Nginx to route domain to `airbyte-proxy:8000`
|
||||
|
||||
## Note
|
||||
|
||||
This uses Airbyte standalone image for simplicity. For production with high workload:
|
||||
- Consider using full Airbyte stack with separate containers
|
||||
- Or use `abctl` (Airbyte Command Line Tool)
|
||||
- See: https://docs.airbyte.com/deploying-airbyte/docker-compose
|
||||
This deployment pins Airbyte images to avoid `:latest` tag issues.
|
||||
|
||||
## First Time Setup
|
||||
1. Create database: `docker exec postgres psql -U postgres -c "CREATE DATABASE airbyte;"`
|
||||
|
||||
Reference in New Issue
Block a user