add airbyte

This commit is contained in:
jigoong
2026-02-16 23:20:48 +07:00
parent 0a2b162c3e
commit dbc52384ba
7 changed files with 46 additions and 75 deletions

View File

@@ -1,18 +1,28 @@
# 04-ingestion: Airbyte Data Ingestion
## Services
- Airbyte Webapp
- Airbyte Server
- Airbyte Worker
- Temporal (workflow engine)
Airbyte OSS for data ingestion and ETL (standalone deployment).
## Services
- **airbyte**: All-in-one Airbyte container (webapp + server + worker + temporal)
## Run
## Start
```bash
docker compose --env-file ../.env.global up -d
```
## Access
Internal - configure Nginx Proxy Manager to expose at `/airbyte`
- Web UI: http://localhost:8000
- Configure in Nginx to route domain to `airbyte:8000`
## Note
This uses Airbyte standalone image for simplicity. For production with high workload:
- Consider using full Airbyte stack with separate containers
- Or use `abctl` (Airbyte Command Line Tool)
- See: https://docs.airbyte.com/deploying-airbyte/docker-compose
## First Time Setup
1. Create database: `docker exec postgres psql -U postgres -c "CREATE DATABASE airbyte;"`