Quickstart
You can deploy the entire Astralog stack (including MinIO and ClickHouse) on your local machine to test ingestion and analytics in under 2 minutes.
Prerequisites
1. Clone and Boot the Stack
First, clone the repository and start the entire Astralog stack (Ingestion Engine, MinIO, and ClickHouse) using Docker Compose.
git clone https://github.com/yourusername/astralog.git
cd astralog
docker-compose up -d
Expected Output:
✔ Network astralog_default Created
✔ Container astralog_clickhouse_local Created
✔ Container astralog_storage_local Created
✔ Container astralog_server Created
2. Verify the Services
Once the containers are healthy, the Astralog server will automatically initialize the environment. You can check the events to ensure everything is running correctly:
docker events -f astralog_server
Expected Server Events:
✔ ClickHouse connected and tables initialized
✔ Bucket 'test-bucket' created successfully
✔ S3-to-ClickHouse Syncer activated
Astralog server starting on port 8080
Ingestion pipeline started (BatchSize: 5000, BatchAge: 2s)
3. Run the Stress Test
Want to see Astralog’s performance immediately? While the server is running, open a new terminal and run the included benchmarking tool.
go run tests/stress.go
This will spawn 50 concurrent workers, generating 100,000 events instantly.
5. Verify the Data in ClickHouse
Wait a few seconds for the Syncer to move the data from MinIO to ClickHouse, then query the database to verify ingestion:
curl -s -u default:logpassword "http://localhost:8123/?query=SELECT+count()+FROM+astralog.events"
You should see 100000 returned.