Dozer is a real time data movement tool leveraging CDC from various sources to multiple sinks.
Dozer is magnitudes of times faster than Debezium+Kafka and natively supports stateless transformations. Primarily used for moving data into warehouses. In our own application, we move data to Clickhouse and build data APIs and integration with LLMs.
Dozer runs with a single configuration file like the following:
app_name: dozer-benchversion: 1connections:
- name: pg_1config: !Postgresuser: userpassword: postgreshost: localhostport: 5432database: customerssinks:
- name: customersconfig: !Dummytable_name: customersFull documentation can be found here
| Connector | Extraction | Resuming | Enterprise |
|---|---|---|---|
| Postgres | ✅ | ✅ | ✅ |
| MySQL | ✅ | ✅ | ✅ |
| Snowflake | ✅ | ✅ | ✅ |
| Kafka | ✅ | 🚧 | ✅ |
| MongoDB | ✅ | 🎯 | ✅ |
| Amazon S3 | ✅ | 🎯 | ✅ |
| Google Cloud Storage | ✅ | 🎯 | ✅ |
| **Oracle | ✅ | ✅ | Enterprise Only |
| **Aerospike | ✅ | ✅ | Enterprise Only |
| Database | Connectivity | Enterprise |
|---|---|---|
| Clickhouse | ✅ | |
| Postgres | ✅ | |
| MySQL | ✅ | |
| Big Query | ✅ | |
| Oracle | ✅ | Enterprise Only |
| Aerospike | ✅ | Enterprise Only |