Senior Software Engineer - Clickpipes (CDC/Streaming)

Job description

Note: . We are hiring for this role remotely in any country ClickHouse has a hiring presence. About the Team The ClickPipes - Database Integrations team builds the platform that enables real-time data replication from databases into ClickHouse at petabyte scale. As a member of this team, you will be solving complex database-related challenges and distributed systems problems, such as understanding database internals to optimize snapshotting strategy, handling schema evolution during live replication, managing data type compatibility across systems, maintaining low end-to-end latency under unpredictable loads, and leveraging durable execution frameworks to ensure data consistency over unreliable networks. We work in the open — our database integrations are built on PeerDB , an open-source CDC platform we actively maintain and contribute to. See some of our recent work: ClickPipes for Postgres now supports failover replication slots MongoDB CDC to ClickHouse with Native JSON Support Under the Hood: Building MySQL Change Data Capture in ClickPipes What You’ll Do: Build data-intensive systems Design and develop high-throughput integrations with databases (Postgres, MySQL, MongoDB), data lakes (Iceberg, Delta Lake), and data warehouses (BigQuery, Snowflake). Handle edge cases in real-world production scenarios: unconventional database setups, internals of data types, database upgrades/failovers, large transactions, etc. Design integration solutions to enable users to fully harness ClickHouse's performance and throughput. Own end-to-end reliability Debug complex issues in production leveraging runtime diagnostics (e.g. pprof, parca) and observability tools (e.g. metrics, logging, tracing). Build and improve infrastructure and tools to increase system reliability, reduce incident response time, and simplify/automate operations. Write clear documentation, both publicly and internally. Participate in on-call rotation. Drive product innovation Work directly with customers to understand integration requirements and discover gaps in existing product. Collaborate cross-functionally with internal teams to ensure operational efficiency. Lead technical discussions and influence product roadmaps. About You: 5+ years of industry experience building data-intensive software solutions. Proficient in Go, or experienced in systems programming with willingness to ramp up quickly i…