Airbyte

Airbyte is an open-source data integration platform. It moves data from sources such as SaaS applications, databases, files and APIs into destinations such as data warehouses, data lakes and vector databases, using a large catalogue of connectors maintained by Airbyte and its community. Its reason for existing is the long tail of data sources. Commercial ELT tools cover popular sources well but charge significant usage-based fees and cannot support every niche API a company relies on. Airbyte's open-source model lets anyone run the platform themselves, inspect and modify connectors, and build new ones. Its low-code Connector Builder and connector development kit make creating a connector for an unsupported API a matter of configuration rather than a full engineering project. The platform handles the core mechanics of data replication: scheduling syncs, incremental updates so only changed records move, change data capture for databases, schema handling, normalisation and monitoring. Data teams typically load raw data with Airbyte and then transform it in the warehouse with tools such as dbt. Increasingly, Airbyte also targets AI use cases, feeding unstructured and structured data into vector stores and AI pipelines. Deployment options cover the spectrum: self-host the open-source version on your own infrastructure, use Airbyte Cloud as a managed service with capacity-based pricing, or choose enterprise offerings with governance and support. Self-hosting removes licence costs and keeps data in your environment, but someone must operate, upgrade and monitor it. The common criticism, typical of large connector catalogues, is uneven connector quality: community connectors vary in maturity, so critical pipelines need testing and monitoring. Alternatives include Fivetran, the best-known managed ELT service with highly reliable connectors at a premium price; Stitch and Hevo for simpler managed pipelines; Meltano and dlt for code-first open-source pipelines; Estuary for real-time streaming; and cloud-native services such as AWS Glue and Azure Data Factory. Choose Airbyte when you need broad, customisable data integration and want the option to self-host. Choose a fully managed service when reliability without operations matters most.