Unlock the Power of One Connect Databricks JDBC Connector
Idempotent Writes
The default insert.mode is INSERT. If configured as UPSERT, the connector will use upsert semantics rather than plain insert statements. Upsert semantics refer to atomically adding a new row or updating the existing row if there is a primary key constraint violation, providing idempotence.
Schema Registry
The connector supports Avro input format for Key and Value. Schema Registry must be enabled to use a Schema Registry-based format
Table and column auto-creation & evolution
Auto.create and auto-evolve are supported. If tables or columns are missing, they can be created automatically. Table names are created based on Kafka topic names.
Cloud Agnostic
Thanks to its container-based implementation, One Connect is platform-independent and can run on any operating system and cloud.
OAuth Supported
The connector supports the usage of OAUTH, a personalized token instead of a password. Databricks tools and SDKs that implement the Databricks client unified authentication standard will automatically generate, refresh, and use Databricks OAuth access tokens on your behalf as needed for OAuth M2M authentication.
Custom Catalogs and Schemas
The ability to access and customize various catalogs and schemas allows for highly flexible organization and management of data insertion. Users can tailor these elements to their specific needs, optimizing the handling and storage of information.
Raw Data
The connector supports sinking raw data to Databricks when insert.mode is INSERT and pk.mode is none.