Connect to Databricks

Complete the following steps to connect to Databricks as a data pipeline destination. This connection allows the pipeline to replicate and load data into Databricks.

1

Select Create > Connection.

2

Search for and select Databricks on the New connection page.

3

Enter a name in the Connection name field.

Databricks connection setup

4

Use the Location drop-down to select the project where you plan to store the connection.

5

Enter the Server hostname for your Databricks instance.

6

Enter the HTTP path. This path identifies the specific SQL warehouse in your Databricks environment.

7

Enter the Port for the connection. The default is 443.

8

Optional. Specify a Catalog. If left blank, the connector uses the default hive_metastore.

9

Optional. Specify a Schema. If left blank, the connector uses the default schema default.

10

Optional. Select a Database timezone. This timezone applies to timestamps during data replication.

11

Use the Authentication type drop-down menu to select one of the following authentication types:

• Username/Password: Enter your Databricks credentials in the Username and Password fields.
• Personal Access Token: Enter your Personal Access Token in the corresponding field.

12

Click Connect to verify and establish the connection.