Databricks

Connect DataDrop to your Databricks workspace.

Prerequisites

  • A Databricks workspace (AWS or Azure)
  • A SQL warehouse or all-purpose cluster
  • A personal access token (PAT) with SQL query permissions
  • Network access from DataDrop to the Databricks workspace

Connection Parameters

ParameterRequiredDescription
server_hostnameRequiredDatabricks workspace hostname.e.g. adb-123456789.1.azuredatabricks.net
http_pathRequiredHTTP path to the SQL warehouse or cluster.e.g. /sql/1.0/warehouses/abc123
access_tokenOptionalPersonal access token. Either this or a Secret ARN is required.e.g. dapi...
token_secretOptionalAWS Secrets Manager ARN storing the access token.
catalogOptionalUnity Catalog name.e.g. main
schemaOptionalDefault schema for queries.e.g. default

Finding Your HTTP Path

To find the HTTP path for your SQL warehouse:

  1. Go to your Databricks workspace
  2. Navigate to SQL Warehouses
  3. Click on your warehouse
  4. Open the Connection Details tab
  5. Copy the HTTP Path value

It will look like /sql/1.0/warehouses/abc123

Unity Catalog

If your workspace uses Unity Catalog, specify the catalog and schema to set the default context for queries. DataDrop will use USE CATALOG and USE SCHEMA before running your query.