Athena Connector

Install PipeRider with the Athena connector and connect to a Athena data source.

Installation

pip install 'piperider[athena]'

Configuration (DBT)

Run the diagnose command in the dbt project

piperider diagnose

If you can successfully connect to Athena using dbt, PipeRider can also connect to Athena using the same profile settings. For details, please refer to the dbt Athena adapter documentation.

Configuration (Non-DBT)

non-dbt use case is deprecated since v0.25.0

The adapter utilizes AWS CLI/boto3 credential file to connect to Athena. You can provide

• ~/.aws/credentials

• or AWS_* environment variables

Please refer to the aws credentials document

Initialize a new Athena PipeRider project

piperider init
[?] What is your data source name?: AthenaProject
[?] Which data source would you like to connect to?:
 > athena

Follow the prompts entering the required information.

Required information

After selecting Athena as your data source, you will be promoted for the following information:

• S3 location to store Athena query results and metadata: Same as the query result location in the query editor.

• AWS region name of your Athena instance: e.g. us-east-1

• Athena data catalog: Same as the data source name in the query editor. Use awsdatacatalog for AWS Glue Data Catalog.

• Athena database: Same as the database name in the query editor

Test connection settings

After configuring your connection settings, ensure that PipeRider can connect to your Athena data source.

piperider diagnose