Saturday, August 3, 2019

How to run Athena queries from Apache NiFi


2. Place the jar file on nifi servers and make nifi user as owner.

3. Create the DBCPConnectionPool service




JDBC url: jdbc:awsathena://AwsRegion=[REGION];UID=[ACCESS KEY];PWD=[SECRET KEY];S3OutputLocation=[LOCATION]

jdbc:awsathena://AwsRegion=us-east-1;S3OutputLocation=s3://aws-athena-query-results-127370262072-us-east-1

for database user and password, provide access key and secret key.

4. Configure the ExecuteSQL processor like below








2 comments:

  1. Hello, I made the connection as indicated but I get an error "Cannot create PoolableConnectionFactory (No host specified: jdbc:awsathena://AwsRegion=us-east-1;S3OutputLocation", could you please support me

    ReplyDelete
  2. AWS Athena's serverless approach is a paradigm shift in data analysis, offering unparalleled efficiency, cost-effectiveness, and adaptability. By embracing this serverless evolution, organizations can quickly derive insights from their data without the complexities associated with traditional infrastructure. AWS Athena consulting services further enhance this efficiency, providing organizations with the expertise needed to optimize their use of Athena and extract maximum value from their analytical endeavors.

    ReplyDelete