Saturday, August 3, 2019

How to run Athena queries from Apache NiFi


2. Place the jar file on nifi servers and make nifi user as owner.

3. Create the DBCPConnectionPool service




JDBC url: jdbc:awsathena://AwsRegion=[REGION];UID=[ACCESS KEY];PWD=[SECRET KEY];S3OutputLocation=[LOCATION]

jdbc:awsathena://AwsRegion=us-east-1;S3OutputLocation=s3://aws-athena-query-results-127370262072-us-east-1

for database user and password, provide access key and secret key.

4. Configure the ExecuteSQL processor like below