I’m trying to execute a query in Athena, but it fails.
Code:
client.start_query_execution(QueryString="CREATE DATABASE IF NOT EXISTS db;", QueryExecutionContext={'Database': 'db'}, ResultConfiguration={ 'OutputLocation': "s3://my-bucket/", 'EncryptionConfiguration': { 'EncryptionOption': 'SSE-S3' } })
But it raises the following exception:
botocore.errorfactory.InvalidRequestException: An error occurred (InvalidRequestException) when calling the StartQueryExecution operation: The S3 location provided to save your query results is invalid. Please check your S3 location is correct and is in the same region and try again. If you continue to see the issue, contact customer support for further assistance.
However, if I go to the Athena Console, go to Settings and enter the same S3 location (for example):
the query runs fine.
What’s wrong with my code? I’ve used the API of several the other services (eg, S3) successfully, but in this one I believe I’m passing some incorrect parameters. Thanks.
Python: 3.6.1. Boto3: 1.4.4
Advertisement
Answer
EDIT: As suggested by Justin, AWS later added support for Athena by adding athena
prefix to the bucket. Please upvote his answer.
Accepted Answer:
The S3 location provided to save your query results is invalid. Please check your S3 location is correct and is in the same region and try again.
Since it works when you use the console, it is likely the bucket is in a different region than the one you are using in Boto3
. Make sure you use the correct region (the one that worked in the console) when constructing the Boto3
client. By default, Boto3
will use the region configured in the credentials file.