I installed airflow (v 2.2.4) on the ami below: The folder it currently lives in is here (But should I relocate this somewhere else per these docs?) AMI INFO: And the issue I am having is that after I run airflow initdb – which works great, I run airflow webserver and when I try to copy in the http valu…
Tag: amazon-web-services
Query destination account to which a VPC is shared in AWS
In AWS, I have a centralized networking account that defines all the VPCs and subnets. And each VPC is shared with target accounts using Resource Access Manager (RAM). Given an IP, need to find out the target account ID with which the VPC/subnet has been shared with. Here is what I have done so far: In the co…
How to check the ssm connection status of all the servers with a specific tag value using python boto3
I wanted to check the ssm connection status of all the servers with a specific tag. I am making use of the boto3 module get_connection_status as follows. However get_connection_status functions accepts only strings and not list. Hence I am getting the below error. How can I get rid of this? {“ExecutionL…
Get context data from Lambda Authorizer (APi Gateway)
I’m using the Aws Lambda authorizer to secure an Api gateway. The authorizer lambda function is written in python using this blueprint from aws (https://github.com/awslabs/aws-apigateway-lambda-authorizer-blueprints/blob/master/blueprints/python/api-gateway-authorizer-python.py) I added this code in the…
ModuleNotFoundError: No module named in AWS Build
I can run the project on my local MAC, but when I use the pipeline to build it. I got this error: Command “python setup.py egg_info” failed with error code 1 in /tmp/pip-build-axjgd0da/MarkupSafe/ This project is working well, and I did not update any new lib in it. Even I redeployed to the old br…
Error using docker compose in AWS Code Pipeline
I’m deploying my dockerized Django app using AWS Code Pipeline but facing some errors of Docker. error: docker-compose-deploy.yml buildspec.yml Answer Docker Hub limits the number of Docker image downloads (“pulls”) based on the account type of the user pulling the image. Pull rates limits are based on …
Uploading folder from local system to a perticular folder in S3
What should I change in my code so that I can upload my entire folder from local system to a particular folder present in my s3 bucket. Answer You are not using your bucket_folder at all. This should be the beginning of your S3 prefix as in the S3 there are no folders. Its all about key names and prefixes.
S3 appending random string in file name
I have a s3 folder with a csv file stored on it. I’m trying to download the last modified file. I’m using this script to get the last modified file: This code lists my last modified object, the file name is part-00000-40f267f2-38dc-4bab-811c-4c3052fdb1ba-c000.csv and is inside the file_r folder. A…
AWS Lambda function handler missing
I created the following lambda function and its given me the following error. I am new to Python and I dont think there’s anything missing in the function. can someone please help to make this function work? Thanks Execution result Answer Very simple. Rename handler to lambda_handler, or change your lam…
Indicate a directory on Amazon’s S3
I’m new to AWS services. I’ve always used the code below to calculate NDVI for images that were located in a directory. Now all the necessary images are in an amazon S3 folder. How do I replace the lines below? Answer Amazon S3 is not a filesystem. You will need to use different commands to: List …