Airflow/EC2 – Save CSV from DAG

I was looking around but I could not find anyone that may have a similar issue. I’m trying to save some results to a CSV into my EC2 instance, but for some reason the return value is none. Here is …

How to upload pandas, sqlalchemy package in lambda to avoid error “Unable to import module ‘lambda_function’: No module named ‘importlib_metadata’”?

I’m trying to upload a deployment package to my AWS lambda function following the article https://korniichuk.medium.com/lambda-with-pandas-fd81aa2ff25e. My final zip file is as follows: https://drive….

Lambda path parameters are embedded inside path dictionary

I have some python AWS lambdas which are deployed using serverless framework and I was able to retrieve the path variables using: event.get(“variable”) I am not sure what has changed but now …

Validate data in Dynamodb is only working through if data is present

this is a rather easy and silly question but I can’t seem to understand the problem at hand. I am trying to create a register page where user could enter thier email, if their email is present, then …

Get tables from AWS Glue using boto3

I need to harvest tables and column names from AWS Glue crawler metadata catalogue. I used boto3 but constantly getting number of 100 tables even though there are more. Setting up NextToken doesn’t …

Why does my Lambda function write an empty csv file to S3?

I’m calling the YouTube API to download and store channel statistics in S3. I can write a csv file to my S3 bucket without any errors, but it’s empty. I have checked this thread Why the csv file in S3 …

On AWS Lambda, Openpyxl doesn’t keep track of the image

when I have a model.xlsx with an image and this code is working perfectly on windows. (keeping the image in output.xlsx) import openpyxl wb = openpyxl.load_workbook(‘model.xlsx’) #doing some stuff on …

get data from s3 Bucket [closed]

def lambda_handler(event, context): if event: # TODO implement params=event.get(‘city’) print(params) s3 = boto3.client(‘s3’) data = s3.get_object(Bucket=’…

Reading a docx file from s3 bucket with flask results in an AttributeError

I got so many different errors, I don’t even know which is pertinent to mention but it’s not about the credentials because I can upload files already and I can read a txt file. Now I want to read a …

How to parse Boto3 200 response for copy_object request

I am new to Python and I’m writing an AWS lambda that copies files from one bucket to another. I am using the Boto3 library and have come across the following in the documentation: A copy request …