I am trying to use pandas profiling in AWS Glue. I downloaded the wheel file and used it in the Glue Library Path. BUt whenever I am trying to run a pandas profiling, module missing error is coming up(like multimethod, visions, networkx, pillow and more). What should I do? Answer Please make sure you’ve installed all dependencies from requirements.txt: https://github.com/pandas-profiling/pandas-profiling/blob/develop/requirements.txt
Tag: aws-glue-data-catalog
How to make connection from Aws Glue Catalog tables to custom python shell script?
I have some tables in aws glue data catalog which have been created by crawling the data from S3 buckets.I am writing my own python shell script to perform some data trasformations for data in those tables.But how can I make the connection to those tables in data catalog via python script? Answer If you want to access Glue catalog