Skip to content

Tag: selenium

Reddit isn’t scraping the top comments (python/selenium)

Put the entire code into a question, thank you to all that have replied but this issue is super annoying either way help is appreciated! Context: This code is meant to go onto the top reddit post of the day/week, then screenshot it and once that’s done it goes to the comments and screenshots the top com…

Finding specifig value in class – Selenium (Python)

I’m trying to scrap a website using selenium. I tried using XPATH, but the problem is that the rows on the website change over time… How can I scrap the website, so that it gives me the output ‘21,73’ ? Answer You can just use querySelector that accepts CSS selectors. I personally like…

Following links and crawling them

I was trying to make a crawler to follow links, with this code I was able to get the links but the part of entering the links and getting the information I need was not working, so a friend helped me to come up with this code It gets the json with the page items, but in loop number 230