I managed to get the data I wanted with selenium, but now I only need the first 17 data that it gives me, I need to make a kind of filter with this data, because I’m going to use conditions on top of them to use in another code. My result is below As you can see he gave me
Tag: css-selectors
How can I click the button and move to next page using selenium?
I am not able to click the button using selenium and move to the next page. I have tried the following commands: I have added a screenshot of the html. What am I doing wrong? Answer To click on the element with text as Production you can use either of the following Locator Strategies: Using css_selector: Usin…
Web scraping: help needed last post and find link
First, sorry for my poor English. Actually, I have a script which scrapes a website to find comments in webpage, in python. Its for scrape all messages in page, but I will want scrape just last post. How to do this please? Too, I will want to find web links probably posted in last message, but a full link. It…
document.scrollingElement is not working . Not able to scroll down for inspecting elements
Please find the aatched screenshot. and Below code is printing only first 4-5 rows which is visible in the screenshot. It is not scrolling down and inspecting element it is prining blank spaces. Same code is running succesfully without i write code written in main function outside the function. add_data.py -&…
Getting the likes and comments of a photo from Facebook using Selenium
I’m looking forward to getting what the title describes. I’ve already found the way to log in and get the photos of any profile that I search for. But when it comes to the comments or likes of any photo that I select, I cannot get them. By this, I mean that Chromedriver clicks on the photo for dis…
Selenium webdriver : find element question
I am trying to use python Selenium for the first time. This would be a simple question for some of you but I am a bit disappointed here.. I would click on a link text which will open another webpage (WebDriver IE) When I inspect the link I have this: I tried this : but this will open another link
screen scrape text values from span based on other text values from corresponding span with beautiful soup
I have some beautiful soup code, like the example code below. I’m using it to screen scrape financial data from yahoo finance about mutual funds. In this piece of code I’m trying to scrape the “Bond Ratings” percentages, and save them in a dictionary. I’ve been trying to select e…
Selenium returns NoSuchElementException Error
I`m a newbie to python. Recently I got interested in Web Crawling. Today I got stuck in NoSuchElementException This is the webpage that i want to scrape. When I click the username that i erased, it returns box like this. Though I used the xpath that i copied from Chrome developer tool, it returns me NoSuchEle…
easymc.io web scraping tying to extract a value
I’m trying to get as many easymc.io accounts keys as I can, I tried to get the value of a button but it doesn’t and when I’m trying to find the element_by_xpath it says that the xpath does not exist Answer To scrape the value of the accounts keys e.g. 8yBAnUFoNlj3JJHzFE7t you need to induce …
Selenium click on ng-click button
I am trying to automate a website with selenium to download an excel file. I have the following HTML for the button: I have tried clicking on the button with the following find element by class: The error message I get is: I have also tried: And received the following error: I have logged in this website succ…