Tag: selenium

Shorten Selenium-Wire Option

I would like to improve the following case by shorting it. I’ve come this far You could say that I should just remove the n decision, but I can’t because I need seleniumwire_options later. Answer You can shorten it by factoring out common parts, like this:

Selenium / Use pagination on site?

python selenium web-scraping xpath

i want to trigger the pagination on this site: https://www.kicker.de/bundesliga/topspieler/2008-09 I found the element with this XPATH in the chrome-inspector: Now i want to click this element to go one page further – but i get an error. This is my code: But i get this error: How can i go to the next pa…

How would I get all elements with a specific XPATH, get the lowest price among them, then get the title of it? [Using Selenium]

python selenium

I’m working on something to scrape all element texts, somehow sort the number and get the title in it. I’ve gotten to the point where I can print all element texts but I can’t seem to get the lowest number and title. I’m also only trying to get the elements that are “CARdano4SPEE…

How to get text from a html using Selenium and Python which has two elements with the same classname where I need to extract both

html python selenium selenium-webdriver webdriver

I have a html like: and my python code like: Is it possible make this get all elements with same class name and put on a array or define as different variable like this? OutPut: #or Actualy my code only get the first one Answer As per the HTML: The following line line of code: will always identify the first

Getting first sibling of second instance using Xpath

google-chrome html python selenium selenium-chromedriver

I’m trying to extract information from this page: I’m trying to extract the time (6:30 PM). My strategy is to find the second instance of the date (Mar. 31st, 2022), and then get the first sibling of that. Photo here (I want the part boxed in yellow): Here’s what I’ve tried: However, t…

copy and paste in selenium python

python selenium

I’m new to selenium I am trying to copy something from one page to another, the page that I copy off of already has it so if you just click on the text once it copies automatically but it is not copying anything I am not sure why Answer On my Linux in Firefox and Chrome works Like I tried

Python / Selenium only print if class has a certain value + only print certain elements in html

html proxy python selenium web-scraping

I am coding a script that is going to test all free proxies available on: https://free-proxy-list.net/ On this site there is a list with all available proxies, and I managed to make my script print them all but, I only want to print the proxy value if https is enabled. This is how the Html looks when https is…

How to get all links from a webpage using selenium?

python selenium web-scraping

I am trying to webscrape a site using Python, Selenium, Beautifulsoup. When I tried to get all the links ,It’ returning an invalid string. This is what I have tried Can someone help me please? Answer It is your selection with xpath, you select the <div> that do not have an href attribute. Select a…

how to get height and ‘X’ value from react tag using BeautifulSoup?

beautifulsoup python selenium

I am trying to get the bar graph height and value of x from this site https://www.sofascore.com/football/livescore Here is what I want to do: Here is what I am getting here is my code Answer There’s an api to get that. Just input the event ID. Output: