I’m currently looking to scrape https://www.bestfightodds.com/ for an MMA machine learning project. I’m specifically looking for the DraftKings opening odds for each fighter which is found by clicking on the odds for a given fighter under the DraftKings column. You are then presented with a popup …
Tag: web-scraping
Use Beautiful Soup to unify #text after a tag
I’m using Beautiful Soup to put in a excel table some infos from a website. The bold titles are shown in the head columns while the text after the colon appear in the rows. What I’m doing is finding the text and searching for next_sibling –> The problem is that in some cases the text afte…
Extract href by class Selenium Python
Im trying to get all hrefs that are found the a specific class next to them. Im not really familiar with HTML so I’m having some trouble. Basically the HTML code in inspect is: I’m using the find_elements command to find all lines that include the class “notranslate _0imsa ” like this:…
Python beautifulsoup – get all text separated by break tag
I have the following tables: I can traverse towards this part of the HTML using the following code below: I am able to get the text using the one below: The output I want to arrive to is a result of all text then separated by a semicolon (;) like so: ANGARA, EDGARDO J.;ENRILE, JUAN PONCE;MAGSAYSAY JR., RAMON …
How to identify a link from href based on string and class name?
I’m trying to get some data from https://betsapi.com/, specifically from the soccer area using python I saw in the code that the link is dynamic, I mean that a couple of weeks ago it was https://betsapi.com/cin/soccer and now is https://betsapi.com/cip/soccer. Looking on the code I would like to underst…
Selenium / Use pagination on site?
i want to trigger the pagination on this site: https://www.kicker.de/bundesliga/topspieler/2008-09 I found the element with this XPATH in the chrome-inspector: Now i want to click this element to go one page further – but i get an error. This is my code: But i get this error: How can i go to the next pa…
How to extract multiple job url from a jobpost using python webscrapping
I have so far created the below code, to extract all the informations, but I cant figure out how to extract the link. I have tried with a for loop, but i get differents links. I really hope anyone can point me at the right direction. Answer You can combine an attribute = value css selector with contains * ope…
How to use playwright and beautifulsoup on web page which has pagination?
Locked for 37 days. There are disputes about this question’s content being resolved at this time. It is not currently accepting new answers or interactions. I am new to web scraping. I want to scrape the data (comments and respective dates) from this web page https://forum.donanimhaber.com/turkcell-25-000-dk-…
Extract single data point from multiple, webscraping
I am trying to extract stock symbols (3rd column) from the table in below screener: https://chartink.com/screener/2-short-trend and pass them on to a dataframe. Due to my limited knowledge, I have hit a wall and can not move past it. My code is: Output: I just need stock symbols: M&M, APOLLOTYRE etc., and…
How to go to the next page using BeautifulSoup?
I am trying to scrape data from all the 37 web pages from this website. The website I am scrapping doesn’t allow going to the next page through the search bar. This is the HTML written for the next button. I know that this can be done with Selenium, but is there any way to do this with BeautifulSoup? Is