I’m trying to get some data from https://betsapi.com/, specifically from the soccer area using python I saw in the code that the link is dynamic, I mean that a couple of weeks ago it was https://betsapi.com/cin/soccer and now is https://betsapi.com/cip/soccer. Looking on the code I would like to underst…
Tag: beautifulsoup
How to extract multiple job url from a jobpost using python webscrapping
I have so far created the below code, to extract all the informations, but I cant figure out how to extract the link. I have tried with a for loop, but i get differents links. I really hope anyone can point me at the right direction. Answer You can combine an attribute = value css selector with contains * ope…
How to use playwright and beautifulsoup on web page which has pagination?
Locked for 37 days. There are disputes about this question’s content being resolved at this time. It is not currently accepting new answers or interactions. I am new to web scraping. I want to scrape the data (comments and respective dates) from this web page https://forum.donanimhaber.com/turkcell-25-000-dk-…
How to go to the next page using BeautifulSoup?
I am trying to scrape data from all the 37 web pages from this website. The website I am scrapping doesn’t allow going to the next page through the search bar. This is the HTML written for the next button. I know that this can be done with Selenium, but is there any way to do this with BeautifulSoup? Is
HTML problem with tags and classes in a simple and little scraping with BeautifulSoup
I am new and am trying to get BeautifulSoup to work. I have Html problems with recovering classes and tags. I get closer, but there is something I’m wrong. I insert wrong tags and classes to scrape the title, time, link, and text of a news item. I would like to scrape all those titles in the vertical li…
how to get height and ‘X’ value from react tag using BeautifulSoup?
I am trying to get the bar graph height and value of x from this site https://www.sofascore.com/football/livescore Here is what I want to do: Here is what I am getting here is my code Answer There’s an api to get that. Just input the event ID. Output:
scrape next page by changing the number of page in URL
I have trouble scraping information on the next pages. I also have a problem when some tags change like when the website developer changes an “a href” with “h2 class” when I reach the appart_response= requests.get(link) Please can you check with me the following code: Answer There is s…
How to scrape only a single href from a div class?
I would like to extract the content of the 1st <a href> from this <div> I’m using BeautifulSoup and I’m also scraping some other contents from the same page and by using the following solution as result for abstract I’m having None Is there a system to reach the first href by usi…
Python – Beautiful Soup – extract text between and
HTML content I have a webpage to parse. The HTML code is in the figure. I need to extract the price, which is simple text: This is the only “price” class on the page. So I call the find() method: The cost is None. I have tried .next_sibling function and .text functions. But as find() returns None,…
Scraping all entries of lazyloading page using python
See this page with ECB press releases. These go back to 1997, so it would be nice to automate getting all the links going back in time. I found the tag that harbours the links (‘//*[@id=”lazyload-container”]’), but it only gets the most recent links. How to get the rest? Answer The dat…