unable to scrape table on website using beautifulsoup

I am trying to scrape this table: https://www.coingecko.com/en/coins/recently_added?page=1 Here is my code: import requests from bs4 import BeautifulSoup import csv root_url = “https://www….

Finding a span tag with a ‘variable’? but no class – Beautiful soup/Python

I am using BeautifulSoup and Python to find a span tag that doesnt seem to have a class. I am wanting to get the text “1hr ago” in the span tag, it has a… Variable? called “data-…

How to access a specific p tag while using BeautifulSoup

Hello everyone I’m having trouble while using BeautifulSoup , indeed i don’t succeed to access the information that I want, here is my code : import nltk import requests from bs4 import …

bs4 p tags returning as None

import bs4 import requests import re r = requests.get(‘https://www.the961.com/latest-news/lebanon-news/’).text soup = bs4.BeautifulSoup(r, ‘lxml’) for article in soup.find_all(‘article’): …

Python Selenium – Clicking pages without next button

I would like to get info from multiple pages by clicking through them. The problem is there is not next button and even though the page link contains a number for counting through , as you can see in …

Python beautiful soup get only body content without header or footer data [closed]

In my code I need to get only the main text not the header or footer data. I also would like to filter out any html/css/js code that is received with the request. How would I do this? I have tried …

Scraping search results off of Sportchek with Beautiful Soup 4 to find prices

So I’m trying to web scrape search results from Sportchek with BS4, specifically this link “https://www.sportchek.ca/categories/men/footwear/basketball-shoes.html?page=1”. I want to get the …

Can’t stratify output based on different headings and their corresponding paragraphs

I’m trying to fetch each heading and their corresponding paragraphs from the html elements below. The results should be stored within a dictionary. Whatever I’ve tried so far produces ludicrously …

python web scrapping issues with mechanize

I am trying to scrap web results from the website: https://promedmail.org/promed-posts/ I have followed beutifulsoup. mechanical soup and mechanize so far unable to scarp the search results. import re …

How can I scrape a href that is hidden behind a placeholder?

I’m trying to scrape the below href from a site. There are several hrefs on the site which I intend to scrape and so I am looping through the site in order to store them all in one list. Below is an …