Scraping dynamic dropdown with Selenium in Python

I woud like a bit of help with the following. I am trying to scrape the elements of the tickers’ dropdown on this website: https://live.hxro.io/tixwix My code is as follow using selenium from selenium …

Format the extracted covid vaccine data from website

Trying to format the “Vaccine data” from URL to pandas dataframe https://www.mygov.in/sites/default/files/covid/vaccine/covid_vaccine_timeline.json Here is the parent website https://www….

How to access a specific p tag while using BeautifulSoup

Hello everyone I’m having trouble while using BeautifulSoup , indeed i don’t succeed to access the information that I want, here is my code : import nltk import requests from bs4 import …

Scraping search results off of Sportchek with Beautiful Soup 4 to find prices

So I’m trying to web scrape search results from Sportchek with BS4, specifically this link “https://www.sportchek.ca/categories/men/footwear/basketball-shoes.html?page=1”. I want to get the …

Why do I run into trouble webscraping this website in Python?

I am new to Python and I am trying to webscrape this website. What I am trying to do is to get just dates and articles’ titles from this website. I follow a procedure I found on SO which is as follows:…

Can’t stratify output based on different headings and their corresponding paragraphs

I’m trying to fetch each heading and their corresponding paragraphs from the html elements below. The results should be stored within a dictionary. Whatever I’ve tried so far produces ludicrously …

How can I scrape a href that is hidden behind a placeholder?

I’m trying to scrape the below href from a site. There are several hrefs on the site which I intend to scrape and so I am looping through the site in order to store them all in one list. Below is an …

Can’t convert this text in normal format in python?

I am web-scraping some stuff and i got something like this “735 πš†πš’πš•πš•πš’πšŠπš– πšƒ π™Όπš˜πš›πš›πš’πšœπšœπšŽπš’ π™±πš•πšŸπš, π™³πš˜πš›πšŒπš‘πšŽπšœπšπšŽπš›, 𝙼𝙰 02122 Dorchester MA 02121” how do i convert it to …

Beautifulsoup : Unable to extract href with several conditions

I’m trying to extract every links with BeautifulSoup from the SEC website such as this one by using the code from this Github. The thing is I do not want to extract every 8-K but only the ones …

Get meta tag content by name, beautiful soup and python

I’m trying to get the meta data from this website(here’s the code). import requests from bs4 import BeautifulSoup source = requests.get(‘https://www.svpboston.com/’).text soup = BeautifulSoup(source,…