I am trying to scrape the href attribute from links from a page, but I end up with [] as the output The HTML code is My desired output is: https://www.pigiame.co.ke/listings/nissan-latio-2016-36000-kms-5300124 Answer You can try: Prints:
Tag: web-scraping
Amazon Web Scraping – retrieving price data
I’m currently working on my first project experimenting with web scraping on python. I am attempting to retrieve price data from an amazon url but am having some issues. When I print the price variable, my output is a bit weird: There’s alot of whitespace and the numbers are formatted in weird way…
Web Scraping with table that can be changed
I have succesfully managed to set together a script now that extracts some information from a table on this website: https://www.nordpoolgroup.com/en/Market-data1/Power-system-data/Production1/Wind-Power-Prognosis/SE/Hourly/?view=table Now, I want to do this for all dates of 2021. I suppose I have to use the …
Why is the get_attribute() function in selenium returning an empty string when inspecting the webpage shows the attribute?
I am trying to grab the src attribute from the video tag from this webpage. This shows where I see the video tag when I am inspecting the image. The XPath for the tag in safari is “//*[@id=”player”]/div[2]/div[4]/video” This is my code: Using .text instead og .get_Attribute also return…
How to scrape reviews from chrome web store for a given extension?
I am trying to use this python code to scrape chrome web store however, I am getting Bad request 400. Is it even possible to scrape chrome web store? Answer The webpage’s contents are loaded by JavaScript. So you have to apply an automation tool something like Selenium to grab the right data. Example: O…
Selenium, issue getting ID of a generic tag and clicking
Issue: I cannot get a clickable variable that points the chosen anime title. The title is an tag that has a tag that contains the anime name. What I want to do is: 1)Get all anime that appear from the website 2)Select the anime that has the same name as the input variable “b” 3)Get the chosen anim…
Getting number of childs of an element with no ID with beatifulsoup
So basically I’m trying to scrape a webpage with Python and I’m getting stucked at finding the number of childs of one element in a list using BeautifulSoup, the HTML of the list follows this: In my case I want to get the number of tr inside tag tbody, but since it has no id, I found no way to
Problem with python web-scraping when reading a URL using “get” function
I have trouble using the “get” function to read the URL taken from cell A1 in the excel file “tennis3.xlsx”. I have tried different solutions and I have no idea how to get it to read it and use it to get a webpage response. The problem probably starts at at ‘sheet[“A1”…
Scraping data through changing Xpaths
I can’t figure out how to scrape data, I am trying to scrape the product name, price and other information from the website, the product names are easy to access as they have similar xpath with only one tag that changes but for the prices the there are multiple changes to the tags.Is there an alternativ…
How do I export a read_html df to Excel, when it related to table ID rather than data in the code?
I am experiencing this error with the code below: I want to save the table I am scraping from wikipedia to an Excel file – but I can’t work out how to adjust the code to get the data list from the terminal to the Excel file using to_excel. I can see it works for a similar problem when a