When I try to download a file online it doesn’t work for a particular site while it works for others. Why is this happening and what should I do about it? I write the content of the dl request in my case https://drivers.amd.com/drivers/amd-software-adrenalin-edition-22.11.1-win10-win11-nov15.exe (warnin…
Tag: request
Parameters are ignored in python web request for JSON data
I try to read JSON-formatted data from the following public URL: http://ws-old.parlament.ch/factions?format=json. Unfortunately, I was not able to convert the response to JSON as I always get the HTML-formatted content back from my request. Somehow the request seems to completely ignore the parameters for JSO…
Different response content when on docker
I am making a request to get a download link through the following request: From my windows laptop and my ubuntu server I am getting the following content: b'{“vid”:”kpz8lpoLvrA”,”title”:”Interstellar Main Theme – Hans Zimmer”,”fn”:”X2Dow…
Save Images with orginal name
I have script to download images from website. But it’s saves name with ‘images1, images2, images3, images4 etc’ I need to save images with orginal name. If the images name 43343.jpg i need to save with 43343.jpg I use beautifulsoup and requests for this case. Sorry my english. It’s no…
request.urlopen(url) not return website response or timeout
I want to take some website’s sources for a project. When i try to get response, program just stuck and wait for response. No matter how long i wait no timeout or response. Here is my code: When i try to other websites, urlopen return their response. But when i try to get “eu.mouser.com” and…
How to get Radio Radio Button Data from POST Request Data in an HTML form?
So I’m coding a test platform consisting of Multiple Choice Questions ( MCQs ) in Django. Everything is working fine but somehow I think that the radio button value from my question page is not getting fetch via POST request. Would appreciate some help! Here are my models : Here are my views : Here̵…
How to extract a table from website without specifying the web browser in python
I’m trying to automate data extraction from ASX (https://www.asxenergy.com.au/futures_nz) website into my database by writing a web scraping python script and deploying it in Azure Databrick. Currently, the script I have is working in Visual Studio Code, but when I try to run it in databrick, it crashes…
How to get json text by request with header details?
I would like to go to page https://losoviny.iamroot.eu/part_one and write json text from there. End at first I must login in https://losoviny.iamroot.eu/part_one_login and use details in header. But if If I run code I see: raise JSONDecodeError(“Expecting value”, s, err.value) from None json.decod…
How to get HTML changes after pressing button with Beautiful Soup and Requests
I want to get the HTML this site https://www.forebet.com/en/football-predictions after pressing the button More[+] enough times to load all games. Each time the button More[+] on the bottom of the page the HTML changes and shows more football games. How do I get the request to the page with all the football g…
Python scraping – subtract class?
I am new to python and programming and scraping. I would like to subtract one html tag from another: in “game_elements” there are all matches including lives, in “game_elements_live” there are only lives. In your opinion is it possible to only have non-live matches? I use requests and …