Concurrency for requests

I have a python script and I’m sending post requests to same url with different data(different ids). I have to send requests for each id and check them continuously to see if there is a change. I’m …

How to parse a list of dictionaries in Python 3

I’m using python(requests) to query an API. The JSON response is list of dictionaries, like below: locationDescriptions = timeseries.publish.get(‘/GetLocationDescriptionList’)[‘LocationDescriptions’]…

Python beautiful soup get only body content without header or footer data [closed]

In my code I need to get only the main text not the header or footer data. I also would like to filter out any html/css/js code that is received with the request. How would I do this? I have tried …

Send settings to clickhouse via http protocol using requests

Via clickhouse-client code looks like this: clickhouse-client –input_format_allow_errors_num=1 –input_format_allow_errors_ratio=0.1 –query=”INSERT INTO db.table VALUES (…, …., …) FORMAT …

Scraping search results off of Sportchek with Beautiful Soup 4 to find prices

So I’m trying to web scrape search results from Sportchek with BS4, specifically this link “https://www.sportchek.ca/categories/men/footwear/basketball-shoes.html?page=1”. I want to get the …

Better way of capturing multiple same tags?

I’m trying to create an scraper which scrapes download links, I want to use regex but that would be a nightmare for me to do, I’ve found this library which is called BeautifulSoup, I’m trying to …

HTTPS POST to query FastAPI using python requests

I am trying to serve a Neural Network using FastAPI. from fastapi import Depends, FastAPI from pydantic import BaseModel from typing import Dict class iRequest(BaseModel): arg1: str arg2: str …

printing same name, price,and link in BeautifulSoup python

How to Get all Product detail it prints the same things but I want others products to detail also here is the link from where I want to fetch the data of all product:https://www.nike.com/gb/w/womens-…

Extract data from Json: Error JSONDecodeError: Expecting value

import json import requests from bs4 import BeautifulSoup url = ‘https://play.google.com/store/apps/details?id=shooter.online.warplanes&hl=en’ data = requests.get(url) soup = BeautifulSoup(data….

Export results to excel file title and link requests python [closed]

I am training on how to scrape some data in python and here’s my try: import requests from bs4 import BeautifulSoup url = ‘https://learndataanalysis.org/python-tutorial/page/10’ r = requests.get(url) …