A few months ago I followed this Scrapy shell method to scrape a real estate listings webpage and it worked perfectly. I pulled my cookie and user-agent text from Firefox (Developer tools -> Headers) when the target URL is loaded, and I would get a successful response (200) and be able to pull items from response.xpath. For example: Now I’m
Tag: response
Scrapy : Crawled 0 pages (at 0 pages/min), scraped 0 items
I’m new to python and I’m trying to scrape a html with a scrapy spider but the response returns nothing. Wondering what’s wrong here? Thanks for any help in advance. The url: https://directory.lubesngreases.com/LngMain/includes/themes/MuraBootstrap3/remote/api/?fn=searchcompany&name&query&STATE&brand&COUNTRY&query2&mode=advanced&filters=%7B%7D&page=1&datatype=html My spider: Output: Answer I added print(‘url:’, response.url) in parse() and I see it runs this function. First problem is that you use CSS in wrong way.
Filtering the specific data for response in DRF
I have following response data But I want to remove the dictionary whose id = 10 from the response data ,how can I do that ? I have following lines of code.. In serializers.py Any help would be appreciated !! Answer What happens if you do something as following :