Skip to content
Advertisement

Tag: response

Scrapy : Crawled 0 pages (at 0 pages/min), scraped 0 items

I’m new to python and I’m trying to scrape a html with a scrapy spider but the response returns nothing. Wondering what’s wrong here? Thanks for any help in advance. The url: https://directory.lubesngreases.com/LngMain/includes/themes/MuraBootstrap3/remote/api/?fn=searchcompany&name&query&STATE&brand&COUNTRY&query2&mode=advanced&filters=%7B%7D&page=1&datatype=html My spider: Output: Answer I added print(‘url:’, response.url) in parse() and I see it runs this function. First problem is that you use CSS in wrong way.

Advertisement