How To Scrapy Handle Dns Lookup Failed

I am looking to handle a DNS error when scraping domains Scrapy. Here's the error that I am seeing: ERROR: Error downloading : DNS lookup failed: addre

Solution 1:

Use errback along with callback:

Request(url, callback=your_callback, errback=your_errorback)

and errback:

defyour_errorback(self, response):
    //your logic will be here

Solution 2:

please check value of allowed_domains = ['abc.xyz.domain_name'] start_urls = ['http://abc.xyz.domain_name//'] may be in correct.