What does it mean when proxies are marked as 'dead' in a Scrapy spider?

asked 2022-01-09 11:00:00 +0000

ladyg
21 ●1 ●2

edit retag flag offensive close merge delete

add a comment

1 Answer

Sort by » oldest newest most voted

answered 2022-06-03 22:00:00 +0000

djk
21 ●1 ●1

When proxies are marked as 'dead' in a Scrapy spider, it means that the proxies are no longer working or responding to requests. This could be due to different reasons, such as the proxy server being overloaded, blocked, or offline. Scrapy spiders use proxies to access websites anonymously or bypass geographical restrictions, and when a proxy is marked as 'dead,' the spider cannot use it anymore and will switch to a different proxy if available.

edit flag offensive delete link

add a comment

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account. This space is reserved only for answers. If you would like to engage in a discussion, please instead post a comment under the question or an answer that you would like to discuss

Add Answer

Question Tools

Stats

Asked: 2022-01-09 11:00:00 +0000

Seen: 11 times

Last updated: Jun 03 '22

What does it mean when proxies are marked as 'dead' in a Scrapy spider? edit

1 Answer