Ask Your Question
0

When using selenium for web scraping, when can detection occur?

asked 2023-04-30 23:52:40 +0000

djk gravatar image

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted
0

answered 2023-05-01 00:16:01 +0000

lalupa gravatar image

Detection can occur at any point during web scraping using selenium, especially if the website being scraped employs anti-scraping measures. The detection can occur during the initialization of the driver, navigating to web pages, scraping the data, or at any other point during the process. Websites can use various techniques such as Captchas, HTTP request analysis, or JavaScript evaluation to detect and block scraping activities. However, there are ways to minimize the risk of detection, such as using user agents, rotating IP addresses, and incorporating breaks into the scraping process.

edit flag offensive delete link more

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account. This space is reserved only for answers. If you would like to engage in a discussion, please instead post a comment under the question or an answer that you would like to discuss

Add Answer


Question Tools

Stats

Asked: 2023-04-30 23:52:40 +0000

Seen: 15 times

Last updated: May 01 '23