Learn how to crawl efficiently during our webinar!
Rewatch our webinar with some of our experts to learn how to crawl like an expert!
Conference
Crawling a website is a good way to collect information about the website and its pages at scale. However, if you’ve ever tried to crawl a website with a specific goal in mind, you’ve likely discovered that getting the right information for the right pages is not so straightforward. What are the different reasons to crawl a website? What modifications should you make to get the exact information you need?
In this webinar, Rebecca Berbel, Frédéric Gérard and Mickael Serantes explore how to guide your crawler to do exactly what you want. We examine different scenarios from website monitoring to crawling key pages to accessing protected sites with a crawler (without breaking any rules).
You’ll walk away confident that your next crawls will include the right pages to provide actionable solutions for your technical SEO needs.
The speakers
Rebecca Berbel
Mickael Serantes
