Search Shelf

Trial. A test of how a curated site works, not a finished site. An AI assistant chose these videos from their titles and descriptions, and nobody has watched them. What this means

Teaching or conference talk · for advanced

IR Lecture 10: Crawlers

Venkatesh Vinayakarao 58 min Published Oct 2020

This video is about 6 years old. Search advice changes quickly, so check this against current guidance.

What it covers

Covers how web crawlers work, the challenges of crawling, and a brief overview of the Nutch crawler.

Watch for: Academic lecture, not SEO advice

Why it is here

A university-style lecture on how web crawlers work and what makes crawling hard, with a brief look at the open source crawler Nutch. Theory rather than SEO advice.

Selected by an AI assistant, from the title and description only.

On the same topics