Teaching or conference talk
IR Lecture 10: Crawlers
Covers how web crawlers work, the challenges of crawling, and a brief overview of the Nutch crawler.
Older: check current guidanceChannel
3 chosen videos. Channel on YouTube
Teaching or conference talk
Covers how web crawlers work, the challenges of crawling, and a brief overview of the Nutch crawler.
Older: check current guidanceTeaching or conference talk
Gives a brief summary of web crawling challenges such as politeness, freshness, coverage, scale and avoiding traps.
Older: check current guidanceTeaching or conference talk
Covers two models of page popularity, PageRank with its random surfer model and HITS, in a course lecture.
Older: check current guidance