|
||||||||||
| PREV NEXT | FRAMES NO FRAMES | |||||||||
| Packages that use CrawlMapper | |
|---|---|
| org.archive.crawler.processor | |
| Uses of CrawlMapper in org.archive.crawler.processor |
|---|
| Subclasses of CrawlMapper in org.archive.crawler.processor | |
|---|---|
class |
HashCrawlMapper
Maps URIs to one of N crawler names by applying a hash to the URI's (possibly-transformed) classKey. |
class |
LexicalCrawlMapper
A simple crawl splitter/mapper, dividing up CandidateURIs/CrawlURIs between crawlers by diverting some range of URIs to local log files (which can then be imported to other crawlers). |
|
||||||||||
| PREV NEXT | FRAMES NO FRAMES | |||||||||