org.archive.crawler.frontier
Class WagCostAssignmentPolicy

java.lang.Object
  extended by org.archive.crawler.frontier.CostAssignmentPolicy
      extended by org.archive.crawler.frontier.WagCostAssignmentPolicy

public class WagCostAssignmentPolicy
extends CostAssignmentPolicy

A CostAssignmentPolicy based on some wild guesses of kinds of URIs that should be deferred into the (potentially never-crawled) future.

Author:
gojomo

Constructor Summary
WagCostAssignmentPolicy()
           
 
Method Summary
 int costOf(CrawlURI curi)
          Add constant penalties for certain features of URI (and its 'via') that make it more delayable/skippable.
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Constructor Detail

WagCostAssignmentPolicy

public WagCostAssignmentPolicy()
Method Detail

costOf

public int costOf(CrawlURI curi)
Add constant penalties for certain features of URI (and its 'via') that make it more delayable/skippable.

Specified by:
costOf in class CostAssignmentPolicy
Parameters:
curi - CrawlURI to be assigned a cost
See Also:
CostAssignmentPolicy.costOf(org.archive.crawler.datamodel.CrawlURI)


Copyright © 2003-2011 Internet Archive. All Rights Reserved.