Uses of Class
org.archive.crawler.datamodel.RobotsDirectives

Packages that use RobotsDirectives

org.archive.crawler.datamodel

Uses of RobotsDirectives in org.archive.crawler.datamodel

Fields in org.archive.crawler.datamodel declared as RobotsDirectives

(package private) static RobotsDirectives

Robotstxt.NO_DIRECTIVES

Fields in org.archive.crawler.datamodel with type parameters of type RobotsDirectives

(package private) java.util.Map<java.lang.String,RobotsDirectives>

Robotstxt.agentsToDirectives

Methods in org.archive.crawler.datamodel that return RobotsDirectives

RobotsDirectives

Robotstxt.getDirectivesFor(java.lang.String ua)