Uses of Interface
org.archive.crawler.datamodel.UriUniqFilter

Packages that use UriUniqFilter

org.archive.crawler.frontier
org.archive.crawler.util

Uses of UriUniqFilter in org.archive.crawler.frontier

Fields in org.archive.crawler.frontier declared as UriUniqFilter

protected UriUniqFilter

WorkQueueFrontier.alreadyIncluded those UURIs which are already in-process (or processed), and thus should not be rescheduled

Methods in org.archive.crawler.frontier that return UriUniqFilter

protected abstract UriUniqFilter	WorkQueueFrontier.createAlreadyIncluded() Create a UriUniqFilter that will serve as record of already seen URIs.
protected UriUniqFilter	BdbFrontier.createAlreadyIncluded() Create a UriUniqFilter that will serve as record of already seen URIs.
protected UriUniqFilter	AdaptiveRevisitFrontier.createAlreadyIncluded() Create a UriUniqFilter that will serve as record of already seen URIs.
protected UriUniqFilter	BdbFrontier.deserializeAlreadySeen(java.lang.Class<? extends UriUniqFilter> cls, java.io.File dir)

Method parameters in org.archive.crawler.frontier with type arguments of type UriUniqFilter

protected UriUniqFilter

BdbFrontier.deserializeAlreadySeen(java.lang.Class<? extends UriUniqFilter> cls, java.io.File dir)

Uses of UriUniqFilter in org.archive.crawler.util

Classes in org.archive.crawler.util that implement UriUniqFilter

class	BdbUriUniqFilter A BDB implementation of an AlreadySeen list.
class	BloomUriUniqFilter A MG4J BloomFilter-based implementation of an AlreadySeen list.
class	DiskFPMergeUriUniqFilter Crude FPMergeUriUniqFilter using a disk data file of raw longs as the overall FP record.
class	FPMergeUriUniqFilter UriUniqFilter based on merging FP arrays (in memory or from disk).
class	FPUriUniqFilter UriUniqFilter storing 64-bit UURI fingerprints, using an internal LongFPSet instance.
class	MemFPMergeUriUniqFilter Crude all-in-memory FP-merging UriUniqFilter.
class	MemUriUniqFilter A purely in-memory UriUniqFilter based on a HashSet, which remembers every full URI string it sees.
class	NoopUriUniqFilter A UriUniqFilter that doesn't actually provide any uniqueness filter on presented items: all are passed through.
class	SetBasedUriUniqFilter UriUniqFilter based on an underlying UriSet (essentially a Set).