org.archive.crawler.util
Class MemUriUniqFilter

java.lang.Object
  org.archive.crawler.util.SetBasedUriUniqFilter
      org.archive.crawler.util.MemUriUniqFilter

All Implemented Interfaces:

UriUniqFilter

public class MemUriUniqFilter
extends SetBasedUriUniqFilter

A purely in-memory UriUniqFilter based on a HashSet, which remembers every full URI string it sees.

Author:

gojomo

Nested Class Summary

Nested classes/interfaces inherited from interface org.archive.crawler.datamodel.UriUniqFilter

UriUniqFilter.HasUriReceiver

Field Summary

(package private) java.util.HashSet<java.lang.CharSequence>

hashSet

Fields inherited from class org.archive.crawler.util.SetBasedUriUniqFilter

duplicateCount, duplicatesAtLastSample, profileLog, receiver

Constructor Summary

MemUriUniqFilter()

Method Summary

protected void	createUriSet()
protected boolean	setAdd(java.lang.CharSequence uri)
protected long	setCount()
protected boolean	setRemove(java.lang.CharSequence uri)

Methods inherited from class org.archive.crawler.util.SetBasedUriUniqFilter

add, addForce, addNow, close, count, forget, note, pending, profileLog, requestFlush, setDestination, setProfileLog

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

hashSet

java.util.HashSet<java.lang.CharSequence> hashSet

Constructor Detail

MemUriUniqFilter

public MemUriUniqFilter()

Method Detail

setAdd

protected boolean setAdd(java.lang.CharSequence uri)

Specified by:

setAdd in class SetBasedUriUniqFilter

setRemove

protected boolean setRemove(java.lang.CharSequence uri)

Specified by:

setRemove in class SetBasedUriUniqFilter

setCount

protected long setCount()

Specified by:

setCount in class SetBasedUriUniqFilter

createUriSet

protected void createUriSet()