org.niocchi.urlpools
Class SimpleListURLPool
java.lang.Object
org.niocchi.urlpools.SimpleListURLPool
- All Implemented Interfaces:
- URLPool
public class SimpleListURLPool
- extends java.lang.Object
- implements URLPool
A simple URL Pool that iterates over a list of URLS.
Methods inherited from class java.lang.Object |
equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
SimpleListURLPool
public SimpleListURLPool(java.util.Iterator<java.lang.String> list)
SimpleListURLPool
public SimpleListURLPool(java.lang.Iterable<java.lang.String> list)
hasNextQuery
public boolean hasNextQuery()
- Specified by:
hasNextQuery
in interface URLPool
- Returns:
- true if there is at least one query to crawl (i.e.
getNextQuery will return a query at some point), false
if no more queries to crawl (a call to getNextQuery
will throw an URLPoolException).
setProcessed
public void setProcessed(Query resource_)
- Description copied from interface:
URLPool
- This method is called by the crawler when the query has been
processed. That gives the oportunity to the url pool to
implement specific behaviors (for instance, send back the query
to the crawler if it got a timeout.
- Specified by:
setProcessed
in interface URLPool
getNextQuery
public Query getNextQuery()
throws URLPoolException
- Specified by:
getNextQuery
in interface URLPool
- Returns:
- null if no query is yet available, otherwise return a
Query. Throws URLPoolException is no query will be
available (a call to hasNextQuery() must returns
false).
- Throws:
URLPoolException