org.apache.nutch.protocol

Class EmptyRobotRules

java.lang.Object

org.apache.nutch.protocol.EmptyRobotRules

All Implemented Interfaces:

RobotRules

public class EmptyRobotRules
extends Object
implements RobotRules

Author:

Andrzej Bialecki <ab@getopt.org>

Field Summary

Fields

Modifier and Type	Field and Description
static RobotRules	RULES

Constructor Summary

Constructors

Constructor and Description
EmptyRobotRules()

Method Summary

Methods

Modifier and Type	Method and Description
long	getCrawlDelay() Get Crawl-Delay, in milliseconds.
long	getExpireTime() Get expire time
boolean	isAllowed(URL url) Returns false if the robots.txt file prohibits us from accessing the given url, or true otherwise.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

RULES

public static final RobotRules RULES

Constructor Detail

EmptyRobotRules

public EmptyRobotRules()

Method Detail

getCrawlDelay

public long getCrawlDelay()

Description copied from interface: RobotRules

Get Crawl-Delay, in milliseconds. This returns -1 if not set.

Specified by:

getCrawlDelay in interface RobotRules

getExpireTime

public long getExpireTime()

Description copied from interface: RobotRules

Get expire time

Specified by:

getExpireTime in interface RobotRules

isAllowed

public boolean isAllowed(URL url)

Description copied from interface: RobotRules

Returns false if the robots.txt file prohibits us from accessing the given url, or true otherwise.

Specified by:

isAllowed in interface RobotRules