org.apache.nutch.protocol
Class EmptyRobotRules
java.lang.Object
org.apache.nutch.protocol.EmptyRobotRules
- All Implemented Interfaces:
- RobotRules
public class EmptyRobotRules
- extends Object
- implements RobotRules
- Author:
- Andrzej Bialecki <ab@getopt.org>
Method Summary |
long |
getCrawlDelay()
Get Crawl-Delay, in milliseconds. |
long |
getExpireTime()
Get expire time |
boolean |
isAllowed(URL url)
Returns false if the robots.txt file
prohibits us from accessing the given url , or
true otherwise. |
Methods inherited from class java.lang.Object |
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
RULES
public static final RobotRules RULES
EmptyRobotRules
public EmptyRobotRules()
getCrawlDelay
public long getCrawlDelay()
- Description copied from interface:
RobotRules
- Get Crawl-Delay, in milliseconds. This returns -1 if not set.
- Specified by:
getCrawlDelay
in interface RobotRules
getExpireTime
public long getExpireTime()
- Description copied from interface:
RobotRules
- Get expire time
- Specified by:
getExpireTime
in interface RobotRules
isAllowed
public boolean isAllowed(URL url)
- Description copied from interface:
RobotRules
- Returns
false
if the robots.txt
file
prohibits us from accessing the given url
, or
true
otherwise.
- Specified by:
isAllowed
in interface RobotRules
Copyright © 2007, 2012, Oracle and/or its affiliates. All rights reserved.