Class
Robots
In:
lib/robots.rb
Parent:
Object
Methods
allowed?
get_robots_txt
new
other_values
timeout
timeout=
Classes and Modules
Class
Robots::ParsedRobots
Constants
DEFAULT_TIMEOUT
=
3
Public Class methods
get_robots_txt
(uri, user_agent)
new
(user_agent)
timeout
()
timeout=
(t)
Public Instance methods
allowed?
(uri)
other_values
(uri)
[Validate]