What a robots.txt check decided about one URL.
Optional
Why, when the answer was not a plain yes — for the operator, once per host.
True when the rules said no and --ignore-robots said fetch anyway.
--ignore-robots
What a robots.txt check decided about one URL.