Founded by three search-engine veterans, Jybe is combining mobile, social, and search-engine technologies to connect people to the physical world around them. Learn more about Jybe.
User Agent
Politeness and Tobots.txt Directives
Tips
Jybebot IPs
Our useragent is Jybebot. This should be indicated clearly in your server access logs, and should also include a URL to reach this page.
It is possible that other bots are masquerading as us. Please see our IP list(link) to see where Jybebot runs from.
TOPWe scrupulously respect the Robots Exclusion Standard If there are directories/pages on your sites that you would like to exclude from spidering, please add Disallow directives for those paths.
In addition we also respect the Yahoo Slurp extension Crawl-delay directive. If you see us spidering you too quickly, please increase the crawl-delay. In most cases, this will never be required.
You may add a Crawl-delay: x.y" directive, where "x.y" is a gap between successive bot accesses. This maps approximately to the number of seconds between accesses to your site.
This number ranges from 0 to 10. Please start with a small number like 0.5 and increase as appropriate.
An example:
User-agent: *
Crawl-delay: 0.5