msnbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
40 |
bingbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
40 |
msnbot/bingbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
40 |
msnbot-media
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
40 |
msnbot-products
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
40 |
msnbot-media/1.0 (+http://search.msn.com/msnbot.htm)
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
40 |
msnbot/0.11 (+http://search.msn.com/msnbot.htm)
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
40 |
msnbot/0.5 (+http://search.msn.com/msnbot.htm)
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
40 |
msnbot/0.9 (+http://search.msn.com/msnbot.htm)
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
40 |
msnbot/1.0 (+http://search.msn.com/msnbot.htm)
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
40 |
msnbot-media/1.1 (+http://search.msn.com/msnbot.htm)
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
40 |
msnbot/1.1 (+http://search.msn.com/msnbot.htm)
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
40 |
msnbot/2.0b (+http://search.msn.com/msnbot.htm)
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
40 |