*
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
pinterestbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
1 |
pinterestbot/1.0
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
1 |
pinterest/0.2 (+https://www.pinterest.com/bot.html)
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
1 |
mozilla/5.0 (compatible; pinterestbot/1.0; +https://www.pinterest.com/bot.html)
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
1 |
mozilla/5.0 (linux; android 6.0.1; nexus 5x build/mmb29p) applewebkit/537.36 (khtml, like gecko) chrome/41.0.2272.96 mobile safari/537.36 (compatible; pinterestbot/1.0; +https://www.pinterest.com/bot.html)
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
1 |