powermapper
| Rule |
Path |
| Disallow |
/error-404 |
| Disallow |
/digital-catalog* |
| Disallow |
/customer/digital-catalog.html* |
*
| Rule |
Path |
| Disallow |
/products/add_products.aspx |
| Disallow |
/landing_page/* |
| Disallow |
/includes/blank.html |
| Disallow |
/ftb_photo_upload.aspx |
| Disallow |
/includes/downloads/* |
| Disallow |
/products/search/* |
| Disallow |
/images/media_room/* |
| Disallow |
/email/* |
mj12bot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
5 |
blexbox
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
5 |
petalbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
5 |
zoominfobot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
5 |
webcrawlmeup
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
5 |
petalbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
bingbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
facebookexternalhit/1.1
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
googlebot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
ahrefsbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
applebot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
adsbot-google
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
yandexbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
seznambot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
zoominfobot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
slackbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
claudebot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
pinterestbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
amazonbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
yandexrenderresourcebot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
com/bot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
semrushbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
awariobot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
bitsightbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
coccocbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
dataforseobot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
discordbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
duckduckbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
googlebot-image
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
googlebot-news
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
googlebot-video
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
gptbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
info/bot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
mail.ru_bot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
mj12bot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
orbbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
mojeekbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
pubmatic crawler bot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
seekportbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
slackbot-linkexpanding
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
snap url preview service; bot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
storebot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
surdotlybot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
Comments