Log In Sign Up

parisbyshuttle.com
robots.txt

Robots Exclusion Standard data for parisbyshuttle.com

Resource Scan

Scan Details

Site Domain parisbyshuttle.com
Base Domain parisbyshuttle.com
Scan Status Ok
Last Scan2025-07-26T01:45:32+00:00
Next Scan 2025-08-25T01:45:32+00:00

Last Scan

Scanned2025-07-26T01:45:32+00:00
URL https://parisbyshuttle.com/robots.txt
Domain IPs 57.128.52.5
Response IP 57.128.52.5
Found Yes
Hash 3a2fc0690c3a4b2cc71eb5cec6a74bb1e7b80ef3b25f8bdf3fdec00b623cd740
SimHash 933c5d237e0b

Groups

a6-indexer

Rule Path
Disallow /

a6-indexer/1.0

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mauibot (crawler.feedback+wc@gmail.com)

Rule Path
Disallow /
Disallow /

ntentbot-fetch

Rule Path
Disallow /

ntentbot-news

Rule Path
Disallow /

proximic

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

synthesio crawler release monalisa

Rule Path
Disallow /

the knowledge ai

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

wesee

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /
Back to top

Warnings

  • `user-agnet` is not a known field.
Back to top