laplascale.com
robots.txt
Robots Exclusion Standard data for laplascale.com
Resource Scan
Scan Details
Site Domain | laplascale.com |
Base Domain | laplascale.com |
Scan Status | Ok |
Last Scan | 2024-11-16T07:33:58+00:00 |
Next Scan | 2024-11-23T07:33:58+00:00 |
Last Scan
Scanned | 2024-11-16T07:33:58+00:00 |
URL | https://www.laplascale.com/robots.txt |
Domain IPs | 34.95.104.186 |
Response IP | 34.95.104.186 |
Found | Yes |
Hash | 1fea71b14ce1495138ccc4925b849331b405fd7ae68412ea5a6c05c33e50dfb5 |
SimHash | 2a144cf3e2a8 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /*/guest/ |
Disallow | */privacy |
Disallow | */privacy_locale |
Disallow | */about_us |
Disallow | */terms_of_use |
Disallow | /report |
Disallow | /puma_status* |
yandex
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 5 |
crawl-delay | 5 |
crawl-delay | 5 |
baiduspider
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 5 |
crawl-delay | 5 |
crawl-delay | 5 |
teoma
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 5 |
crawl-delay | 5 |
crawl-delay | 5 |
yetibot
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 5 |
crawl-delay | 5 |
crawl-delay | 5 |
Comments