locanto.de
robots.txt
Robots Exclusion Standard data for locanto.de
Resource Scan
Scan Details
Site Domain | locanto.de |
Base Domain | locanto.de |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-11-06T11:32:34+00:00 |
Next Scan | 2024-11-20T11:32:34+00:00 |
Last Successful Scan
Scanned | 2022-11-10T20:48:56+00:00 |
URL | https://locanto.de/robots.txt |
Response IP | 104.18.5.153, 104.18.4.153 |
Found | Yes |
Hash | ae870f782a93e25ec24e26ec346561ea1f7201fdf451c52eb2598ad84364af60 |
SimHash | 6b9a43f3cfe3 |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /asclick/ |
Disallow | /post_G1/ |
Disallow | /register_G2/ |
Disallow | /afs_click/ |
Disallow | /run/faq/ |
Disallow | /m/run/faq/ |
Disallow | /my/ |
Disallow | /m/my/ |
Disallow | /*index.rss$ |
Disallow | /images/sprites/ |
Disallow | /images/bg/ |
Disallow | /images/16/ |
Disallow | /images/32/ |
Disallow | /images/48/ |
Disallow | /images/64/ |
Disallow | /images/100/ |
Disallow | /images/128/ |
Disallow | /images/256/ |
Disallow | /images/share/ |
Disallow | /manage/ |
Disallow | /*/manage/ |
msnbot
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /asclick/ |
Disallow | /post_G1/ |
Disallow | /register_G2/ |
Disallow | /afs_click/ |
Disallow | /api/ |
Disallow | /run/faq/ |
Disallow | /m/run/faq/ |
Disallow | /my/ |
Disallow | /m/my/ |
Disallow | /images/sprites/ |
Disallow | /images/bg/ |
Disallow | /images/16/ |
Disallow | /images/32/ |
Disallow | /images/48/ |
Disallow | /images/64/ |
Disallow | /images/100/ |
Disallow | /images/128/ |
Disallow | /images/256/ |
Disallow | /images/share/ |
Disallow | /manage/ |
Disallow | /*/manage/ |
Other Records
Field | Value |
---|---|
crawl-delay | 60 |
bingbot
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /asclick/ |
Disallow | /post_G1/ |
Disallow | /register_G2/ |
Disallow | /afs_click/ |
Disallow | /api/ |
Disallow | /run/faq/ |
Disallow | /m/run/faq/ |
Disallow | /my/ |
Disallow | /m/my/ |
Disallow | /*index.rss$ |
Disallow | /images/sprites/ |
Disallow | /images/bg/ |
Disallow | /images/16/ |
Disallow | /images/32/ |
Disallow | /images/48/ |
Disallow | /images/64/ |
Disallow | /images/100/ |
Disallow | /images/128/ |
Disallow | /images/256/ |
Disallow | /images/share/ |
Disallow | /manage/ |
Disallow | /*/manage/ |
Other Records
Field | Value |
---|---|
crawl-delay | 60 |
slurp
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /asclick/ |
Disallow | /post_G1/ |
Disallow | /register_G2/ |
Disallow | /afs_click/ |
Disallow | /api/ |
Disallow | /run/faq/ |
Disallow | /m/run/faq/ |
Disallow | /my/ |
Disallow | /m/my/ |
Disallow | /*index.rss$ |
Disallow | /images/sprites/ |
Disallow | /images/bg/ |
Disallow | /images/16/ |
Disallow | /images/32/ |
Disallow | /images/48/ |
Disallow | /images/64/ |
Disallow | /images/100/ |
Disallow | /images/128/ |
Disallow | /images/256/ |
Disallow | /images/share/ |
Disallow | /manage/ |
Disallow | /*/manage/ |
Other Records
Field | Value |
---|---|
crawl-delay | 60 |
Warnings
- 2 invalid lines.
Comments