wikiloc.com
robots.txt
Robots Exclusion Standard data for wikiloc.com
Resource Scan
Scan Details
Site Domain | wikiloc.com |
Base Domain | wikiloc.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-09-12T08:21:20+00:00 |
Next Scan | 2024-10-12T08:21:20+00:00 |
Last Successful Scan
Scanned | 2024-08-13T21:13:57+00:00 |
URL | https://wikiloc.com/robots.txt |
Redirect | https://www.wikiloc.com/robots.txt |
Redirect Domain | www.wikiloc.com |
Redirect Base | wikiloc.com |
Domain IPs | 104.18.18.124, 104.18.19.124, 2606:4700::6812:127c, 2606:4700::6812:137c |
Redirect IPs | 104.18.18.124, 104.18.19.124, 2606:4700::6812:127c, 2606:4700::6812:137c |
Response IP | 104.18.18.124 |
Found | Yes |
Hash | f204f4172e49c4e54a13279ce11ee7859ac04416072b57337adcb7e8008b218a |
SimHash | 419e8852a390 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /*_full.jpg$ |
Disallow | /wikiloc/companionRequest.do |
Disallow | /wikiloc/tr.do |
Disallow | /wikiloc/map.do |
Disallow | /wikiloc/geocode.do |
Disallow | /cdn-cgi/ |
Disallow | /wikiloc/login.do |
Disallow | /wikiloc/signingup.do |
Other Records
Field | Value |
---|---|
sitemap | https://www.wikiloc.com/sitemap.xml |