mapmywalk.com
robots.txt

Robots Exclusion Standard data for mapmywalk.com

Resource Scan

Scan Details

Site Domain mapmywalk.com
Base Domain mapmywalk.com
Scan Status Ok
Last Scan2024-09-20T06:01:43+00:00
Next Scan 2024-09-27T06:01:43+00:00

Last Scan

Scanned2024-09-20T06:01:43+00:00
URL https://mapmywalk.com/robots.txt
Redirect https://www.mapmywalk.com/robots.txt
Redirect Domain www.mapmywalk.com
Redirect Base mapmywalk.com
Domain IPs 2600:9000:2755:3000:5:a672:9b40:93a1, 2600:9000:2755:4400:5:a672:9b40:93a1, 2600:9000:2755:7000:5:a672:9b40:93a1, 2600:9000:2755:7800:5:a672:9b40:93a1, 2600:9000:2755:a400:5:a672:9b40:93a1, 2600:9000:2755:b000:5:a672:9b40:93a1, 2600:9000:2755:c600:5:a672:9b40:93a1, 2600:9000:2755:e800:5:a672:9b40:93a1, 54.192.18.105, 54.192.18.109, 54.192.18.27, 54.192.18.47
Redirect IPs 108.156.133.108, 108.156.133.115, 108.156.133.15, 108.156.133.49, 2600:9000:2755:2a00:5:a672:9b40:93a1, 2600:9000:2755:3a00:5:a672:9b40:93a1, 2600:9000:2755:3c00:5:a672:9b40:93a1, 2600:9000:2755:7000:5:a672:9b40:93a1, 2600:9000:2755:7400:5:a672:9b40:93a1, 2600:9000:2755:800:5:a672:9b40:93a1, 2600:9000:2755:8c00:5:a672:9b40:93a1, 2600:9000:2755:d600:5:a672:9b40:93a1
Response IP 108.156.133.108
Found Yes
Hash 1fd2409449629ab30edede52f46f9d68fd54d7ff07ef0436861554c3bebd9902
SimHash 28373a24a095

Groups

*

Rule Path
Disallow /admin/
Disallow /routes/view/
Disallow /routes/my_routes/
Disallow /workout/
Disallow /workouts/

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 100

bing

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap /sitemap.xml