humanitrail.com
robots.txt

Robots Exclusion Standard data for humanitrail.com

Resource Scan

Scan Details

Site Domain humanitrail.com
Base Domain humanitrail.com
Scan Status Ok
Last Scan2025-10-08T15:18:31+00:00
Next Scan 2025-11-07T15:18:31+00:00

Last Scan

Scanned2025-10-08T15:18:31+00:00
URL https://humanitrail.com/robots.txt
Redirect https://www.humanitrail.com/robots.txt
Redirect Domain www.humanitrail.com
Redirect Base humanitrail.com
Domain IPs 199.34.228.79
Redirect IPs 199.34.228.79
Response IP 199.34.228.79
Found Yes
Hash 7d7e11de44ad23f98bbfad41c76db29ae0d354afcc16bf02ec6176710b423a17
SimHash 0a44dd20e683

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/
Disallow /https%3A//drive.google.com/file/d/1AhRCUqpt15N9gx3FYEcZ4_VO66QGsBuV/view?usp=sharing
Disallow /https%3A//drive.google.com/file/d/1AhRCUqpt15N9gx3FYEcZ4_VO66QGsBuV/view?usp=sharing
Disallow /https%3A//drive.google.com/file/d/1AhRCUqpt15N9gx3FYEcZ4_VO66QGsBuV/view?usp=sharing
Disallow /preacutesentation.html
Disallow /praumlsentation.html
Disallow /presentation.html
Disallow /parcours.html
Disallow /die-rennen.html
Disallow /races.html
Disallow /pratique.html
Disallow /info.html
Disallow /information.html

Other Records

Field Value
sitemap https://www.humanitrail.com/sitemap.xml