montransport.com
robots.txt

Robots Exclusion Standard data for montransport.com

Resource Scan

Scan Details

Site Domain montransport.com
Base Domain montransport.com
Scan Status Ok
Last Scan2025-04-11T10:51:19+00:00
Next Scan 2025-04-18T10:51:19+00:00

Last Scan

Scanned2025-04-11T10:51:19+00:00
URL https://montransport.com/robots.txt
Domain IPs 104.26.0.42, 104.26.1.42, 172.67.68.209, 2606:4700:20::681a:12a, 2606:4700:20::681a:2a, 2606:4700:20::ac43:44d1
Response IP 104.26.1.42
Found Yes
Hash 42955f728987e816f18b8eeaa2c7ece323ff64b954afa850737f228e7e486ebb
SimHash c20e8c32aab3

Groups

*

Rule Path
Disallow /fb_channel.php
Disallow /*?r=

Other Records

Field Value
crawl-delay 3

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

metasr

Rule Path
Disallow /

mozilla/4.0

Rule Path
Disallow /

Other Records

Field Value
sitemap https://montransport.com/sitemap.xml