mc-mc.com
robots.txt

Robots Exclusion Standard data for mc-mc.com

Resource Scan

Scan Details

Site Domain mc-mc.com
Base Domain mc-mc.com
Scan Status Ok
Last Scan2025-09-16T21:11:09+00:00
Next Scan 2025-10-16T21:11:09+00:00

Last Scan

Scanned2025-09-16T21:11:09+00:00
URL https://mc-mc.com/robots.txt
Redirect https://www.mc-mc.com/robots.txt
Redirect Domain www.mc-mc.com
Redirect Base mc-mc.com
Domain IPs 52.3.163.37
Redirect IPs 104.18.33.131, 172.64.154.125, 2a06:98c1:3103::6812:2183, 2a06:98c1:310b::ac40:9a7d
Response IP 172.64.154.125
Found Yes
Hash 2f3df0578774fdff42c87dfe36c5ac17ec14f6a4c23e82e2714807d35fd1a7b6
SimHash 47405c60427f

Groups

*

Rule Path
Disallow */Checkout*
Disallow */Search?query*
Disallow */userfiles/*
Disallow */MyAccount/*
Disallow */MyAccount
Disallow */Cart
Disallow */Rfq
Allow /LocationFinder/DealerDetails?id*
Disallow *%26attributeValueIds*
Disallow /VendorTools*
Disallow /jefferson-north-trailer

rogerbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3

Other Records

Field Value
sitemap https://www.mc-mc.com/sitemapindex.xml