cmafh.com
robots.txt

Robots Exclusion Standard data for cmafh.com

Resource Scan

Scan Details

Site Domain cmafh.com
Base Domain cmafh.com
Scan Status Ok
Last Scan2024-09-23T10:58:17+00:00
Next Scan 2024-10-23T10:58:17+00:00

Last Scan

Scanned2024-09-23T10:58:17+00:00
URL https://cmafh.com/robots.txt
Domain IPs 206.246.207.36
Response IP 206.246.207.36
Found Yes
Hash 1f82271469295df277752f4f5000fbe90a5ea5531bd03b5b1aa719024003bd7f
SimHash 2828d311d2b5

Groups

*

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 600

googlebot
googlebot-image
mediapartners-google
msnbot
msnbot-media
slurp
yahoo-blogs
yahoo-mmcrawler

Rule Path
Disallow /EmployeeResources.aspx
Disallow /WebsiteCatalogs/VendorCatalogs/
Disallow /Websitecatalogs/MarketingFolder/
Disallow /getprices.aspx
Disallow /getcartsummary.aspx
Disallow /Checkout.aspx
Disallow /Confirmation.aspx
Disallow /PrintConfirmation.aspx
Disallow /ShoppingCart.aspx

Other Records

Field Value
sitemap https://cmafh.com/sitemap.xml

Comments

  • disallow all
  • but allow only important bots