na.daycoaftermarket.com
robots.txt

Robots Exclusion Standard data for na.daycoaftermarket.com

Resource Scan

Scan Details

Site Domain na.daycoaftermarket.com
Base Domain daycoaftermarket.com
Scan Status Ok
Last Scan2024-05-18T04:05:03+00:00
Next Scan 2024-06-17T04:05:03+00:00

Last Scan

Scanned2024-05-18T04:05:03+00:00
URL https://na.daycoaftermarket.com/robots.txt
Domain IPs 172.66.40.137, 172.66.43.119
Response IP 172.66.43.119
Found Yes
Hash 6d101f0511f2be74214676e310fd3eb95490b9e4d45297c00de2769fd364d028
SimHash 2a381c2bc7f5

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /trackback/
Disallow /feed/
Disallow */trackback/
Disallow */feed/
Disallow /cdn-cgi/
Disallow *?s=

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://na.daycoaftermarket.com/sitemap_index.xml

Comments

  • robots.txt for https://na.daycoaftermarket.com/
  • Every bot that might possibly read and respect this file
  • Wait 1 second between successive requests
  • Independent of user agent. Links in the sitemap are full URLs using https:// and need to match the protocol of the sitemap