diversifiedindustries.com
robots.txt

Robots Exclusion Standard data for diversifiedindustries.com

Resource Scan

Scan Details

Site Domain diversifiedindustries.com
Base Domain diversifiedindustries.com
Scan Status Ok
Last Scan2026-01-22T23:21:11+00:00
Next Scan 2026-02-21T23:21:11+00:00

Last Scan

Scanned2026-01-22T23:21:11+00:00
URL https://diversifiedindustries.com/robots.txt
Domain IPs 104.21.60.156, 172.67.198.2, 2606:4700:3033::ac43:c602, 2606:4700:3034::6815:3c9c
Response IP 172.67.198.2
Found Yes
Hash d87f192419f97b6dc8e56199f5b741336a3993155937d72449c528c70637e054
SimHash e500dc74c993

Groups

*

Rule Path
Allow
Disallow

Other Records

Field Value
sitemap https://diversifiedindustries.com/wp-sitemap.xml
sitemap https://diversifiedindustries.com/wp-sitemap-posts-page-1.xml

Comments

  • Crawl-delay: 15