diverseelectronics.com
robots.txt

Robots Exclusion Standard data for diverseelectronics.com

Resource Scan

Scan Details

Site Domain diverseelectronics.com
Base Domain diverseelectronics.com
Scan Status Ok
Last Scan2025-10-29T07:54:29+00:00
Next Scan 2025-11-28T07:54:29+00:00

Last Scan

Scanned2025-10-29T07:54:29+00:00
URL https://diverseelectronics.com/robots.txt
Redirect https://www.diverseelectronics.com/robots.txt
Redirect Domain www.diverseelectronics.com
Redirect Base diverseelectronics.com
Domain IPs 104.21.9.73, 172.67.159.74, 2606:4700:3032::6815:949, 2606:4700:3035::ac43:9f4a
Redirect IPs 104.21.9.73, 172.67.159.74, 2606:4700:3032::6815:949, 2606:4700:3035::ac43:9f4a
Response IP 172.67.159.74
Found Yes
Hash 33b329d1f774ab9ab627ee5edc930a41e15890e8df2b0ec0f5d9d84c6f4beac7
SimHash 231d9882ea93

Groups

*

Rule Path
Disallow /myaccount/
Disallow /cart/
Disallow /Sale-Items/
Disallow /fr/myaccount/
Disallow /fr/cart/
Disallow /fr/Sale-Items/
Disallow /admin/

aranhabot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 200

mj12bot
semrushbot
semrushbot
seekportbot
bytespider
ahrefsbot
claudebot
amazonbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.diverseelectronics.com/sitemap.xml