digi-electronics.com
robots.txt

Robots Exclusion Standard data for digi-electronics.com

Resource Scan

Scan Details

Site Domain digi-electronics.com
Base Domain digi-electronics.com
Scan Status Ok
Last Scan2025-10-24T18:51:37+00:00
Next Scan 2025-11-23T18:51:37+00:00

Last Scan

Scanned2025-10-24T18:51:37+00:00
URL https://digi-electronics.com/robots.txt
Redirect https://www.digi-electronics.com/robots.txt
Redirect Domain www.digi-electronics.com
Redirect Base digi-electronics.com
Domain IPs 104.21.71.66, 172.67.143.184, 2606:4700:3031::ac43:8fb8, 2606:4700:3033::6815:4742
Redirect IPs 104.21.71.66, 172.67.143.184, 2606:4700:3031::ac43:8fb8, 2606:4700:3033::6815:4742
Response IP 104.21.71.66
Found Yes
Hash 275822f23dc6c8999ddc18970aca797ed9542c30e88a0069a41a4be515d7fada
SimHash c3148d00ae12

Groups

*

Rule Path
Disallow /cdn-cgi/*
Disallow /user/*

amazonbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.digi-electronics.com/blogs/sitemap.xml
sitemap https://www.digi-electronics.com/product/sitemap.xml
sitemap https://www.digi-electronics.com/video/sitemap.xml
sitemap https://www.digi-electronics.com/index/sitemap.xml

Comments

  • all crawlers
  • Amazon
  • Ahrefs
  • Moz
  • Majestic
  • PetalBot
  • Sitemaps