electronicsurplus.com
robots.txt

Robots Exclusion Standard data for electronicsurplus.com

Resource Scan

Scan Details

Site Domain electronicsurplus.com
Base Domain electronicsurplus.com
Scan Status Ok
Last Scan2025-08-26T22:07:45+00:00
Next Scan 2025-09-25T22:07:45+00:00

Last Scan

Scanned2025-08-26T22:07:45+00:00
URL https://electronicsurplus.com/robots.txt
Redirect https://www.electronicsurplus.com/robots.txt
Redirect Domain www.electronicsurplus.com
Redirect Base electronicsurplus.com
Domain IPs 104.26.10.25, 104.26.11.25, 172.67.73.228, 2606:4700:20::681a:a19, 2606:4700:20::681a:b19, 2606:4700:20::ac43:49e4
Redirect IPs 104.26.10.25, 104.26.11.25, 172.67.73.228, 2606:4700:20::681a:a19, 2606:4700:20::681a:b19, 2606:4700:20::ac43:49e4
Response IP 172.67.73.228
Found Yes
Hash 84b57e639436dd5e4fc794716d188dcc895b0c4269feacb8fa86a33a0b34abbc
SimHash 432499c1cf48

Groups

*

Rule Path
Allow /
Disallow /checkout/
Disallow /onestepcheckout/
Disallow /secure-checkout/
Disallow /catalog/
Disallow /customer/
Disallow /search/
Disallow /catalogsearch/
Disallow /app/
Disallow /bin/
Disallow /dev/
Disallow /lib/
Disallow /phpserver/
Disallow /pkginfo/
Disallow /report/
Disallow /tag/
Disallow /rewiew/
Disallow /var/
Disallow /pub/
Disallow /sales/
Disallow /sendfriend/
Disallow /wishlist/
Disallow /privacy-policy
Disallow /return-refund
Disallow /customer-service
Disallow /privacy-policy-cookie-restriction-mode
Disallow /*?dir*
Disallow /*?dir=desc
Disallow /*?dir=asc
Disallow /*?limit=all
Disallow /*?mode*
Disallow /*.php$
Disallow /*SID%3D
Disallow /*?manufacturer*
Disallow /*manufacturer*
Disallow /index.php/
Disallow /*?*
Allow /*?p=
Allow /*?utm_*

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Allow /
Disallow /admin/
Disallow /checkout/
Disallow /customer/

bingbot

Rule Path
Allow /
Disallow /admin/
Disallow /checkout/
Disallow /customer/

amazonbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /