chipguide.com
robots.txt

Robots Exclusion Standard data for chipguide.com

Resource Scan

Scan Details

Site Domain chipguide.com
Base Domain chipguide.com
Scan Status Ok
Last Scan2024-09-26T02:44:42+00:00
Next Scan 2024-10-26T02:44:42+00:00

Last Scan

Scanned2024-09-26T02:44:42+00:00
URL https://chipguide.com/robots.txt
Domain IPs 77.68.121.87
Response IP 77.68.121.87
Found Yes
Hash a257d8fecd384bd3dce7c30fccc15d9e7cadb4538382f28461c01590fb4013a7
SimHash 0a06c852d41b

Groups

ahrefsbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

edisterbot

Rule Path
Disallow /

hailoobot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

msnbot

Rule Path
Disallow /calendar/
Disallow /cgi-bin/
Disallow /css/
Disallow /error_docs/
Disallow /img/
Disallow /ioncube/
Disallow /plesk-stat/
Disallow /private/
Disallow /psjs_datalogs/
Disallow /webbbs/

Other Records

Field Value
crawl-delay 10

obot

Rule Path
Disallow /

panscient.com

Rule Path
Disallow /

suggybot

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

speedy

Rule Path
Disallow /calendar/
Disallow /cgi-bin/
Disallow /css/
Disallow /error_docs/
Disallow /img/
Disallow /ioncube/
Disallow /plesk-stat/
Disallow /private/
Disallow /psjs_datalogs/
Disallow /webbbs/

Other Records

Field Value
crawl-delay 10

tagoobot

Rule Path
Disallow /

twiceler

Rule Path
Disallow /calendar/
Disallow /cgi-bin/
Disallow /css/
Disallow /error_docs/
Disallow /img/
Disallow /ioncube/
Disallow /plesk-stat/
Disallow /private/
Disallow /psjs_datalogs/
Disallow /webbbs/

Other Records

Field Value
crawl-delay 10

slurp

Rule Path
Disallow /calendar/
Disallow /cgi-bin/
Disallow /css/
Disallow /error_docs/
Disallow /img/
Disallow /ioncube/
Disallow /plesk-stat/
Disallow /private/
Disallow /psjs_datalogs/
Disallow /webbbs/

Other Records

Field Value
crawl-delay 10

wbsearchbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

*

Rule Path
Disallow /calendar/
Disallow /cgi-bin/
Disallow /css/
Disallow /error_docs/
Disallow /img/
Disallow /ioncube/
Disallow /plesk-stat/
Disallow /private/
Disallow /psjs_datalogs/
Disallow /webbbs/

Comments

  • general advice: