Log In Sign Up

goiconnect.com
robots.txt

Robots Exclusion Standard data for goiconnect.com

Resource Scan

Scan Details

Site Domain goiconnect.com
Base Domain goiconnect.com
Scan Status Ok
Last Scan2025-02-20T22:44:38+00:00
Next Scan 2025-03-22T22:44:38+00:00

Last Scan

Scanned2025-02-20T22:44:38+00:00
URL https://goiconnect.com/robots.txt
Domain IPs 104.26.2.211, 104.26.3.211, 172.67.71.226, 2606:4700:20::681a:2d3, 2606:4700:20::681a:3d3, 2606:4700:20::ac43:47e2
Response IP 172.67.71.226
Found Yes
Hash 9f47a7a1b527c48748c812947781f0078f96a51e2ef5ab419e9990945d1ac8f1
SimHash 7ad4c162ee91

Groups

netmechanic

Rule Path
Disallow

*

Rule Path
Disallow /*.axd$

yandex

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

haosouspider

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

sogou

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

steeler

Rule Path
Disallow /

spiderling

Rule Path
Disallow /

trendiction-bot

Rule Path
Disallow /

sogou+web+spider

Rule Path
Disallow /

exabot

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /
Back to top

Comments

  • allow just www.netmechanic.com
  • go away to all other robots for entire site
Back to top

Warnings

  • 2 invalid lines.
Back to top