Log In Sign Up

handspeak.com
robots.txt

Robots Exclusion Standard data for handspeak.com

Resource Scan

Scan Details

Site Domain handspeak.com
Base Domain handspeak.com
Scan Status Ok
Last Scan2024-09-16T15:09:35+00:00
Next Scan 2024-09-23T15:09:35+00:00

Last Scan

Scanned2024-09-16T15:09:35+00:00
URL https://handspeak.com/robots.txt
Redirect https://www.handspeak.com/robots.txt
Redirect Domain www.handspeak.com
Redirect Base handspeak.com
Domain IPs 162.246.254.209
Redirect IPs 162.246.254.209
Response IP 162.246.254.209
Found Yes
Hash fb4861958a0c815cbbad8d8ca8de367a3b12cee1efba150c86564eca2cd35047
SimHash 2b148951c5b6

Groups

*

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

piplbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

googlebot-image

Rule Path
Allow /word/
Allow /learn/

bingbot
googlebot

Rule Path
Allow /
Disallow /member/*

yahoo
duckduckbot

Rule Path
Allow /$
Allow /word/$
Allow /word/*/$
Allow /learn/$
Allow /learn/*/$
Disallow /member/*

archive.org_bot

Rule Path
Disallow /member
Back to top

Other Records

Field Value
sitemap https://www.handspeak.com/sitemap.xml
Back to top

Comments

  • disallow all agents and files
  • allow adsense bot on entire site
  • User-agent: Googlebot
  • Disallow: /nogooglebot/
  • allow google bot on entire site
  • allow agents to crawl some
  • allow google bot on entire site
  • Allow: /
Back to top