Log In Sign Up

gneet.com
robots.txt

Robots Exclusion Standard data for gneet.com

Resource Scan

Scan Details

Site Domain gneet.com
Base Domain gneet.com
Scan Status Ok
Last Scan2025-11-03T05:55:30+00:00
Next Scan 2025-11-10T05:55:30+00:00

Last Scan

Scanned2025-11-03T05:55:30+00:00
URL https://gneet.com/robots.txt
Domain IPs 91.204.209.6
Response IP 91.204.209.6
Found Yes
Hash d2505f444959eae0bbdd5b49ee64baced255e60b56bfce94f5b48065d44b8f86
SimHash 6418ee90e593

Groups

*

Rule Path
Disallow /

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

slurp

Product Comment
slurp Yahoo
Rule Path
Allow /

duckduckbot

Rule Path
Allow /

baiduspider

Rule Path Comment
Disallow / (Optional, block if irrelevant audience)

yandex

Rule Path Comment
Disallow / (Optional, block if irrelevant audience)

chatgpt-user

Rule Path
Allow /

gptbot

Rule Path
Allow /

perplexitybot

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://www.gneet.com/sitemap.xml
Back to top

Comments

  • Block all unknown bots
  • Allow major search engines
  • Allow AI bots you're okay with
  • Sitemap location
Back to top