keeperfantasy.com
robots.txt

Robots Exclusion Standard data for keeperfantasy.com

Resource Scan

Scan Details

Site Domain keeperfantasy.com
Base Domain keeperfantasy.com
Scan Status Ok
Last Scan2025-12-28T23:37:03+00:00
Next Scan 2026-01-04T23:37:03+00:00

Last Scan

Scanned2025-12-28T23:37:03+00:00
URL https://keeperfantasy.com/robots.txt
Domain IPs 18.155.68.13, 18.155.68.27, 18.155.68.3, 18.155.68.83
Response IP 18.155.68.83
Found Yes
Hash 15f843a8c572597ed6e235f3e1591cc61fbcff4be6290a09c1e7071a81f00d94
SimHash 513cdb56f1d6

Groups

googlebot

Rule Path
Allow /afl/players/

googlebot-image

Rule Path
Allow /

claudebot

Rule Path
Disallow /afl/players/

gptbot

Rule Path
Disallow /

*

Rule Path
Disallow /afl/
Allow /afl/players/

Comments

  • Robots.txt tester: https://technicalseo.com/tools/robots-txt/
  • Allow Google access to specific paths
  • Disallow: /afl/
  • Allow Google Image bot
  • Block Problem Bots from even player profiles
  • Block all other bots