anerdcooks.com
robots.txt

Robots Exclusion Standard data for anerdcooks.com

Resource Scan

Scan Details

Site Domain anerdcooks.com
Base Domain anerdcooks.com
Scan Status Ok
Last Scan2025-12-10T12:27:35+00:00
Next Scan 2025-12-17T12:27:35+00:00

Last Scan

Scanned2025-12-10T12:27:35+00:00
URL https://anerdcooks.com/robots.txt
Domain IPs 104.18.4.29, 104.18.5.29, 2606:4700::6812:41d, 2606:4700::6812:51d
Response IP 104.18.4.29
Found Yes
Hash ecc0eea1a6a1fc49c3fadb3dfad305c0f273aa733e591e2d91613fa5311f4ffc
SimHash 186458c0a593

Groups

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

piplbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://anerdcooks.com/sitemap_index.xml

Comments

  • ======Raptive Begin======
  • ======Raptive End======
  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK