allaboutparrots.com
robots.txt

Robots Exclusion Standard data for allaboutparrots.com

Resource Scan

Scan Details

Site Domain allaboutparrots.com
Base Domain allaboutparrots.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan6/30/2025, 10:31:56 AM
Next Scan 7/7/2025, 10:31:56 AM

Last Successful Scan

Scanned6/22/2025, 7:58:16 AM
URL https://allaboutparrots.com/robots.txt
Redirect https://www.allaboutparrots.com/robots.txt
Redirect Domain www.allaboutparrots.com
Redirect Base allaboutparrots.com
Domain IPs 104.21.80.161, 172.67.151.119, 2606:4700:3030::6815:50a1, 2606:4700:3030::ac43:9777
Redirect IPs 104.21.80.161, 172.67.151.119, 2606:4700:3030::6815:50a1, 2606:4700:3030::ac43:9777
Response IP 104.21.80.161
Found Yes
Hash 2db3b71b23574274c957fa85535e2753dc1cf49094856bc293e21321d176a622
SimHash 1960d8c0a193

Groups

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

piplbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.allaboutparrots.com/sitemap_index.xml

Comments

  • ======Raptive Begin======
  • ======Raptive End======
  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK