Log In Sign Up

teenkidschat.com
robots.txt

Robots Exclusion Standard data for teenkidschat.com

Resource Scan

Scan Details

Site Domain teenkidschat.com
Base Domain teenkidschat.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-27T19:09:25+00:00
Next Scan 2024-09-26T19:09:25+00:00

Last Successful Scan

Scanned2024-07-29T19:07:52+00:00
URL https://teenkidschat.com/robots.txt
Domain IPs 185.178.208.188
Response IP 185.178.208.188
Found Yes
Hash c54ff1aca340d616349b4951fef83da0eb0429f5d8c279f853bded9a0612bcfe
SimHash 84b6cac64db3

Groups

*

Rule Path Comment
Disallow /login/ -
Disallow /admin.php -
Allow / -
Allow /search/ -
Allow /posts/ -
Allow /threads/ Assuming you want search engines to index threads (excluding replies blocked by Amazonbot disallow)
Disallow /account/* This would block all pages under /account/

mediapartners-google

No rules defined. All paths allowed.

Back to top

Other Records

Field Value
sitemap https://teenkidschat.com/sitemap.xml
Back to top

Comments

  • Allow search engine bots to access most content
  • Allow indexing of essential content
  • Optional: You can add specific disallows with path patterns for more granular control
  • Sitemap location
  • Mediapartners-Google: Allow for AdSense functionality (no disallow needed)
Back to top