thehomeschoolmom.com
robots.txt

Robots Exclusion Standard data for thehomeschoolmom.com

Resource Scan

Scan Details

Site Domain thehomeschoolmom.com
Base Domain thehomeschoolmom.com
Scan Status Ok
Last Scan2024-07-01T15:39:33+00:00
Next Scan 2024-07-08T15:39:33+00:00

Last Scan

Scanned2024-07-01T15:39:33+00:00
URL https://thehomeschoolmom.com/robots.txt
Redirect https://www.thehomeschoolmom.com/robots.txt
Redirect Domain www.thehomeschoolmom.com
Redirect Base thehomeschoolmom.com
Domain IPs 67.225.168.17
Redirect IPs 67.225.168.17
Response IP 67.225.168.17
Found Yes
Hash f9249f7faebc707702b411e2fae9c80170a57b138c8a16852f7b04cddaa05996
SimHash 647e49c84db2

Groups

ia_archiver

Rule Path
Disallow /

baiduspider
baiduspider-video
baiduspider-image

Rule Path
Disallow /

*

Rule Path
Disallow /cgi-bin/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /wp-includes/
Disallow /*feed/$
Disallow /trackback/
Disallow /index.php
Disallow /xmlrpc.php
Disallow *comments%3D*
Disallow /search/
Disallow /?s*
Disallow /tag/
Disallow /old-site/
Disallow /contact-form/
Disallow /local_resource_category/
Disallow /fieldtriplocation/
Disallow /fieldtripcategory/
Disallow /comment-subscriptions/

anthropic-ai

Rule Path
Disallow /

claude-webt

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

piplbot

Rule Path
Disallow /

Comments

  • changed permissions to 444 - if can't upload, add owner write permissions