mychicagotherapist.com
robots.txt
Robots Exclusion Standard data for mychicagotherapist.com
Resource Scan
Scan Details
| Site Domain | mychicagotherapist.com |
| Base Domain | mychicagotherapist.com |
| Scan Status | Ok |
| Last Scan | 2024-06-17T16:10:04+00:00 |
| Next Scan | 2024-07-17T16:10:04+00:00 |
Last Scan
| Scanned | 2024-06-17T16:10:04+00:00 |
| URL | https://mychicagotherapist.com/robots.txt |
| Domain IPs | 69.195.124.216 |
| Response IP | 69.195.124.216 |
| Found | Yes |
| Hash | 45006a5250732680e7ac99d7dcd1aa80ea387b34f1c3f3aceaa9a83728e89fa4 |
| SimHash | 680003306573 |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | /cgi-bin/ | - |
| Disallow | /wp-admin/ | - |
| Disallow | /wp-includes/ | - |
| Disallow | /wp-content/plugins/ | - |
| Disallow | /wp-content/cache/ | - |
| Disallow | /wp-content/themes/ | - |
| Disallow | /trackback/ | - |
| Disallow | /comments/ | - |
| Disallow | */trackback/ | - |
| Disallow | */comments/ | - |
| Disallow | wp-login.php | - |
| Disallow | wp-signup.php | - |
| Disallow | /*tag | tag pages do not contain unique content and should not be crawled |
| Disallow | /*2012 | date pages do not contain unique content and should not be crawled |
| Disallow | /*2013 | - |
| Disallow | /*2014 | - |
| Disallow | /*2015 | - |
| Disallow | /*? | - |
| Disallow | /*author | author pages should not be crawled or indexed unless they contain author bio and other useful info |
| Disallow | /feed/ | - |
| Disallow | /xmlrpc.php | - |
| Allow | /wp-content/uploads | - |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.mychicagotherapist.com/sitemap_index.xml |
Comments