thedisneyblog.com
robots.txt
Robots Exclusion Standard data for thedisneyblog.com
Resource Scan
Scan Details
| Site Domain | thedisneyblog.com |
| Base Domain | thedisneyblog.com |
| Scan Status | Ok |
| Last Scan | 2025-08-19T15:58:28+00:00 |
| Next Scan | 2025-09-02T15:58:28+00:00 |
Last Scan
| Scanned | 2025-08-19T15:58:28+00:00 |
| URL | https://thedisneyblog.com/robots.txt |
| Domain IPs | 104.26.0.196, 104.26.1.196, 172.67.75.211, 2606:4700:20::681a:1c4, 2606:4700:20::681a:c4, 2606:4700:20::ac43:4bd3 |
| Response IP | 104.26.1.196 |
| Found | Yes |
| Hash | e3f0bee22eed21ca1108e0709380a0801a0475edc375dd6597a951c940445b29 |
| SimHash | 43054af26693 |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | /wp-admin/ | - |
| Disallow | /wp-login.php | - |
| Disallow | /wp-includes/ | - |
| Disallow | /wp-content/plugins/ | - |
| Disallow | /wp-content/cache/ | - |
| Disallow | /wp-content/themes/ | - |
| Disallow | /wp-includes/js/ | - |
| Disallow | /trackback/ | - |
| Disallow | /category/*/* | - |
| Disallow | */trackback | - |
| Disallow | /search/ | prevents search queries being indexed |
| Disallow | /*?* | - |
| Disallow | /*? | - |
| Disallow | /*~* | - |
| Disallow | /*~ | - |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.thedisneyblog.com/sitemap.xml.gz |
Comments