hauterrfly.com
robots.txt
Robots Exclusion Standard data for hauterrfly.com
Resource Scan
Scan Details
| Site Domain | hauterrfly.com |
| Base Domain | hauterrfly.com |
| Scan Status | Ok |
| Last Scan | 2024-11-10T01:51:33+00:00 |
| Next Scan | 2024-11-17T01:51:33+00:00 |
Last Scan
| Scanned | 2024-11-10T01:51:33+00:00 |
| URL | https://hauterrfly.com/robots.txt |
| Domain IPs | 13.35.238.100, 13.35.238.124, 13.35.238.20, 13.35.238.6 |
| Response IP | 13.35.238.6 |
| Found | Yes |
| Hash | 57a76c443593d3a7af77989f584adc039f5df15e1fb7ab26955ebf15a0cf42f1 |
| SimHash | 48246248a323 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /wp-admin/admin-ajax.php |
| Disallow | */feed$ |
| Disallow | */?s=* |
| Disallow | /wp-admin/ |
| Disallow | /events/ |
| Disallow | /wp-content/sitemaps/pagination-sitemap.xml |
| Disallow | /page/ |
| Disallow | */2018/* |
| Disallow | */2019/* |
| Disallow | */2015/* |
| Disallow | */2017/* |
| Disallow | */2016/* |
| Disallow | */?q=%2F* |
| Disallow | */webp-express/* |
| Disallow | */embed/?embed=true |
| Disallow | */web-stories/page/* |
| Disallow | */search/* |
| Disallow | */embed/* |
| Disallow | */page/* |
| Disallow | */Kinjal |
| Disallow | */undefined/* |
| Disallow | */about%3Ablank* |
| Disallow | */podcast/* |
| Disallow | /xmlrpc.php |
| Disallow | /*sex* |
| Disallow | /tag/sex/ |
| Disallow | /home/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://hauterrfly.com/post-sitemap1.xml |
| sitemap | https://hauterrfly.com/post-sitemap2.xml |
| sitemap | https://hauterrfly.com/post-sitemap3.xml |
| sitemap | https://hauterrfly.com/post-sitemap4.xml |
| sitemap | https://hauterrfly.com/post-sitemap5.xml |
| sitemap | https://hauterrfly.com/page-sitemap.xml |
| sitemap | https://hauterrfly.com/category-sitemap.xml |
| sitemap | https://hauterrfly.com/feed/podcast/the-tits-bits |