unicornbooty.com
robots.txt
Robots Exclusion Standard data for unicornbooty.com
Resource Scan
Scan Details
| Site Domain | unicornbooty.com |
| Base Domain | unicornbooty.com |
| Scan Status | Ok |
| Last Scan | 2024-05-12T07:33:23+00:00 |
| Next Scan | 2024-06-11T07:33:23+00:00 |
Last Scan
| Scanned | 2024-05-12T07:33:23+00:00 |
| URL | http://unicornbooty.com/robots.txt |
| Redirect | https://hornet.com/robots.txt |
| Redirect Domain | hornet.com |
| Redirect Base | hornet.com |
| Domain IPs | 2600:1f18:4634:4602:d310:7723:c9ff:fed6, 2600:1f18:4634:4603:c4a3:2d4e:874e:8ceb, 3.219.8.102, 34.193.255.42 |
| Redirect IPs | 13.33.88.16, 13.33.88.20, 13.33.88.33, 13.33.88.79 |
| Response IP | 13.33.88.20 |
| Found | Yes |
| Hash | 149cc8bc36bc2948f2bfc20a1d96a2521a2586fe8f95292a6a7b8f2b37646146 |
| SimHash | 68168713a7f1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /reset-password |
| Disallow | /stories/*/comments |
| Disallow | /stories/*/feed |
| Disallow | /stories/*/search |
| Disallow | /stories/*/trackback |
| Disallow | /stories/*? |
| Disallow | /stories/*?* |
| Disallow | /stories/blog |
| Disallow | /stories/cgi-bin |
| Disallow | /stories/comment |
| Disallow | /stories/comment/reply/304/ |
| Disallow | /stories/comments |
| Disallow | /stories/feed |
| Disallow | /stories/hornet-best-practices-guide |
| Disallow | /stories/hornet-style-guide |
| Disallow | /stories/trackback |
| Disallow | /stories/wp-admin |
| Disallow | /stories/wp-content/cache |
| Disallow | /stories/wp-content/plugins |
| Disallow | /stories/wp-content/themes |
| Disallow | /stories/wp-includes |
| Disallow | /stories/write-for-us |
| Disallow | /stories-ping |
| Disallow | /about/wp-login.php |
| Allow | /stories/wp-content/uploads |
| Disallow | /stories/wp-content/uploads/cache |
| Disallow | /community |
| Disallow | /contribute |
| Allow | /community/knowledge-base |
| Allow | /contribute/knowledge-base |
| Allow | /community/programs |
| Allow | /contribute/programs |
googlebot
| Rule | Path |
|---|---|
| Disallow | /stories/*.cgi$ |
| Disallow | /stories/*.gz$ |
| Disallow | /stories/*.inc$ |
| Disallow | /stories/*.wmv$ |
| Disallow | /stories/*.xhtml$ |
| Disallow | /stories/*/comments |
| Disallow | /stories/*/feed |
| Disallow | /stories/*/page/ |
| Disallow | /stories/*/search |
| Disallow | /stories/blog |
| Disallow | /stories/calendar |
| Disallow | /stories/cmnty-translation-queue* |
| Disallow | /stories/comment |
| Disallow | /stories/comments |
| Disallow | /stories/hornet-best-practices-guide |
| Disallow | /stories/hornet-style-guide |
| Disallow | /stories/omgwtflol |
| Disallow | /stories/wp-content/cache |
| Disallow | /stories/wp-content/uploads/cache |
| Disallow | /stories/wp-includes |
| Disallow | /stories/write-for-us |
| Allow | /stories/*.css?* |
| Allow | /stories/*.js?* |
| Allow | /stories/*.ttf?* |
| Allow | /stories/*.woff?* |
| Allow | /stories/*bunyad_custom_css* |
| Allow | /stories/*sharify-style.php$ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://hornet.com/sitemap.xml |
Comments