gomilkyway.com
robots.txt
Robots Exclusion Standard data for gomilkyway.com
Resource Scan
Scan Details
| Site Domain | gomilkyway.com |
| Base Domain | gomilkyway.com |
| Scan Status | Ok |
| Last Scan | 2024-11-02T17:58:07+00:00 |
| Next Scan | 2024-11-09T17:58:07+00:00 |
Last Scan
| Scanned | 2024-11-02T17:58:07+00:00 |
| URL | https://gomilkyway.com/robots.txt |
| Domain IPs | 104.193.109.154, 104.193.109.156 |
| Response IP | 104.193.109.156 |
| Found | Yes |
| Hash | 4fc89348688fd9f76a44257c323bc2aa3a0e8f0116f8c8fe9a7e04eaed7ffbee |
| SimHash | e9a018204915 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /contact.php |
| Disallow | /copyright-information |
| Disallow | /contact |
| Disallow | /privacy-policy |
| Disallow | /terms-of-service |
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |
| Disallow | /wp-includes/ |
| Allow | /wp-includes/*.js |
| Allow | /wp-includes/*.css |
Other Records
| Field | Value |
|---|---|
| sitemap | http://gomilkyway.com/sitemap_index.xml |