motorbikemag.es
robots.txt
Robots Exclusion Standard data for motorbikemag.es
Resource Scan
Scan Details
| Site Domain | motorbikemag.es |
| Base Domain | motorbikemag.es |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-08-12T05:35:22+00:00 |
| Next Scan | 2024-10-11T05:35:22+00:00 |
Last Successful Scan
| Scanned | 2024-06-14T05:33:45+00:00 |
| URL | https://motorbikemag.es/robots.txt |
| Domain IPs | 104.26.8.8, 104.26.9.8, 172.67.75.89, 2606:4700:20::681a:808, 2606:4700:20::681a:908, 2606:4700:20::ac43:4b59 |
| Response IP | 172.67.75.89 |
| Found | Yes |
| Hash | 61f442377ec4c64cc6df7cf4436e9d6302b9e2008d44f35f2f53383fae9dd95a |
| SimHash | 4122dcd12b37 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /web/wp-admin/ |
| Disallow | /home-app/ |
| Disallow | /v-club/ |
| Disallow | /wp-login |
| Disallow | /web/wp-login |
| Disallow | /wp-admin |
| Disallow | /wp-includes/ |
| Disallow | /web/wp-includes/ |
| Disallow | /wp-login.php |
| Disallow | /web/wp-login.php |
| Disallow | /wp-login.php |
| Disallow | /wp-register.php |
| Disallow | /web/wp-login.php |
| Disallow | /web/wp-register.php |
| Disallow | /?attachment_id* |
| Disallow | /40730975/ |
| Disallow | /adserver/ |
| Disallow | /tienda/wp-admin/ |
| Disallow | /tienda/wp-login |
| Disallow | /tienda/wp-login.php |
| Disallow | /tienda/wp-register.php |
| Allow | /web/wp-includes/js/ |
| Allow | /web/wp-includes/css/ |
| Allow | /web/wp-includes/images/ |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.motorbikemag.es/sitemap.xml |
| sitemap | http://www.motorbikemag.es/sitemap-news.xml |