allthingshair.com
robots.txt
Robots Exclusion Standard data for allthingshair.com
Resource Scan
Scan Details
| Site Domain | allthingshair.com |
| Base Domain | allthingshair.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-07-02T10:05:52+00:00 |
| Next Scan | 2024-09-30T10:05:52+00:00 |
Last Successful Scan
| Scanned | 2023-09-06T11:49:29+00:00 |
| URL | https://www.allthingshair.com/robots.txt |
| Domain IPs | 104.69.174.231 |
| Response IP | 104.69.174.231 |
| Found | Yes |
| Hash | bdcb0b71f97b335fda717774318500ec92c828ac60f47c94abea5e66882dbd2c |
| SimHash | 286f4ea1ee50 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /wp-admin/ |
| Disallow | /*global-tags |
| Disallow | /*/page/* |
| Disallow | /en-uk/wp-admin/ |
| Disallow | /en-us/wp-admin/ |
| Disallow | /pt-br/wp-admin/ |
| Disallow | /es-us/wp-admin/ |
| Disallow | /th-th/wp-admin/ |
| Disallow | /id-id/wp-admin/ |
| Disallow | /en-ph/wp-admin/ |
| Disallow | /ru-ru/wp-admin/ |
| Disallow | /es-ar/wp-admin/ |
| Disallow | /es-mx/wp-admin/ |
| Disallow | /en-za/wp-admin/ |
| Disallow | /*?tag= |
| Disallow | /*?p= |
| Disallow | /pt-br/uncategorised/ |
| Disallow | /pt-br/redirect-store* |
| Disallow | /en-us/uncategorised/ |
| Disallow | /en-uk/uncategorised/ |
| Disallow | /es-us/uncategorised/ |
| Disallow | /th-th/uncategorised/ |
| Disallow | /id-id/uncategorised/ |
| Disallow | /en-ph/uncategorised/ |
| Disallow | /ru-ru/uncategorised/ |
| Disallow | /es-ar/uncategorised/ |
| Disallow | /es-mx/uncategorised/ |
| Disallow | /en-za/uncategorised/ |
| Disallow | /*?filters= |
| Disallow | /search/* |
| Disallow | /*/feed/ |
| Disallow | */search/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.allthingshair.com/pt-br/sitemap_index.xml |
| sitemap | https://www.allthingshair.com/en-uk/sitemap_index.xml |
| sitemap | https://www.allthingshair.com/en-us/sitemap_index.xml |
| sitemap | https://www.allthingshair.com/es-us/sitemap_index.xml |
| sitemap | https://www.allthingshair.com/th-th/sitemap_index.xml |
| sitemap | https://www.allthingshair.com/id-id/sitemap_index.xml |
| sitemap | https://www.allthingshair.com/en-ph/sitemap_index.xml |
| sitemap | https://www.allthingshair.com/ru-ru/sitemap_index.xml |
| sitemap | https://www.allthingshair.com/es-ar/sitemap_index.xml |
| sitemap | https://www.allthingshair.com/es-mx/sitemap_index.xml |
| sitemap | https://www.allthingshair.com/en-za/sitemap_index.xml |