usa-retail.com
robots.txt
Robots Exclusion Standard data for usa-retail.com
Resource Scan
Scan Details
| Site Domain | usa-retail.com |
| Base Domain | usa-retail.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-08-29T16:52:39+00:00 |
| Next Scan | 2024-11-27T16:52:39+00:00 |
Last Successful Scan
| Scanned | 2024-02-02T16:46:55+00:00 |
| URL | https://usa-retail.com/robots.txt |
| Domain IPs | 104.21.95.140, 172.67.170.115, 2606:4700:3031::ac43:aa73, 2606:4700:3037::6815:5f8c |
| Response IP | 172.67.170.115 |
| Found | Yes |
| Hash | 0c7d63ae1576670eb1a71e173688bb530590e6101ad6e044f176d09d85f20d66 |
| SimHash | 4865d8842813 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |
| Allow | /wp-content/uploads/ |
| Allow | /wp-content/themes/ |
| Allow | /wp-content/plugins/ |
| Allow | /wp-json/ |
| Disallow | *.xls$ |
| Disallow | /?s= |
| Disallow | /?ref= |
| Disallow | /?attachment_id= |
| Disallow | /feed |
| Disallow | */feed |
| Disallow | /comments/feed |
| Disallow | /feed/$ |
| Disallow | /*/feed/$ |
| Disallow | /*/feed/rss/$ |
| Disallow | /*/trackback/$ |
| Disallow | /*/*/feed/$ |
| Disallow | /*/*/feed/rss/$ |
| Disallow | /*/*/trackback/$ |
| Disallow | /*/*/*/feed/$ |
| Disallow | /*/*/*/feed/rss/$ |
| Disallow | /*/*/*/trackback/$ |
| Disallow | /*/attachment/* |
| Disallow | /*/*/attachment/* |
| Disallow | /author/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.america-retail.com/sitemap.xml |
| sitemap | https://www.america-retail.com/sitemap-news.xml |