tenstickers.com
robots.txt
Robots Exclusion Standard data for tenstickers.com
Resource Scan
Scan Details
Site Domain | tenstickers.com |
Base Domain | tenstickers.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-08-17T00:54:21+00:00 |
Next Scan | 2024-10-16T00:54:21+00:00 |
Last Successful Scan
Scanned | 2024-05-27T00:52:20+00:00 |
URL | https://tenstickers.com/robots.txt |
Redirect | https://www.tenstickers.com:443/robots.txt |
Redirect Domain | www.tenstickers.com |
Redirect Base | tenstickers.com |
Domain IPs | 3.248.37.224, 52.50.161.195, 54.228.5.179 |
Redirect IPs | 138.199.44.209, 2a02:6ea0:c77e::4, 2a02:6ea0:ca3a::4, 2a02:6ea0:d513::4, 79.127.211.129, 79.127.237.161 |
Response IP | 79.127.211.129 |
Found | Yes |
Hash | a53b3ae2b5c21a34a041b9c418333231af47235d16172c29c34f79c6ee6bd6ae |
SimHash | 207054c4d484 |
Groups
*
Rule | Path |
---|---|
Disallow | /bot-honneypot/ |
Disallow | /information/legal-notice/ |
Disallow | /information/terms-and-conditions-of-purchase/ |
Disallow | /information/details-of-the-shirts |
Disallow | /users/ |
Disallow | /buy/ |
Other Records
Field | Value |
---|---|
crawl-delay | 30 |
adsbot-google
Rule | Path |
---|---|
Disallow | /bot-honneypot/ |
Disallow | /information/legal-notice/ |
Disallow | /information/terms-and-conditions-of-purchase/ |
Disallow | /information/details-of-the-shirts |
Disallow | /users/ |
Disallow | /buy/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.tenstickers.com/sitemap.xml |