shippingwatch.com
robots.txt
Robots Exclusion Standard data for shippingwatch.com
Resource Scan
Scan Details
Site Domain | shippingwatch.com |
Base Domain | shippingwatch.com |
Scan Status | Ok |
Last Scan | 2024-05-15T18:19:37+00:00 |
Next Scan | 2024-05-29T18:19:37+00:00 |
Last Scan
Scanned | 2024-05-15T18:19:37+00:00 |
URL | https://shippingwatch.com/robots.txt |
Domain IPs | 18.155.68.107, 18.155.68.34, 18.155.68.62, 18.155.68.96 |
Response IP | 18.155.68.34 |
Found | Yes |
Hash | 8f9a17cd8f8673daa60455719ac1a0c404293d3cc6e265361e89a1fbdc1c2e6f |
SimHash | 70175224a7c7 |
Groups
*
Rule | Path |
---|---|
Disallow | /archive/ |
Disallow | /auth |
Disallow | /user/addTrial |
Disallow | /metrics |
Disallow | /health |
Disallow | /cache |
Disallow | /esi |
Disallow | /mark-variant-won |
Disallow | /article/5253094 |
Disallow | /Sygdom___Sundhed/article5253094.ece |
Disallow | /service/cbp |
Other Records
Field | Value |
---|---|
sitemap | https://shippingwatch.com/sitemapindex.xml |
Comments