theshoppesatcarlsbad.com
robots.txt
Robots Exclusion Standard data for theshoppesatcarlsbad.com
Resource Scan
Scan Details
Site Domain | theshoppesatcarlsbad.com |
Base Domain | theshoppesatcarlsbad.com |
Scan Status | Ok |
Last Scan | 2024-05-07T15:18:00+00:00 |
Next Scan | 2024-06-06T15:18:00+00:00 |
Last Scan
Scanned | 2024-05-07T15:18:00+00:00 |
URL | https://theshoppesatcarlsbad.com/robots.txt |
Redirect | https://www.theshoppesatcarlsbad.com:443/robots.txt |
Redirect Domain | www.theshoppesatcarlsbad.com |
Redirect Base | theshoppesatcarlsbad.com |
Domain IPs | 13.248.172.216, 99.83.143.0 |
Redirect IPs | 23.49.60.200, 23.49.60.202, 2600:1413:b000:14::b857:c147, 2600:1413:b000:14::b857:c15a |
Response IP | 42.99.140.210 |
Found | Yes |
Hash | abc0bd09faf39a96e4fb2ca0c3ce73302e89bc13d859f7d7a42f794a481f387d |
SimHash | 41701545d5b1 |
Groups
*
Rule | Path |
---|---|
Disallow | */wifi |
Disallow | */wifi/connected |
Disallow | */the-club/thank-you |
Disallow | */directory/map/* |
Disallow | */directory/wayfinding/* |
Disallow | /*date%3D |
Allow | */directory/map/$ |
Other Records
Field | Value |
---|---|
sitemap | https://www.theshoppesatcarlsbad.com/arc/outboundfeeds/sitemap-index/ |
sitemap | https://www.theshoppesatcarlsbad.com/arc/outboundfeeds/sitemap-section-index/ |