firstcolonymall.com
robots.txt
Robots Exclusion Standard data for firstcolonymall.com
Resource Scan
Scan Details
Site Domain | firstcolonymall.com |
Base Domain | firstcolonymall.com |
Scan Status | Ok |
Last Scan | 2024-06-03T14:23:42+00:00 |
Next Scan | 2024-07-03T14:23:42+00:00 |
Last Scan
Scanned | 2024-06-03T14:23:42+00:00 |
URL | https://firstcolonymall.com/robots.txt |
Redirect | https://www.firstcolonymall.com:443/robots.txt |
Redirect Domain | www.firstcolonymall.com |
Redirect Base | firstcolonymall.com |
Domain IPs | 13.248.172.216, 99.83.143.0 |
Redirect IPs | 184.27.122.185, 184.27.122.193, 2600:1413:b000:13::b857:c186, 2600:1413:b000:13::b857:c18f |
Response IP | 42.99.140.152 |
Found | Yes |
Hash | e318850db6b798d2e3d77e2f57e1138b989e2a8c2f461bfbe38040123bfc7555 |
SimHash | 61183f419fb3 |
Groups
*
Rule | Path |
---|---|
Disallow | */wifi |
Disallow | */wifi/connected |
Disallow | */the-club/thank-you |
Disallow | */directory/map/* |
Disallow | */directory/wayfinding/* |
Disallow | /*date%3D |
Disallow | */sweepstakes |
Allow | */directory/map/$ |
Other Records
Field | Value |
---|---|
sitemap | https://www.firstcolonymall.com/arc/outboundfeeds/sitemap-index/ |
sitemap | https://www.firstcolonymall.com/arc/outboundfeeds/sitemap-section-index/ |