mainemall.com
robots.txt
Robots Exclusion Standard data for mainemall.com
Resource Scan
Scan Details
Site Domain | mainemall.com |
Base Domain | mainemall.com |
Scan Status | Ok |
Last Scan | 2024-06-04T06:41:51+00:00 |
Next Scan | 2024-07-04T06:41:51+00:00 |
Last Scan
Scanned | 2024-06-04T06:41:51+00:00 |
URL | https://mainemall.com/robots.txt |
Redirect | https://www.mainemall.com:443/robots.txt |
Redirect Domain | www.mainemall.com |
Redirect Base | mainemall.com |
Domain IPs | 15.197.248.202, 99.83.149.22 |
Redirect IPs | 2600:1413:b000:14::b857:c148, 2600:1413:b000:14::b857:c150, 72.247.127.225, 72.247.127.242 |
Response IP | 42.99.140.192 |
Found | Yes |
Hash | 9570207b5378adc919869e8bf4462c38c880fd98f5b7c3c53eef25e2eabdd048 |
SimHash | 2160374192b3 |
Groups
*
Rule | Path |
---|---|
Disallow | */wifi |
Disallow | */wifi/connected |
Disallow | */the-club/thank-you |
Disallow | */directory/map/* |
Disallow | */directory/wayfinding/* |
Disallow | /*date%3D |
Disallow | */sweepstakes |
Allow | */directory/map/$ |
Other Records
Field | Value |
---|---|
sitemap | https://www.mainemall.com/arc/outboundfeeds/sitemap-index/ |
sitemap | https://www.mainemall.com/arc/outboundfeeds/sitemap-section-index/ |