comparefoodsnc.com
robots.txt
Robots Exclusion Standard data for comparefoodsnc.com
Resource Scan
Scan Details
| Site Domain | comparefoodsnc.com |
| Base Domain | comparefoodsnc.com |
| Scan Status | Ok |
| Last Scan | 2025-12-20T11:22:14+00:00 |
| Next Scan | 2026-01-03T11:22:14+00:00 |
Last Scan
| Scanned | 2025-12-20T11:22:14+00:00 |
| URL | https://comparefoodsnc.com/robots.txt |
| Domain IPs | 54.166.150.11 |
| Response IP | 54.166.150.11 |
| Found | Yes |
| Hash | 4d9bb48b07572dea16843cf5dca67e9a2d72c5fd6028ae7efb7aac0b59f92056 |
| SimHash | 4965d85123b3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.comparefoodsnc.com/freshop_sitemap.xml.gz |
| sitemap | https://comparefoodsnc.com/sitemap.xml |
| sitemap | https://comparefoodsnc.com/sitemap.html |