pennysaverusa.com
robots.txt
Robots Exclusion Standard data for pennysaverusa.com
Resource Scan
Scan Details
| Site Domain | pennysaverusa.com |
| Base Domain | pennysaverusa.com |
| Scan Status | Ok |
| Last Scan | 2024-11-06T03:57:49+00:00 |
| Next Scan | 2024-11-13T03:57:49+00:00 |
Last Scan
| Scanned | 2024-11-06T03:57:49+00:00 |
| URL | https://pennysaverusa.com/robots.txt |
| Domain IPs | 104.21.78.32, 172.67.215.97, 2606:4700:3033::6815:4e20, 2606:4700:3037::ac43:d761 |
| Response IP | 172.67.215.97 |
| Found | Yes |
| Hash | 1ffb946650f78180f3ae6a2c2a4198c7c5dcf6255e8022324e4a96616095dad1 |
| SimHash | e4df59c3ccb3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /oc-admin/ |
| Disallow | /send_pending_mails/ |
| Disallow | /script_images_to_bb/ |
| Disallow | /update_active_item_log.log |
| Disallow | /search_activity_log.log |
| Disallow | /items.log |
| Disallow | /log/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.pennysaverusa.com/sitemap.xml |