supersummary.com
robots.txt
Robots Exclusion Standard data for supersummary.com
Resource Scan
Scan Details
| Site Domain | supersummary.com |
| Base Domain | supersummary.com |
| Scan Status | Ok |
| Last Scan | 2024-05-19T13:09:07+00:00 |
| Next Scan | 2024-05-26T13:09:07+00:00 |
Last Scan
| Scanned | 2024-05-19T13:09:07+00:00 |
| URL | https://supersummary.com/robots.txt |
| Redirect | https://www.supersummary.com/robots.txt |
| Redirect Domain | www.supersummary.com |
| Redirect Base | supersummary.com |
| Domain IPs | 76.76.21.21 |
| Redirect IPs | 76.76.21.9, 76.76.21.98 |
| Response IP | 76.76.21.98 |
| Found | Yes |
| Hash | 87964302e98966d3a6363c62129d4293798dc72d22f5debcaa7b11795c262aaf |
| SimHash | 401fd8d2c413 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /rss/ |
| Disallow | /rss2/ |
| Disallow | /search/ |
| Disallow | /sign-in/ |
| Disallow | /sign-out/ |
| Disallow | /checkout/ |
| Disallow | /subscribe/ |
| Disallow | /*?keep_ads%2F* |
| Disallow | /*?a%2F* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.supersummary.com/sitemap.xml |