sweepsheet.com
robots.txt
Robots Exclusion Standard data for sweepsheet.com
Resource Scan
Scan Details
| Site Domain | sweepsheet.com |
| Base Domain | sweepsheet.com |
| Scan Status | Ok |
| Last Scan | 2025-09-12T11:44:12+00:00 |
| Next Scan | 2025-10-12T11:44:12+00:00 |
Last Scan
| Scanned | 2025-09-12T11:44:12+00:00 |
| URL | https://www.sweepsheet.com/robots.txt |
| Domain IPs | 52.202.73.234 |
| Response IP | 52.202.73.234 |
| Found | Yes |
| Hash | 3bb0c0e2c47a25944f62daa5e9f182dda2b980e1c302b9e1e2e6eb33b6b8f98d |
| SimHash | 381a5d6040a3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /App_Code/ |
| Disallow | /Bin/ |
| Disallow | /bootstrap/ |
| Disallow | /ckeditor/ |
| Disallow | /Errors/ |
| Disallow | /images/ |
| Disallow | /smoothness/ |
| Disallow | /*.gif$ |
| Disallow | /*.jpg$ |
| Disallow | /*.png$ |
| Disallow | /*.asax$ |
| Disallow | /*.ascx$ |
| Disallow | /*.cs$ |
| Disallow | /*.js$ |
| Disallow | /*.config$ |
| Disallow | /forgotpas.aspx |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 20 |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.sweepsheet.com/sitemap.xml |