1stwebdesigner.com
robots.txt
Robots Exclusion Standard data for 1stwebdesigner.com
Resource Scan
Scan Details
| Site Domain | 1stwebdesigner.com |
| Base Domain | 1stwebdesigner.com |
| Scan Status | Ok |
| Last Scan | 2024-05-29T00:01:31+00:00 |
| Next Scan | 2024-06-05T00:01:31+00:00 |
Last Scan
| Scanned | 2024-05-29T00:01:31+00:00 |
| URL | https://1stwebdesigner.com/robots.txt |
| Domain IPs | 104.21.9.123, 172.67.189.66 |
| Response IP | 104.21.9.123 |
| Found | Yes |
| Hash | b7d7c7995475bf24ad031abe85810af70ba87acd950023e58367a50b38bac4cd |
| SimHash | 250cccc067b5 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /*?v |
| Allow | /*?amp |
| Disallow | /calendar/action* |
| Disallow | /events/action* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3 |
Comments