catalyst-au.net
robots.txt
Robots Exclusion Standard data for catalyst-au.net
Resource Scan
Scan Details
| Site Domain | catalyst-au.net |
| Base Domain | catalyst-au.net |
| Scan Status | Ok |
| Last Scan | 2024-11-15T22:44:13+00:00 |
| Next Scan | 2024-11-29T22:44:13+00:00 |
Last Scan
| Scanned | 2024-11-15T22:44:13+00:00 |
| URL | https://catalyst-au.net/robots.txt |
| Redirect | https://www.catalyst-au.net:443/robots.txt |
| Redirect Domain | www.catalyst-au.net |
| Redirect Base | catalyst-au.net |
| Domain IPs | 18.155.68.108, 18.155.68.113, 18.155.68.118, 18.155.68.61 |
| Redirect IPs | 104.22.58.194, 104.22.59.194, 172.67.11.246, 2606:4700:10::6816:3ac2, 2606:4700:10::6816:3bc2, 2606:4700:10::ac43:bf6 |
| Response IP | 104.22.58.194 |
| Found | Yes |
| Hash | 71a05e2fac67624413bb18cc3e9d3210db364fd4d2d4c8b52264f406e5ea0b0f |
| SimHash | 4918cdc2e6b5 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /calendar/action* |
| Disallow | /events/action* |
| Allow | /*.css |
| Allow | /*.js |
| Disallow | /*? |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://catalyst-au.net/sitemap_index.xml |
Comments