intellect.icu
robots.txt
Robots Exclusion Standard data for intellect.icu
Resource Scan
Scan Details
| Site Domain | intellect.icu |
| Base Domain | intellect.icu |
| Scan Status | Ok |
| Last Scan | 2024-11-17T17:54:58+00:00 |
| Next Scan | 2024-11-24T17:54:58+00:00 |
Last Scan
| Scanned | 2024-11-17T17:54:58+00:00 |
| URL | https://intellect.icu/robots.txt |
| Domain IPs | 134.249.151.20 |
| Response IP | 134.249.151.20 |
| Found | Yes |
| Hash | 69ed92ac463aca9c49b4c9a060c05f9ffa262fa9a59bece90a818d71c8742db0 |
| SimHash | 831c41c36ab0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /tags |
| Disallow | /tags/* |
| Disallow | /password |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 30 |