dotclear.net
robots.txt
Robots Exclusion Standard data for dotclear.net
Resource Scan
Scan Details
Site Domain | dotclear.net |
Base Domain | dotclear.net |
Scan Status | Ok |
Last Scan | 2024-06-14T17:19:51+00:00 |
Next Scan | 2024-07-14T17:19:51+00:00 |
Last Scan
Scanned | 2024-06-14T17:19:51+00:00 |
URL | https://dotclear.net/robots.txt |
Redirect | https://dotclear.org/robots.txt |
Redirect Domain | dotclear.org |
Redirect Base | dotclear.org |
Domain IPs | 213.36.253.74 |
Redirect IPs | 213.36.253.71 |
Response IP | 213.36.253.71 |
Found | Yes |
Hash | 2d022dbc09d1d8eb7f2e334267f90195ce7d22f87bd46b0b527aacea61fbe590 |
SimHash | a91cdc60e3d1 |
Groups
*
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 5 |