intermatrix.hu
robots.txt
Robots Exclusion Standard data for intermatrix.hu
Resource Scan
Scan Details
Site Domain | intermatrix.hu |
Base Domain | intermatrix.hu |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-05-21T17:35:15+00:00 |
Next Scan | 2024-06-20T17:35:15+00:00 |
Last Successful Scan
Scanned | 2024-04-22T16:37:37+00:00 |
URL | https://intermatrix.hu/robots.txt |
Response IP | 87.229.85.82 |
Found | Yes |
Hash | 5bfe831980a708cb5a0329c26075773b0b7fd00573cf55693f7a1e07d8905d8e |
SimHash | 414422da97d8 |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /404.php |
Disallow | /404 |
Disallow | /403 |
Disallow | /403.php |
Disallow | /secret/ |
*
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 30 |
Other Records
Field | Value |
---|---|
sitemap | https://intermatrix.hu/sitemap.xml |
Warnings
- 33 invalid lines.