exellent.be
robots.txt
Robots Exclusion Standard data for exellent.be
Resource Scan
Scan Details
Site Domain | exellent.be |
Base Domain | exellent.be |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2024-08-22T07:59:33+00:00 |
Next Scan | 2024-11-20T07:59:33+00:00 |
Last Successful Scan
Scanned | 2022-09-16T00:03:29+00:00 |
URL | https://exellent.be/robots.txt |
Redirect | https://www.exellent.be/robots.txt |
Redirect Domain | www.exellent.be |
Redirect Base | exellent.be |
Response IP | 185.2.53.123 |
Found | Yes |
Hash | aa0b388d4afd74b02a0877a5bcda8fa7224d60a52be6fa00cfd17d539157988b |
SimHash | 4a5c5cc47610 |
Groups
*
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://www.exellent.be/sitemap.xml |