rehakids.org
robots.txt
Robots Exclusion Standard data for rehakids.org
Resource Scan
Scan Details
Site Domain | rehakids.org |
Base Domain | rehakids.org |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2025-03-14T02:16:01+00:00 |
Next Scan | 2025-06-12T02:16:01+00:00 |
Last Successful Scan
Scanned | 2024-01-27T01:56:29+00:00 |
URL | https://rehakids.org/robots.txt |
Redirect | https://www.rehakids.de/robots.txt |
Redirect Domain | www.rehakids.de |
Redirect Base | rehakids.de |
Domain IPs | 104.21.78.56, 172.67.217.52, 2606:4700:3034::6815:4e38, 2606:4700:3034::ac43:d934 |
Redirect IPs | 104.21.52.161, 172.67.201.81, 2606:4700:3033::6815:34a1, 2606:4700:3036::ac43:c951 |
Response IP | 104.21.52.161 |
Found | Yes |
Hash | d8534a1af10faec66d7fa1cc9410dce5550f35ce99075e103556f9b4d98a26a8 |
SimHash | a0134844ea06 |
Groups
*
Rule | Path |
---|---|
Disallow | /adm |
Disallow | /bin |
Disallow | /cache |
Disallow | /config |
Disallow | /docs |
Disallow | /downloads |
Disallow | /files |
Disallow | /includes |
Disallow | /install |
Disallow | /language |
Disallow | /store |
Disallow | /vendor |
Disallow | /common.php |
Disallow | /config.php |
Disallow | /download.php |
Disallow | /mcp.php |
Disallow | /posting.php |
Disallow | /report.php |
Disallow | /ucp.php |
Disallow | /viewonline.php |
Disallow | /memberlist.php |
Disallow | /search.php |
Disallow | /web.config |
Disallow | /external.php |
Other Records
Field | Value |
---|---|
crawl-delay | 30 |