tervist24.ohtuleht.ee
robots.txt
Robots Exclusion Standard data for tervist24.ohtuleht.ee
Resource Scan
Scan Details
Site Domain | tervist24.ohtuleht.ee |
Base Domain | ohtuleht.ee |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2024-04-17T23:25:58+00:00 |
Next Scan | 2024-07-16T23:25:58+00:00 |
Last Successful Scan
Scanned | 2023-05-31T22:19:19+00:00 |
URL | https://tervist24.ohtuleht.ee/robots.txt |
Redirect | https://www.ohtuleht.ee/robots.txt |
Redirect Domain | www.ohtuleht.ee |
Redirect Base | ohtuleht.ee |
Domain IPs | 104.26.10.243, 104.26.11.243, 172.67.73.240, 2606:4700:20::681a:af3, 2606:4700:20::681a:bf3, 2606:4700:20::ac43:49f0 |
Redirect IPs | 104.26.10.243, 104.26.11.243, 172.67.73.240, 2606:4700:20::681a:af3, 2606:4700:20::681a:bf3, 2606:4700:20::ac43:49f0 |
Response IP | 104.26.11.243 |
Found | Yes |
Hash | cf0e1f5291b6dff6a514c807c59e625f50a592a29c6d0e15a145f69d1cdad2d9 |
SimHash | 2a4afcc1ea91 |
Groups
*
Rule | Path |
---|---|
Disallow | /*kommentaarid |
Disallow | /*? |
Disallow | /19272/* |
Disallow | /350468/* |
Disallow | /89893/* |
Disallow | /99652/* |