vietas.lv
robots.txt
Robots Exclusion Standard data for vietas.lv
Resource Scan
Scan Details
Site Domain | vietas.lv |
Base Domain | vietas.lv |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-08-08T14:25:21+00:00 |
Next Scan | 2024-11-06T14:25:21+00:00 |
Last Successful Scan
Scanned | 2023-10-14T12:58:34+00:00 |
URL | https://vietas.lv/robots.txt |
Redirect | https://www.vietas.lv/robots.txt |
Redirect Domain | www.vietas.lv |
Redirect Base | vietas.lv |
Domain IPs | 104.21.40.101, 172.67.184.88, 2606:4700:3036::6815:2865, 2606:4700:3037::ac43:b858 |
Redirect IPs | 104.21.40.101, 172.67.184.88, 2606:4700:3036::6815:2865, 2606:4700:3037::ac43:b858 |
Response IP | 104.21.40.101 |
Found | Yes |
Hash | fd1a660baf97d9266d6812d36968daba66e24f8b17b265380a4a198b721ab3c0 |
SimHash | c97cf620da10 |
Groups
*
Rule | Path |
---|---|
Disallow | /captcha/ |
Disallow | /pzone/ |
Disallow | /swf2/ |
Disallow | /other/ |
Disallow | /swf/ |
Disallow | /maptest/ |
Disallow | /index.php?p=35 |
Allow | / |
Warnings
- 2 invalid lines.