soulz.lt
robots.txt
Robots Exclusion Standard data for soulz.lt
Resource Scan
Scan Details
Site Domain | soulz.lt |
Base Domain | soulz.lt |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-05-21T13:13:38+00:00 |
Next Scan | 2024-07-20T13:13:38+00:00 |
Last Successful Scan
Scanned | 2024-03-23T13:09:33+00:00 |
URL | https://soulz.lt/robots.txt |
Domain IPs | 104.26.12.214, 104.26.13.214, 172.67.70.141, 2606:4700:20::681a:cd6, 2606:4700:20::681a:dd6, 2606:4700:20::ac43:468d |
Response IP | 104.26.13.214 |
Found | Yes |
Hash | 931739eb185f0e50884346804f41587be42fc1c2f0c686abe9d38bd3442ad27e |
SimHash | c8008a328ff7 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /*/api/ |
Disallow | /*/ajax/ |
Disallow | /admin/* |
Disallow | /admin |
Other Records
Field | Value |
---|---|
sitemap | https://soulz.lt/sitemap_index.xml |