xlist.si
robots.txt

Robots Exclusion Standard data for xlist.si

Resource Scan

Scan Details

Site Domain xlist.si
Base Domain xlist.si
Scan Status Ok
Last Scan2025-10-31T23:46:47+00:00
Next Scan 2025-11-30T23:46:47+00:00

Last Scan

Scanned2025-10-31T23:46:47+00:00
URL https://xlist.si/robots.txt
Redirect https://www.xlist.si/robots.php
Redirect Domain www.xlist.si
Redirect Base xlist.si
Domain IPs 104.21.12.138, 172.67.194.188, 2606:4700:3033::6815:c8a, 2606:4700:3033::ac43:c2bc
Redirect IPs 104.21.12.138, 172.67.194.188, 2606:4700:3033::6815:c8a, 2606:4700:3033::ac43:c2bc
Response IP 172.67.194.188
Found Yes
Hash 55dc7db0ffdae8be9aa17138868a20a3c679878067cea71d1218afde579161d2
SimHash 67109e77c331

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.xlist.si/sitemap.xml

Warnings

  • `host` is not a known field.