Log In Sign Up

xlist.rs
robots.txt

Robots Exclusion Standard data for xlist.rs

Resource Scan

Scan Details

Site Domain xlist.rs
Base Domain xlist.rs
Scan Status Ok
Last Scan2025-09-03T18:24:17+00:00
Next Scan 2025-10-03T18:24:17+00:00

Last Scan

Scanned2025-09-03T18:24:17+00:00
URL https://xlist.rs/robots.txt
Redirect https://www.xlist.rs/robots.php
Redirect Domain www.xlist.rs
Redirect Base xlist.rs
Domain IPs 104.21.54.62, 172.67.136.7, 2606:4700:3031::ac43:8807, 2606:4700:3035::6815:363e
Redirect IPs 104.21.54.62, 172.67.136.7, 2606:4700:3031::ac43:8807, 2606:4700:3035::6815:363e
Response IP 104.21.54.62
Found Yes
Hash e856e9c63741e1fa764b6082a2456f23b2e70b234d14972c622873471c797794
SimHash 67089c51c731

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5
Back to top

Other Records

Field Value
sitemap https://www.xlist.rs/sitemap.xml
Back to top

Warnings

  • `host` is not a known field.
Back to top