erodate.rs
robots.txt

Robots Exclusion Standard data for erodate.rs

Resource Scan

Scan Details

Site Domain erodate.rs
Base Domain erodate.rs
Scan Status Ok
Last Scan2025-08-27T05:20:58+00:00
Next Scan 2025-09-26T05:20:58+00:00

Last Scan

Scanned2025-08-27T05:20:58+00:00
URL https://erodate.rs/robots.txt
Redirect https://www.erodate.rs/robots.php
Redirect Domain www.erodate.rs
Redirect Base erodate.rs
Domain IPs 104.21.26.41, 172.67.135.93, 2606:4700:3033::6815:1a29, 2606:4700:3033::ac43:875d
Redirect IPs 104.21.26.41, 172.67.135.93, 2606:4700:3033::6815:1a29, 2606:4700:3033::ac43:875d
Response IP 172.67.135.93
Found Yes
Hash c8887cdfca2a155cf94e7f13934d687323160598033e88f0b708077164b28aea
SimHash 4d409c72c733

Groups

*

Rule Path
Allow /
Disallow /affiliates

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.erodate.rs/sitemap_index.xml

Warnings

  • `host` is not a known field.