agro24.rs
robots.txt

Robots Exclusion Standard data for agro24.rs

Resource Scan

Scan Details

Site Domain agro24.rs
Base Domain agro24.rs
Scan Status Ok
Last Scan2025-04-21T09:59:10+00:00
Next Scan 2025-05-21T09:59:10+00:00

Last Scan

Scanned2025-04-21T09:59:10+00:00
URL https://agro24.rs/robots.txt
Domain IPs 2001:8d8:100f:f000::22d, 217.160.0.60
Response IP 217.160.0.60
Found Yes
Hash 1b27a670a68618c2b4f998c53e0e062b51fc6769214174f2a9356aaad9472abb
SimHash 6775df45f317

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

*

Rule Path
Disallow
Disallow /cgi-bin/

Other Records

Field Value
sitemap https://agro24.rs/sitemap.xml

Comments

  • This virtual robots.txt file was created by the Virtual Robots.txt WordPress plugin: https://www.wordpress.org/plugins/pc-robotstxt/