agrarnetz.com
robots.txt

Robots Exclusion Standard data for agrarnetz.com

Resource Scan

Scan Details

Site Domain agrarnetz.com
Base Domain agrarnetz.com
Scan Status Ok
Last Scan2025-05-21T04:58:13+00:00
Next Scan 2025-05-28T04:58:13+00:00

Last Scan

Scanned2025-05-21T04:58:13+00:00
URL http://agrarnetz.com/robots.txt
Redirect http://www.agrarnetz.com/robots.txt
Redirect Domain www.agrarnetz.com
Redirect Base agrarnetz.com
Domain IPs 92.205.64.11
Redirect IPs 92.205.64.11
Response IP 92.205.64.11
Found Yes
Hash fadacdfda22289e213fea465f0a045ebd24c7e1c3f243fdf6727434dd287013e
SimHash 387888406b93

Groups

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

alexibot

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

*

Rule Path
Disallow /iframe/
Disallow /ajax/