citywalls.ru
robots.txt

Robots Exclusion Standard data for citywalls.ru

Resource Scan

Scan Details

Site Domain citywalls.ru
Base Domain citywalls.ru
Scan Status Ok
Last Scan2024-10-07T01:49:03+00:00
Next Scan 2024-10-14T01:49:03+00:00

Last Scan

Scanned2024-10-07T01:49:03+00:00
URL https://citywalls.ru/robots.txt
Redirect https://www.citywalls.ru/robots.txt
Redirect Domain www.citywalls.ru
Redirect Base citywalls.ru
Domain IPs 109.236.91.4
Redirect IPs 109.236.91.4
Response IP 109.236.91.4
Found Yes
Hash e934ea6878a3fee25f36ad956a906f00bf75b14f9e391bea46dec735bb937e1d
SimHash 0a37d8e8fe13

Groups

petalbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

academicbotrtu

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

weborama-fetcher

Rule Path
Disallow /

*

Rule Path
Disallow /admin/
Disallow /cgi-bin/
Disallow /images/
Disallow /include/
Disallow /script/
Disallow /style/

Warnings

  • `clean-param` is not a known field.