timeserver.ru
robots.txt
Robots Exclusion Standard data for timeserver.ru
Resource Scan
Scan Details
Site Domain | timeserver.ru |
Base Domain | timeserver.ru |
Scan Status | Ok |
Last Scan | 2024-10-09T23:22:51+00:00 |
Next Scan | 2024-10-16T23:22:51+00:00 |
Last Scan
Scanned | 2024-10-09T23:22:51+00:00 |
URL | https://timeserver.ru/robots.txt |
Domain IPs | 188.130.153.32, 188.130.153.33 |
Response IP | 188.130.153.32 |
Found | Yes |
Hash | f03744ca59099c27ca9c2aea95314d36581bf293c4da0f911464b10fdf1cc23c |
SimHash | 4265d740fe02 |
Groups
rogerbot
dotbot
ahrefsbot
mj12bot
linkdexbot
sosospider
proximic
baiduspider
baiduspider-video
baiduspider-image
naverbot
yeti
coccoc
blexbot
sogou spider
semrushbot
cliqzbot
Rule | Path |
---|---|
Disallow | / |
*
Rule | Path |
---|---|
Disallow | /search |
Disallow | /favorites |
Disallow | /sync/utc |
Disallow | /sync/cities |
Disallow | /go |
Disallow | /compare?city |