olo.az
robots.txt

Robots Exclusion Standard data for olo.az

Resource Scan

Scan Details

Site Domain olo.az
Base Domain olo.az
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-04-08T22:26:14+00:00
Next Scan 2024-07-07T22:26:14+00:00

Last Successful Scan

Scanned2023-09-08T14:24:04+00:00
URL https://olo.az/robots.txt
Redirect https://ucuztap.az/robots.txt
Redirect Domain ucuztap.az
Redirect Base ucuztap.az
Domain IPs 104.21.67.63, 172.67.214.254, 2606:4700:3030::ac43:d6fe, 2606:4700:3037::6815:433f
Redirect IPs 104.21.23.157, 172.67.212.7, 2606:4700:3030::6815:179d, 2606:4700:3032::ac43:d407
Response IP 172.67.212.7
Found Yes
Hash 9d92690d96326bf126e65303c9ed1b72501b4de400cb7436e32c3080c221e791
SimHash c944d908c41a

Groups

*

Rule Path
Disallow /f/
Disallow /c/
Disallow /a/*
Disallow /p/*

baiduspider
baiduspider
baiduspider-video
baiduspider-image
baiduspider+

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

Comments

  • Block Baidu spider