Log In Sign Up

br.su
robots.txt

Robots Exclusion Standard data for br.su

Resource Scan

Scan Details

Site Domain br.su
Base Domain br.su
Scan Status Ok
Last Scan2024-09-12T10:23:56+00:00
Next Scan 2024-10-12T10:23:56+00:00

Last Scan

Scanned2024-09-12T10:23:56+00:00
URL http://br.su/robots.txt
Domain IPs 62.122.170.171
Response IP 62.122.170.171
Found Yes
Hash c32f403383c5f9d7027338dfb277e05d8e11cd98db8c36f11a80deb443fded2d
SimHash 501cc0a0eb08

Groups

*
baiduspider

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

bingbot/2.0

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

checkmarknetwork/1.0 (+https://www.checkmarknetwork.com/spider.html)

Rule Path
Disallow /

dotbot/1.2

Rule Path
Disallow /
Back to top