q.lb.bstatic.com
robots.txt

Robots Exclusion Standard data for q.lb.bstatic.com

Resource Scan

Scan Details

Site Domain q.lb.bstatic.com
Base Domain bstatic.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2024-04-12T20:06:27+00:00
Next Scan 2024-07-11T20:06:27+00:00

Last Successful Scan

Scanned2023-09-09T16:07:14+00:00
URL http://q.lb.bstatic.com/robots.txt
Domain IPs 185.28.221.4
Response IP 5.57.17.99
Found Yes
Hash 64a54d6f89151e425963858bef6dd235df616ce89ad55c1321e6b568d3b2254e
SimHash 5000d1c1c3e3

Groups

psbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

npbot-1/2.0

Rule Path
Disallow /

npbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /honing.html
Disallow /photo.html
Disallow /photo.en.html
Disallow /photo.de.html
Disallow /photo.nl.html
Disallow /photo.fr.html
Disallow /photo.es.html
Disallow /photo.it.html
Disallow /photo.pt.html
Disallow /photo.ja.html
Disallow /photo.zh.html
Disallow /photo.pl.html
Disallow /book.html
Disallow /mybooking.html
Disallow /confirmation.html
Disallow /general.*
Disallow /static/js/seo/*

*

Rule Path
Disallow /honing.html
Disallow /photo.html
Disallow /photo.en.html
Disallow /photo.de.html
Disallow /photo.nl.html
Disallow /photo.fr.html
Disallow /photo.es.html
Disallow /photo.it.html
Disallow /photo.pt.html
Disallow /photo.ja.html
Disallow /photo.zh.html
Disallow /photo.pl.html
Disallow /book.html
Disallow /mybooking.html
Disallow /confirmation.html
Disallow /general.*
Disallow /static/js/seo/*