webstat.live
robots.txt
Robots Exclusion Standard data for webstat.live
Resource Scan
Scan Details
Site Domain | webstat.live |
Base Domain | webstat.live |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2025-09-08T14:27:47+00:00 |
Next Scan | 2025-12-07T14:27:47+00:00 |
Last Successful Scan
Scanned | 2025-04-19T12:38:20+00:00 |
URL | https://webstat.live/robots.txt |
Domain IPs | 104.21.52.160, 172.67.201.39, 2606:4700:3031::6815:34a0, 2606:4700:3032::ac43:c927 |
Response IP | 104.21.52.160 |
Found | Yes |
Hash | 2a3003f6d24a2d984ec7d0e9510e9363477e6128a457fe74889530931007da81 |
SimHash | ca14d321d4f5 |
Groups
googlebot
adsbot-google
adsbot-google-mobile
adsbot-google-mobile-apps
google favicon
googlebot-news
googlebot-image
googlebot-video
mediapartners-google
apis-google
duplexweb-google
bingbot
slurp
duckduckbot
baiduspider
ahrefsbot
rogerbot
yandexbot
dotbot
twitterbot
bingpreview
linkedinbot
yandexbot
facebot
facebookexternalhit
msnbot
msnbot-media
Rule | Path |
---|---|
Disallow | / |
Allow | /matomo.php |
Allow | /piwik.php |
Allow | /matomo.js |
Allow | /piwik.js |
Allow | /js/ |