webstat.live
robots.txt

Robots Exclusion Standard data for webstat.live

Resource Scan

Scan Details

Site Domain webstat.live
Base Domain webstat.live
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-08T14:27:47+00:00
Next Scan 2025-12-07T14:27:47+00:00

Last Successful Scan

Scanned2025-04-19T12:38:20+00:00
URL https://webstat.live/robots.txt
Domain IPs 104.21.52.160, 172.67.201.39, 2606:4700:3031::6815:34a0, 2606:4700:3032::ac43:c927
Response IP 104.21.52.160
Found Yes
Hash 2a3003f6d24a2d984ec7d0e9510e9363477e6128a457fe74889530931007da81
SimHash ca14d321d4f5

Groups

googlebot
adsbot-google
adsbot-google-mobile
adsbot-google-mobile-apps
google favicon
googlebot-news
googlebot-image
googlebot-video
mediapartners-google
apis-google
duplexweb-google
bingbot
slurp
duckduckbot
baiduspider
ahrefsbot
rogerbot
yandexbot
dotbot
twitterbot
bingpreview
linkedinbot
yandexbot
facebot
facebookexternalhit
msnbot
msnbot-media

Rule Path
Disallow /
Allow /matomo.php
Allow /piwik.php
Allow /matomo.js
Allow /piwik.js
Allow /js/