Log In Sign Up

robbor.it
robots.txt

Robots Exclusion Standard data for robbor.it

Resource Scan

Scan Details

Site Domain robbor.it
Base Domain robbor.it
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-21T17:07:59+00:00
Next Scan 2025-11-20T17:07:59+00:00

Last Successful Scan

Scanned2025-07-24T15:25:48+00:00
URL https://robbor.it/robots.txt
Domain IPs 2a02:4780:84:cb9d:9eff:25fc:b66a:fdbc, 2a02:4780:84:dcbd:69c4:92cf:bc24:54e0, 84.32.84.165, 84.32.84.41
Response IP 77.37.66.53
Found Yes
Hash 392c5c7ac83e6cdbc9c388859c55ba2d0b11ea12251c3d7eefb95286b89a769f
SimHash 4957330355de

Groups

googlebot

Rule Path
Disallow

bingbot

Rule Path
Disallow

yahoo! slurp

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

feedfetcher-google

Rule Path
Disallow

google wireless transcoder

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

mediapartners-google

Rule Path
Disallow

google desktop

Rule Path
Disallow

bingpreview

Rule Path
Disallow

ia_archiver

Rule Path
Disallow

msnbot-media/

Rule Path
Disallow

juiceadv

Rule Path
Disallow

istellabot

Rule Path
Disallow

w3c_validator

Rule Path
Disallow

bytespider

Rule Path
Disallow /
Back to top

Comments

  • robots.txt for http://robbor.it
  • blocca i bot con useragent specificato in tutto il sito
  • Disallow: accedono ovunque. Disallow: / non accedono da nessuna parte
  • User-agent: *
  • Disallow: /
Back to top