Log In Sign Up

nozbone.eu
robots.txt

Robots Exclusion Standard data for nozbone.eu

Resource Scan

Scan Details

Site Domain nozbone.eu
Base Domain nozbone.eu
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-09-04T02:57:17+00:00
Next Scan 2024-12-03T02:57:17+00:00

Last Successful Scan

Scanned2024-04-14T23:06:16+00:00
URL https://nozbone.eu/robots.txt
Domain IPs 162.19.99.87
Response IP 162.19.99.87
Found Yes
Hash b5aebd2766ca51d36086b41810e64d2cc992d6ee41059277c87263274537fe64
SimHash 585855c0e130

Groups

*

Rule Path
Disallow /customer/
Disallow /catalogsearch/

semrushbot

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

semrushbot-coub

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

discobot

Rule Path
Disallow /

blekkobot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

sistrix crawler

Rule Path
Disallow /

uptimerobot/2.0

Rule Path
Disallow /

ezooms robot

Rule Path
Disallow /

perl lwp

Rule Path
Disallow /

netestate ne crawler

Rule Path
Disallow /

wiseguys robot

Rule Path
Disallow /

turnitin robot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

babya discoverer

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /
Back to top

Comments

  • Block Ahrefs
  • Block Sogou
  • Block SEOkicks
  • SEOkicks
  • Dicoveryengine.com
  • Blekkobot
  • Block BlexBot
  • Block SISTRIX
  • Block Uptime robot
  • Block Ezooms Robot
  • Block Perl LWP
  • Block netEstate NE Crawler
  • Block WiseGuys Robot
  • Block Turnitin Robot
  • Exabot
  • Yandex
  • Babya Discoverer
  • Amazonbot
Back to top

Warnings

  • 2 invalid lines.
Back to top