Log In Sign Up

onsite.org
robots.txt

Robots Exclusion Standard data for onsite.org

Resource Scan

Scan Details

Site Domain onsite.org
Base Domain onsite.org
Scan Status Ok
Last Scan2025-05-19T16:28:54+00:00
Next Scan 2025-06-18T16:28:54+00:00

Last Scan

Scanned2025-05-19T16:28:54+00:00
URL https://onsite.org/robots.txt
Redirect https://www.onsite.org/robots.txt
Redirect Domain www.onsite.org
Redirect Base onsite.org
Domain IPs 62.116.144.143
Redirect IPs 62.116.144.143
Response IP 62.116.144.143
Found Yes
Hash e82c34d21c9d6e3fb7df400cef789820d02b0cf12a0ae5457b6e1b7995250549
SimHash b959e14141b2

Groups

*

Rule Path Comment
Disallow /assets/cache/ -
Disallow /assets/docs/ -
Disallow /assets/export/ -
Disallow /assets/import/ -
Disallow /assets/modules/ -
Disallow /assets/plugins/ -
Disallow /assets/snippets/ -
Disallow /install/ -
Disallow /manager/ -
Disallow /html/datenschutz.html -
Disallow /cgi-bin/ -
Disallow /php/ -
Disallow /banner/ -
Disallow /daten/ -
Disallow /html/linkpartner/ -
Disallow /vorschau/ -
Disallow /teamviewer -
Disallow /onsrw 01.03.2017 soll das spidern der URls blockieren, die das hack noch enthalten.
Disallow /AUFSCHALTUNGEN/ -
Disallow /assets/templates/bootstrap/js/jquery-1.11.2.min$ -
Disallow /assets/templates/bootstrap/js/bootstrap.min$ -
Disallow /assets/templates/bootstrap/js/modernizr.custom.48287$ -
Disallow /assets/templates/bootstrap/js/woothemes-FlexSlider-06b12f8/jquery.flexslider-min$ -
Disallow /assets/templates/bootstrap/js/prettyPhoto_3.1.5/jquery.prettyPhoto$ -
Disallow /assets/templates/bootstrap/js/isotope/jquery.isotope.min$ -
Disallow /assets/templates/bootstrap/js/jquery.ui.totop$ -
Disallow /assets/templates/bootstrap/js/easing$ -
Disallow /assets/templates/bootstrap/js/wow.min$ -
Disallow /assets/templates/bootstrap/js/snap.svg-min$ -
Disallow /assets/templates/bootstrap/js/restart_theme.min$ -
Disallow /assets/templates/bootstrap/js/collapser$ -
Disallow /assets/templates/bootstrap/js/shariff.min$ -
Disallow /assets/js/snowfall.jquery.min$ -
Disallow /assets/templates/js/check_domain$ -
Disallow /assets/templates/js/multi_domain_check$ -

ia_archiver

Rule Path
Disallow /

incywincy

Rule Path
Disallow /

larbin

Rule Path
Disallow /

psbot

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

x-tractor

Rule Path
Disallow /

jobboersebot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.onsite.org/sitemap.html
Back to top

Comments

  • Default m_o d x exclusions
  • others
  • Disallow: /kb # 06.04.2016 wieder erlaubt weil der doofe g. sonst altscheiss nich spidert.penner.
  • deny these Spiders
  • For sitemaps.xml autodiscovery. Uncomment if you have one:
Back to top