Log In Sign Up

tekelbett.com
robots.txt

Robots Exclusion Standard data for tekelbett.com

Resource Scan

Scan Details

Site Domain tekelbett.com
Base Domain tekelbett.com
Scan Status Ok
Last Scan2026-04-03T08:49:37+00:00
Next Scan 2026-05-03T08:49:37+00:00

Last Scan

Scanned2026-04-03T08:49:37+00:00
URL https://tekelbett.com/robots.txt
Domain IPs 2a02:4780:84:6d00:2ba5:c76a:e19f:7e1f, 2a02:4780:84:c6a8:e9db:d50a:b24f:2605, 77.37.75.39, 93.127.201.241
Response IP 77.37.66.8
Found Yes
Hash 8f28539fc6a07d84a3d8b396cdf96dd4b036ca81ec4f1ae87170cfd3e4151fdc
SimHash 6d139e02a557

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /includes/
Disallow /config.php
Disallow /database.sql
Disallow /create_*.php
Disallow /fix_*.php
Disallow /test_*.php
Disallow /debug_*.php
Disallow /install_*.php
Disallow /generate_*.php
Disallow /auto_*.php
Disallow /cleanup_*.php
Disallow /link_update_*.php
Disallow /f12_protection_*.php

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

slurp

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

baiduspider

Rule Path
Allow /

yandexbot

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://tekelbett.com/sitemap.xml
Back to top

Comments

  • Sitemap
  • Disallow admin area
  • Crawl delay (optional - be nice to servers)
  • Crawl-delay: 1
  • Specific rules for major search engines
Back to top