Log In Sign Up

btng.org
robots.txt

Robots Exclusion Standard data for btng.org

Resource Scan

Scan Details

Site Domain btng.org
Base Domain btng.org
Scan Status Ok
Last Scan2026-02-06T07:01:22+00:00
Next Scan 2026-03-08T07:01:22+00:00

Last Scan

Scanned2026-02-06T07:01:22+00:00
URL https://btng.org/robots.txt
Domain IPs 213.109.149.87
Response IP 213.109.149.87
Found Yes
Hash 6caac422e043387f2ac20f9793226cfdb5a6b6cdc32029f8002197a48267f48f
SimHash 581bd55157f1

Groups

*

Rule Path
Disallow /CVS/
Disallow /lib/
Disallow /doc/
Disallow /dump/
Disallow /img/
Disallow /templates/
Disallow /templates_c/
Disallow /var/
Disallow /lang/
Disallow /backups/
Disallow /bin/
Disallow /db/
Disallow /images/
Disallow /maps/
Disallow /modules/
Disallow /popups/
Disallow /temp/
Disallow /tests/
Disallow /tikimovies/
Disallow tiki-install.php
Disallow /tiki-install.php
Disallow tiki-admin.php
Disallow /tiki-admin.php
Disallow tiki-admin
Disallow /tiki-admin
Disallow tiki-editpage.php
Disallow /tiki-editpage.php
Disallow tiki-print.php
Disallow /tiki-print.php
Disallow tiki-print_article.php
Disallow /tiki-print_article.php
Disallow tiki-print_blog_post.php
Disallow /tiki-print_blog_post.php
Disallow tiki-print_multi_pages.php
Disallow /tiki-print_multi_pages.php
Disallow tiki-print_pages.php
Disallow /tiki-print_pages.php
Disallow tiki-pagehistory.php
Disallow /tiki-pagehistory.php
Disallow tiki-backlinks.php
Disallow /tiki-backlinks.php
Disallow tiki-likepages.php
Disallow /tiki-likepages.php
Disallow tiki-listpages.php
Disallow /tiki-listpages.php
Disallow tiki-list_file_gallery.php
Disallow /tiki-list_file_gallery.php
Disallow tiki-lastchanges.php
Disallow /tiki-lastchanges.php
Disallow tiki-orphan_pages.php
Disallow /tiki-orphan_pages.php
Disallow tiki-register.php
Disallow /tiki-register.php
Disallow tiki-login_scr.php
Disallow /tiki-login_scr.php
Disallow tiki-view_cache.php
Disallow /tiki-view_cache.php
Disallow tiki-user_information.php
Disallow /tiki-user_information.php
Disallow get_strings.php
Disallow /get_strings.php
Disallow tiki-index.php?page=SandBox
Disallow /tiki-index.php?page=SandBox
Disallow tiki-calendar.php
Disallow /tiki-calendar.php
Disallow tiki-browse_categories.php
Disallow /tiki-browse_categories.php
Disallow CVS/
Disallow lib/
Disallow doc/
Disallow dump/
Disallow img/
Disallow templates/
Disallow templates_c/
Disallow var/
Disallow lang/
Disallow backups/
Disallow bin/
Disallow db/
Disallow images/
Disallow maps/
Disallow modules/
Disallow popups/
Disallow temp/
Disallow tests/
Disallow tikimovies/

Other Records

Field Value
crawl-delay 30
Back to top

Comments

  • for an installation in a subdirectory, you have to copy this file in your root of your domain and add /subdir/ on each line
  • Uncomment the following line to indicate to robots __not__ to crawl your site.
  • Disallow: /
  • This is to slow down any crawling so as not to put pressure on your server
  • The following are what we normally don't want to be crawled
Back to top