Log In Sign Up

takawiki.com
robots.txt

Robots Exclusion Standard data for takawiki.com

Resource Scan

Scan Details

Site Domain takawiki.com
Base Domain takawiki.com
Scan Status Ok
Last Scan2025-10-01T18:40:17+00:00
Next Scan 2025-10-31T18:40:17+00:00

Last Scan

Scanned2025-10-01T18:40:17+00:00
URL https://takawiki.com/robots.txt
Redirect https://www.takawiki.com/robots.txt
Redirect Domain www.takawiki.com
Redirect Base takawiki.com
Domain IPs 104.21.17.158, 172.67.177.19, 2606:4700:3030::ac43:b113, 2606:4700:3032::6815:119e
Redirect IPs 104.21.17.158, 172.67.177.19, 2606:4700:3030::ac43:b113, 2606:4700:3032::6815:119e
Response IP 104.21.17.158
Found Yes
Hash 2e0e29c556973fc0dc4126b652c0b32f430b24f4a1391901e5a77ab6835db308
SimHash ea1cfd5444f0

Groups

*

Rule Path Comment
Disallow /temp/ -
Allow /temp/public/ -
Disallow /addons/ -
Disallow /admin/ -
Disallow /backup/ -
Disallow /db/ -
Disallow /doc/ -
Disallow /installer/ -
Disallow /lang/ -
Allow /lang/*.js$ -
Disallow /maps/ -
Disallow /mods/ -
Disallow /modules/ -
Disallow /permissioncheck/ -
Disallow /popups/ -
Disallow /templates/ -
Disallow /tests/ -
Disallow /vendor* -
Allow /vendor*.gif$ -
Allow /vendor*.jpg$ -
Allow /vendor*.png$ -
Allow /vendor*.svg$ -
Allow /vendor*.js$ -
Allow /vendor*.css$ -
Allow /vendor*.otf$ -
Allow /vendor*.eot$ -
Allow /vendor*.ttf$ -
Allow /vendor*.woff$ -
Allow /vendor*.woff2$ -
Disallow /get_strings.php -
Disallow /tiki-admin -
Disallow /*sort_mode%3D* -
Disallow /*latest%3D1* -
Disallow /*PHPSESSID%3D -
Disallow /*display%3Dprint* -
Disallow /*show_comzone%3D* -
Disallow /*page_ref_id%3D* -
Disallow /*topics_offset%3D-1* to fix a display error, can be removed when bug5204 is fixed
Disallow /*show_details%3D* -
Disallow /*offset%3D0* -
Disallow /*print%3Dy* -
Disallow /*fullscreen%3Dy* -
Disallow /*mode%3Dmobile* -

Other Records

Field Value
crawl-delay 10
Back to top

Other Records

Field Value
sitemap https://www.takawiki.com/storage/public/sitemap-index.xml
Back to top

Comments

  • This is a robot.txt file for Tiki to tell all search bots that we don't want them to crawl in the paths beginning with the strings below.
  • For an installation in a subdirectory, you have to copy this file in root of your domain and add /yoursubdirname on each line.
  • (c) Copyright by authors of the Tiki Wiki CMS Groupware Project
  • All Rights Reserved. See copyright.txt for details and a complete list of authors.
  • Licensed under the GNU LESSER GENERAL PUBLIC LICENSE. See license.txt for details.
  • Uncomment the following line to indicate to robots __not__ to crawl your site.
  • Disallow: /
  • Be sure to re-generate sitemaps with scheduler (https://doc.tiki.org/Sitemap)
  • == Begin SEF URL Section ==
  • remove pages in favour of the SEF counterpart (Enable only after SEF URL’s are enabled in tiki will otherwise prevent indexing.)
  • Disallow: /tiki-forums.php
  • Disallow: /tiki-view_forum.php
  • Disallow: /tiki-index.php
  • Disallow: /tiki-read_article.php
  • Disallow: /tiki-view_blog.php
  • Disallow: /tiki-list_file_gallery.php
  • == End SEF URL Section ==
  • Disallow: /tiki-view_forum_thread.php #Do Not Enable until bug5204 is fixed. Will prevent indexing. Add to SEF URL Section when bug is fixed.
  • This option will filer out multiple views of Structured Wiki Pages
  • only enable if "Open page as structure" is enabled under Admin-Wiki, so the structure is not passed via the url.
  • If existing links in your pages use the structure= in our pages, it may cause problem with Google Crawling the website.
  • Disallow: /*structure=*
  • This is to slow down any crawling so as not to put pressure on your server
  • filter out crawling that applies in all situations
  • filer out multiple views
Back to top