technightowl.live
robots.txt

Robots Exclusion Standard data for technightowl.live

Resource Scan

Scan Details

Site Domain technightowl.live
Base Domain technightowl.live
Scan Status Ok
Last Scan2024-09-19T17:16:54+00:00
Next Scan 2024-09-26T17:16:54+00:00

Last Scan

Scanned2024-09-19T17:16:54+00:00
URL https://technightowl.live/robots.txt
Domain IPs 104.21.81.169, 172.67.162.226, 2606:4700:3031::6815:51a9, 2606:4700:3036::ac43:a2e2
Response IP 104.21.81.169
Found Yes
Hash ad26b8680d65f037682810103c8922ad3b8e27d3694ad72fe02d9f7014d7e5e5
SimHash 095ef2076322

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /z/j/
Disallow /z/c/
Disallow /stats/
Disallow /dh_
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /contact/
Disallow /tag/
Disallow /wp-content/b
Disallow /wp-content/p
Disallow /wp-content/themes/askapache/4
Disallow /wp-content/themes/askapache/c
Disallow /wp-content/themes/askapache/d
Disallow /wp-content/themes/askapache/f
Disallow /wp-content/themes/askapache/h
Disallow /wp-content/themes/askapache/in
Disallow /wp-content/themes/askapache/p
Disallow /wp-content/themes/askapache/s
Disallow /trackback/
Disallow /*?*
Disallow */trackback/

googlebot

Rule Path
Disallow /*.php$
Disallow /*.js$
Disallow /*.inc$
Disallow /*.css$
Disallow /*.gz$
Disallow /*.cgi$
Disallow /*.wmv$
Disallow /*.png$
Disallow /*.gif$
Disallow /*.jpg$
Disallow /*.cgi$
Disallow /*.xhtml$
Disallow /*.php*
Disallow */trackback*
Disallow /*?*
Disallow /z/
Disallow /wp-*
Allow /wp-content/uploads/

googlebot-image

Rule Path
Allow /*

mediapartners-google

Rule Path
Disallow
Allow /z/
Allow /about/
Allow /contact/
Allow /wp-content/
Allow /tag/
Allow /manual/*
Allow /docs/*
Allow /*.php$
Allow /*.js$
Allow /*.inc$
Allow /*.css$
Allow /*.gz$
Allow /*.cgi$
Allow /*.wmv$
Allow /*.cgi$
Allow /*.xhtml$
Allow /*.php*
Allow /*.gif$
Allow /*.jpg$
Allow /*.png$

ia_archiver

Rule Path
Disallow /

duggmirror

Rule Path
Disallow /

*

Rule Path
Disallow /forum/calendar.php
Disallow /forum/editpost.php
Disallow /forum/member.php
Disallow /forum/memberlist.php
Disallow /forum/misc.php
Disallow /forum/newreply.php
Disallow /forum/newthread.php
Disallow /forum/printthread.php
Disallow /forum/private.php
Disallow /forum/register.php
Disallow /forum/report.php
Disallow /forum/search.php
Disallow /forum/showgroups.php
Disallow /forum/usercp.php
Disallow /forum/impressum.php
Disallow /forum/admincp/
Disallow /forum/modcp/
Disallow /forum/online.php
Disallow /forum/subscription.php
Disallow /forum/sendtofriend.php
Disallow /forum/threadrate.php
Disallow /forum/poll.php
Disallow /forum/attachment.php
Disallow /forum/avatar.php
Disallow /forum/faq.php
Disallow /forum/usercp.php
Disallow /forum/profile.php

Comments

  • disallow all files in these directories
  • disallow all files ending with these extensions
  • allow google image bot to search all images
  • allow adsense bot on entire site
  • disallow archiving site
  • disable duggmirror