teamonite.mu
robots.txt

Robots Exclusion Standard data for teamonite.mu

Resource Scan

Scan Details

Site Domain teamonite.mu
Base Domain teamonite.mu
Scan Status Ok
Last Scan2024-04-26T10:46:45+00:00
Next Scan 2024-05-26T10:46:45+00:00

Last Scan

Scanned2024-04-26T10:46:45+00:00
URL https://teamonite.mu/robots.txt
Domain IPs 104.21.27.55, 172.67.141.118, 2606:4700:3030::ac43:8d76, 2606:4700:3032::6815:1b37
Response IP 104.21.27.55
Found Yes
Hash 627267909f61b2f5c1cdd20a39a726269811267821c4560639e64e109a90bfdd
SimHash 6a1ce783e7d3

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /z/j/
Disallow /z/c/
Disallow /stats/
Disallow /dh_
Disallow /tag/
Disallow /contact
Disallow /phpmanual/

googlebot

Rule Path
Disallow /*.php$
Disallow /*.js$
Disallow /*.inc$
Disallow /*.css$
Disallow /*.gz$
Disallow /*.wmv$
Disallow /*.cgi$
Disallow /*.xhtml$
Disallow /*?*

duggmirror

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow
Allow /*

mediapartners-google*

Rule Path
Disallow
Allow /*

yandex

Rule Path
Disallow /

*

Rule Path
Allow /wp-content/uploads/
Disallow /wp-admin
Disallow /wp-login.php
Disallow /wp-content/plugins/
Disallow /wp-content/updraft
Disallow /wp-content/upgrade
Disallow /wp-content/uploads/js_composer
Disallow /wp-content/uploads/revslider
Disallow /wp-content/uploads/wc-logs
Disallow /wp-content/uploads/woocommerce_uploads
Disallow /wp-content/languages
Disallow /wp/wp-admin
Disallow /wp/wp-login.php
Disallow /wp/wp-content/updraft
Disallow /wp/wp-content/upgrade
Disallow /wp/wp-content/uploads/js_composer
Disallow /wp/wp-content/uploads/revslider
Disallow /wp/wp-content/uploads/wc-logs
Disallow /wp/wp-content/uploads/woocommerce_uploads
Disallow /wp/wp-content/languages
Disallow /readme.html
Disallow /refer/

Other Records

Field Value
sitemap https://YOURDOMAIN/sitemap.xml

Comments

  • disallow all files in these directories
  • disallow all files ending with these extensions
  • disallow all files with ? in url
  • disable duggmirror
  • allow google image bot to search all images
  • allow adsense bot on entire site