gtekz.com
robots.txt

Robots Exclusion Standard data for gtekz.com

Resource Scan

Scan Details

Site Domain gtekz.com
Base Domain gtekz.com
Scan Status Ok
Last Scan2025-09-16T07:31:45+00:00
Next Scan 2025-09-23T07:31:45+00:00

Last Scan

Scanned2025-09-16T07:31:45+00:00
URL https://gtekz.com/robots.txt
Domain IPs 192.0.78.174, 192.0.78.214
Response IP 192.0.78.214
Found Yes
Hash 3371a00539353e6775a4675a6b96b66855a2925d5b8eb2734d669e6b92b3d01d
SimHash 6b52db066413

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /cgi-bin/
Disallow /xmlrpc.php
Disallow /trackback/
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /readme.html
Disallow /license.txt
Disallow *?attachment_id=
Disallow *?s=
Disallow /?s=
Allow /wp-admin/admin-ajax.php
Allow /wp-content/uploads/
Allow /wp-content/themes/
Allow /wp-content/plugins/
Allow /*.css$
Allow /*.js$
Allow /*.jpg$
Allow /*.jpeg$
Allow /*.png$
Allow /*.gif$
Allow /*.svg$
Allow /*.webp$

googlebot

Rule Path
Disallow

googlebot-news

Rule Path
Disallow

mediapartners-google

Rule Path
Disallow

bingbot

Rule Path
Disallow

duckduckbot

Rule Path
Disallow

slurp

Rule Path
Disallow

baiduspider

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://gtekz.com/sitemap.xml
sitemap https://gtekz.com/news-sitemap.xml
sitemap https://gtekz.com/sitemap_index.xml
sitemap https://gtekz.com/post-sitemap.xml

Comments

  • ======== Global Settings for All Crawlers ========
  • Allow essential static resources