techgiz.net
robots.txt

Robots Exclusion Standard data for techgiz.net

Resource Scan

Scan Details

Site Domain techgiz.net
Base Domain techgiz.net
Scan Status Ok
Last Scan2025-11-06T19:47:57+00:00
Next Scan 2025-11-13T19:47:57+00:00

Last Scan

Scanned2025-11-06T19:47:57+00:00
URL https://techgiz.net/robots.txt
Redirect https://androidfinal.com/robots.txt
Redirect Domain androidfinal.com
Redirect Base androidfinal.com
Domain IPs 104.21.44.9, 172.67.192.144, 2606:4700:3031::ac43:c090, 2606:4700:3034::6815:2c09
Redirect IPs 104.21.18.151, 172.67.182.159, 2606:4700:3032::6815:1297, 2606:4700:3033::ac43:b69f
Response IP 104.21.18.151
Found Yes
Hash 381cc2a9edbf59498a76baa3401c2b6c6f6d8b26480ae3d2090a5d7562bd3058
SimHash 405c5151e653

Groups

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

*

Rule Path
Disallow /ghost/
Disallow /email/
Disallow /members/api/comments/counts/
Disallow /r/
Disallow /webmentions/receive/
Disallow /p/
Disallow /signup/
Disallow /signin/
Disallow /account/
Disallow /members/
Disallow /private/
Disallow /admin/
Disallow /search/
Disallow /preview/
Disallow /?s=*
Allow /tag/
Allow /author/
Allow /post/
Allow /content/images/
Allow /sitemap.xml
Allow /rss/
Allow /contato/
Allow /talking-ai/
Allow /dmca/
Allow /politica-de-reembolso/
Allow /termos-de-uso/
Allow /anuncie/
Allow /sobre/
Allow /politica-de-privacidade/

googlebot-image

Rule Path
Allow /content/images/

googlebot-news

Rule Path
Allow /

Other Records

Field Value
sitemap https://androidfinal.com/sitemap.xml
sitemap https://androidfinal.com/sitemap-posts.xml
sitemap https://androidfinal.com/sitemap-pages.xml
sitemap https://androidfinal.com/sitemap-authors.xml
sitemap https://androidfinal.com/sitemap-tags.xml

Comments

  • Bloquear IAs e Scrapers
  • Crawlers normais
  • Permitir conteúdo público
  • Imagens
  • Notícias
  • Sitemaps