xat-aiuto.com
robots.txt

Robots Exclusion Standard data for xat-aiuto.com

Resource Scan

Scan Details

Site Domain xat-aiuto.com
Base Domain xat-aiuto.com
Scan Status Ok
Last Scan2025-11-29T13:29:14+00:00
Next Scan 2025-12-06T13:29:14+00:00

Last Scan

Scanned2025-11-29T13:29:14+00:00
URL https://xat-aiuto.com/robots.txt
Redirect https://www.xat-aiuto.com/robots.txt
Redirect Domain www.xat-aiuto.com
Redirect Base xat-aiuto.com
Domain IPs 188.240.228.130
Redirect IPs 188.240.228.130
Response IP 188.240.228.130
Found Yes
Hash d68686caefb79436be44715c84e108d87eb7ceb89979fd4501701d37ea860dfd
SimHash 98985e122d92

Groups

googlebot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 0

bingbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 0

slurp

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

duckduckbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

baiduspider

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

yandexbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

facebookexternalhit

Rule Path
Allow /

twitterbot

Rule Path
Allow /

linkedinbot

Rule Path
Allow /

whatsapp

Rule Path
Allow /

telegrambot

Rule Path
Allow /

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 2

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

*

Rule Path
Disallow /admin/
Disallow /config.php
Disallow /*.json$
Disallow /api-client.php
Disallow /header.php
Disallow /footer.php
Disallow /.git/
Disallow /vendor/
Allow /media/
Allow *.css$
Allow *.js$
Allow *.jpg$
Allow *.jpeg$
Allow *.png$
Allow *.gif$
Allow *.webp$
Allow *.svg$
Allow *.woff$
Allow *.woff2$

Other Records

Field Value
sitemap https://www.xat-aiuto.com/sitemap.xml
sitemap https://www.xat-aiuto.com/sitemap.xml
sitemap https://www.xat-aiuto.com/sitemap.xml
sitemap https://www.xat-aiuto.com/sitemap-articles.xml
sitemap https://www.xat-aiuto.com/sitemap-guides.xml
sitemap https://www.xat-aiuto.com/sitemap-pages.xml

Comments

  • Robots.txt per xat-aiuto.com
  • Ottimizzato per massima indicizzazione
  • Googlebot
  • Bingbot
  • Altri bot dei motori di ricerca principali
  • Bot social media per anteprima link
  • Tutti gli altri bot legittimi
  • Blocco bot spam e scraper
  • Directory da escludere per tutti i bot
  • Permetti accesso a file statici importanti
  • Sitemap
  • Host preferito

Warnings

  • `host` is not a known field.