saborintenso.com
robots.txt

Robots Exclusion Standard data for saborintenso.com

Resource Scan

Scan Details

Site Domain saborintenso.com
Base Domain saborintenso.com
Scan Status Ok
Last Scan2024-11-12T10:15:20+00:00
Next Scan 2024-11-19T10:15:20+00:00

Last Scan

Scanned2024-11-12T10:15:20+00:00
URL https://saborintenso.com/robots.txt
Redirect https://www.saborintenso.com/robots.txt
Redirect Domain www.saborintenso.com
Redirect Base saborintenso.com
Domain IPs 94.46.173.60
Redirect IPs 94.46.173.60
Response IP 94.46.173.60
Found Yes
Hash 890050c5a183d6f3830296d70248c1ede9a8177d763ad1aec34770fac5c38e21
SimHash 5340d4520ed0

Groups

mediapartners-google

Rule Path
Disallow

ia_archiver

Rule Path
Allow /

*

Rule Path
Allow /ads.txt
Disallow *.php
Disallow *.jsp
Disallow *.cfm
Disallow *.asp
Disallow *.html
Disallow *.htm
Disallow *.aspx
Disallow *.cgi
Disallow /includes/
Disallow /install/
Disallow /customavatars/
Disallow /archive/
Disallow /sitemap/
Disallow /attachments/
Disallow /blogs/
Disallow /grupos/
Disallow /chef/experiencias/
Disallow /chef/receitas/
Disallow /chef/quemfez/
Disallow /chef/comentarios/
Disallow /chef/receitas-por-chef/

Other Records

Field Value
sitemap http://www.saborintenso.com/sitemap_index.xml.gz

Comments

  • Allow Archiver
  • User-agent: msnbot
  • Crawl-delay: 1
  • User-agent: bingbot
  • Crawl-delay: 1