infonews.com
robots.txt

Robots Exclusion Standard data for infonews.com

Resource Scan

Scan Details

Site Domain infonews.com
Base Domain infonews.com
Scan Status Ok
Last Scan2024-11-11T01:17:14+00:00
Next Scan 2024-11-18T01:17:14+00:00

Last Scan

Scanned2024-11-11T01:17:14+00:00
URL https://infonews.com/robots.txt
Domain IPs 104.21.95.147, 172.67.145.128, 2606:4700:3030::6815:5f93, 2606:4700:3035::ac43:9180
Response IP 104.21.95.147
Found Yes
Hash 6edf3f03e14d896a0b3c3bfec7ee1784931bfdff7e7c3be1424de6aef3445084
SimHash 11559df06dd8

Groups

*

Rule Path
Disallow /backend/
Disallow /backend*/

googlebot

Rule Path
Disallow

bingbot

Rule Path
Disallow

applebot

Rule Path
Disallow

duckduckbot

Rule Path
Disallow

yandexbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

Other Records

Field Value
sitemap https://infonews.com/news.xml

Comments

  • Permitir solo bots relevantes para SEO en mercados occidentales
  • Bloquear bots no deseados