sgen.com.ar
robots.txt

Robots Exclusion Standard data for sgen.com.ar

Resource Scan

Scan Details

Site Domain sgen.com.ar
Base Domain sgen.com.ar
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-01-11T10:31:40+00:00
Next Scan 2026-01-25T10:31:40+00:00

Last Successful Scan

Scanned2024-08-26T21:04:56+00:00
URL https://sgen.com.ar/robots.txt
Redirect https://www.sgen.com.ar/robots.txt
Redirect Domain www.sgen.com.ar
Redirect Base sgen.com.ar
Domain IPs 3.208.202.76
Redirect IPs 185.133.35.13, 185.133.35.14
Response IP 185.133.35.14
Found Yes
Hash 3caa7218c9094805b066036ceb7fa8acc31098fb579f8ec5de6cf3a848519c3a
SimHash 7315dc52c3d1

Groups

*

Rule Path
Disallow /admin/
Disallow /account/
Disallow /checkout/
Disallow /*?*preview_theme_installation_id*
Disallow /*?*exit_preview_theme_installation*
Disallow /comprar/
Disallow /envio/
Disallow /fb-comment/
Disallow /ar/comprar/
Disallow /ar/envio/
Disallow /ar/fb-comment/

wbsearchbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

urlmetrica

Rule Path
Disallow /

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

pinterest

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://dcdn.mitiendanube.com/stores/001/071/674/themes/common/sitemap.xml.gz

Comments

  • We use Tiendanube as our ecommerce platform: https://www.tiendanube.com