espana-esteroide.com
robots.txt

Robots Exclusion Standard data for espana-esteroide.com

Resource Scan

Scan Details

Site Domain espana-esteroide.com
Base Domain espana-esteroide.com
Scan Status Ok
Last Scan2026-01-11T16:47:34+00:00
Next Scan 2026-02-10T16:47:34+00:00

Last Scan

Scanned2026-01-11T16:47:34+00:00
URL https://espana-esteroide.com/robots.txt
Redirect https://espanaesteroide.com/robots.txt
Redirect Domain espanaesteroide.com
Redirect Base espanaesteroide.com
Domain IPs 104.21.91.58, 172.67.167.121, 2606:4700:3035::ac43:a779, 2606:4700:3037::6815:5b3a
Redirect IPs 104.21.0.168, 172.67.128.32
Response IP 172.67.128.32
Found Yes
Hash 24d2ee860f1ae8704019795bfadc0e206af05f8a61b7e5b6b70afbc3c6cc2712
SimHash 0e35cb074401

Groups

*

Rule Path
Disallow /*route%3Daccount/
Disallow /*route%3Daffiliate/
Disallow /*route%3Dcheckout/
Disallow /*route%3Dproduct/search
Disallow /index.php?route=product%2Fproduct*&manufacturer_id=
Disallow /admin
Disallow /system
Disallow /*?sort=
Disallow /*%26sort%3D
Disallow /*?order=
Disallow /*%26order%3D
Disallow /*?limit=
Disallow /*%26limit%3D
Disallow /*?filter=
Disallow /*%26filter%3D
Disallow /*?filter_name=
Disallow /*%26filter_name%3D
Disallow /*?filter_sub_category=
Disallow /*%26filter_sub_category%3D
Disallow /*?filter_description=
Disallow */results%26page%3D*
Disallow *?route=module%2Fmega_filter*
Disallow /*?add-to-cart=*
Disallow *review%26product_id%3D*
Allow /*.css$
Allow /*.gif$
Allow /*.jpeg$
Allow /*.jpg$
Allow /*.js$
Allow /*.mp4$
Allow /*.pdf$
Allow /*.png$
Allow /*.svg$
Allow /*.webp$

oai-searchbot

Rule Path
Allow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Allow /

ccbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-user

Rule Path
Allow /

claude-searchbot

Rule Path
Allow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

webzio

Rule Path
Disallow /

webzio-extended

Rule Path
Disallow /

cohere-ai

Rule Path
Allow /

cohere-training-data-crawler

Rule Path
Disallow /

perplexitybot

Rule Path
Allow /

perplexity-user

Rule Path
Allow /

facebookbot

Rule Path
Allow /

ia_archiver

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

ia_archiver-web.archive.org

Rule Path
Disallow /

Other Records

Field Value
sitemap https://espanaesteroide.com/sitemap.xml
sitemap https://espanaesteroide.com/video-sitemap.xml