steroidsshop-ua.com
robots.txt

Robots Exclusion Standard data for steroidsshop-ua.com

Resource Scan

Scan Details

Site Domain steroidsshop-ua.com
Base Domain steroidsshop-ua.com
Scan Status Ok
Last Scan2025-09-19T23:27:54+00:00
Next Scan 2025-10-19T23:27:54+00:00

Last Scan

Scanned2025-09-19T23:27:54+00:00
URL https://steroidsshop-ua.com/robots.txt
Domain IPs 104.21.15.106, 172.67.162.45, 2606:4700:3037::6815:f6a, 2606:4700:3037::ac43:a22d
Response IP 172.67.162.45
Found Yes
Hash 72669c619b50a58664ddf23a0ef0fb9bdd2ec107ac38f0cc67285b470c4970cf
SimHash 2995391e0281

Groups

*

Rule Path
Disallow /*filter%3D*
Disallow /*filter_description%3D*
Disallow /*filter_name%3D*
Disallow /*filter_sub_category%3D*
Disallow /*limit%3D*
Disallow /*order%3D*
Disallow /*route%3D*
Disallow /*sort%3D*
Disallow /admin/
Disallow /cdn-cgi/*
Disallow /system/
Allow /*.css$
Allow /*.jpg$
Allow /*.js$
Allow /*.mp4$
Allow /*.pdf$
Allow /*.png$
Allow /*.svg$
Allow /*.gif$
Allow /*.webp$
Allow /*.jpeg$

oai-searchbot

Rule Path
Allow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Allow /

ccbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-user

Rule Path
Allow /

claude-searchbot

Rule Path
Allow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

webzio

Rule Path
Disallow /

webzio-extended

Rule Path
Disallow /

cohere-ai

Rule Path
Allow /

cohere-training-data-crawler

Rule Path
Disallow /

perplexitybot

Rule Path
Allow /

perplexity-user

Rule Path
Allow /

facebookbot

Rule Path
Allow /

ia_archiver

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

ia_archiver-web.archive.org

Rule Path
Disallow /

Other Records

Field Value
sitemap https://steroidsshop-ua.com/sitemap.xml
sitemap https://steroidsshop-ua.com/image-sitemap.xml