steroids-safe.com
robots.txt

Robots Exclusion Standard data for steroids-safe.com

Resource Scan

Scan Details

Site Domain steroids-safe.com
Base Domain steroids-safe.com
Scan Status Ok
Last Scan2024-06-11T18:17:15+00:00
Next Scan 2024-07-11T18:17:15+00:00

Last Scan

Scanned2024-06-11T18:17:15+00:00
URL https://steroids-safe.com/robots.txt
Domain IPs 104.21.24.37, 172.67.216.192
Response IP 104.21.24.37
Found Yes
Hash 78dbb38576ae4fad2721ea0acb5940d662d3427c7df241ae5448c28e56d9108b
SimHash c8074b58e832

Groups

*

Rule Path
Disallow */?filter=
Disallow */?filter_name=
Disallow */?filter_sub_category
Disallow */affiliate-login*
Disallow */cart/*
Disallow */checkout*
Disallow */create-account/*
Disallow */downloads*
Disallow */login/*
Disallow */mfp/*
Disallow */price/*
Disallow */search/*
Disallow */search/*
Disallow *feed*
Disallow *limit*
Disallow *route*
Disallow *sort*
Disallow /admin/
Disallow /cdn-cgi/l/email-protection
Allow *.css*
Allow *.gif*
Allow *.jpeg*
Allow *.jpg*
Allow *.js*
Allow *.mp4*
Allow *.pdf*
Allow *.png*
Allow *.svg*
Allow *.webp*

ccbot
google-extended
gptbot
chatgpt-user
omgilibot
omgili
facebookbot
anthropic-ai
cohere-ai

Rule Path
Disallow /

Other Records

Field Value
sitemap https://steroids-safe.com/sitemap.xml
sitemap https://steroids-safe.com/video-sitemap.xml