testosteronepillsuk.com
robots.txt

Robots Exclusion Standard data for testosteronepillsuk.com

Resource Scan

Scan Details

Site Domain testosteronepillsuk.com
Base Domain testosteronepillsuk.com
Scan Status Ok
Last Scan2026-01-28T12:12:22+00:00
Next Scan 2026-02-27T12:12:22+00:00

Last Scan

Scanned2026-01-28T12:12:22+00:00
URL https://testosteronepillsuk.com/robots.txt
Domain IPs 104.21.24.68, 172.67.217.89
Response IP 172.67.217.89
Found Yes
Hash 54a27b83ca3e6aebbaf556b3b353ea8d255c926ddee5a9093b9b88021996cbd7
SimHash 19957a178681

Groups

*

Rule Path
Disallow /*/mfp/
Disallow /*limit%3D
Disallow /*mfp%3D
Disallow /*route%3D
Disallow /*route%3D
Disallow /*sort%3D
Disallow /*tag%3D
Disallow /admin/
Disallow /cart/
Disallow /checkout/
Disallow /create-account/
Disallow /login/
Disallow /search/
Disallow /simplecheckout/
Allow /*.css$
Allow /*.gif$
Allow /*.jpeg$
Allow /*.jpg$
Allow /*.js$
Allow /*.mp4$
Allow /*.pdf$
Allow /*.pdf$
Allow /*.png$
Allow /*.svg$
Allow /*.webp$

oai-searchbot

Rule Path
Allow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Allow /

ccbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-user

Rule Path
Allow /

claude-searchbot

Rule Path
Allow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

webzio

Rule Path
Disallow /

webzio-extended

Rule Path
Disallow /

cohere-ai

Rule Path
Allow /

cohere-training-data-crawler

Rule Path
Disallow /

perplexitybot

Rule Path
Allow /

perplexity-user

Rule Path
Allow /

facebookbot

Rule Path
Allow /

ia_archiver

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

ia_archiver-web.archive.org

Rule Path
Disallow /

Other Records

Field Value
sitemap https://testosteronepillsuk.com/sitemap.xml
sitemap https://testosteronepillsuk.com/video-sitemap.xml