testosteronesteroid.com
robots.txt

Robots Exclusion Standard data for testosteronesteroid.com

Resource Scan

Scan Details

Site Domain testosteronesteroid.com
Base Domain testosteronesteroid.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-18T20:33:35+00:00
Next Scan 2024-07-17T20:33:35+00:00

Last Successful Scan

Scanned2024-02-26T20:32:29+00:00
URL https://testosteronesteroid.com/robots.txt
Domain IPs 104.21.95.55, 172.67.143.72, 2606:4700:3035::6815:5f37, 2606:4700:3037::ac43:8f48
Response IP 172.67.143.72
Found Yes
Hash 2bd05083801933598d51a5a866556b4a30e7878ef72814fd515a6fdcf0251e5d
SimHash 000449682131

Groups

*

Rule Path
Disallow /cdn-cgi/l/email-protection
Disallow *route*
Disallow */downloads*
Disallow */checkout/*
Disallow */?limit=*
Disallow */?order=*
Disallow */%26order%3D*
Disallow */create-account*
Disallow */login/*
Disallow */price/*
Disallow */checkout*
Disallow */returns*
Disallow */?sort=*
Disallow *?search=*
Disallow */create-account*
Disallow */cart*
Disallow */transactions*
Allow *.js*
Allow *.css*
Allow *.png*
Allow *.gif*
Allow *.jpg*
Allow *.jpeg*
Allow *.svg*
Allow *.webp*
Allow *.pdf*

ccbot
google-extended
gptbot
chatgpt-user
omgilibot
omgili
facebookbot
anthropic-ai
cohere-ai

Rule Path
Disallow /

Other Records

Field Value
sitemap https://testosteronesteroid.com/sitemap.xml
sitemap https://testosteronesteroid.com/video-sitemap.xml