greatanabolicsteroids.com
robots.txt

Robots Exclusion Standard data for greatanabolicsteroids.com

Resource Scan

Scan Details

Site Domain greatanabolicsteroids.com
Base Domain greatanabolicsteroids.com
Scan Status Ok
Last Scan2024-05-18T01:06:56+00:00
Next Scan 2024-06-17T01:06:56+00:00

Last Scan

Scanned2024-05-18T01:06:56+00:00
URL https://greatanabolicsteroids.com/robots.txt
Domain IPs 104.21.8.243, 172.67.130.197
Response IP 104.21.8.243
Found Yes
Hash 42c0a652145a3de6b8ae77e7f1a3e80aef9b88e9c2b0a4b48db3f33b8262e0b5
SimHash 9004cf69c171

Groups

*

Rule Path
Disallow */admin*
Disallow */cart*
Disallow */cdn-cgi/*
Disallow */checkout*
Disallow */create-account*
Disallow */downloads*
Disallow */login/*
Disallow */mfp*
Disallow */page/*
Disallow */pdf/*
Disallow */returns*
Disallow */transactions*
Disallow *?limit=*
Disallow *?mfp=*
Disallow *?search=*
Disallow *?sort=*
Disallow *route*
Allow *.css*
Allow *.gif*
Allow *.jpeg*
Allow *.jpg*
Allow *.js*
Allow *.mp4*
Allow *.pdf*
Allow *.png*
Allow *.svg*
Allow *.webp*

ccbot
google-extended
gptbot
chatgpt-user
omgilibot
omgili
facebookbot
anthropic-ai
cohere-ai

Rule Path
Disallow /

Other Records

Field Value
sitemap https://greatanabolicsteroids.com/sitemap.xml
sitemap https://greatanabolicsteroids.com/video-sitemap.xml