testosteronesteroid.com
robots.txt
Robots Exclusion Standard data for testosteronesteroid.com
Resource Scan
Scan Details
Site Domain | testosteronesteroid.com |
Base Domain | testosteronesteroid.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-05-18T20:33:35+00:00 |
Next Scan | 2024-07-17T20:33:35+00:00 |
Last Successful Scan
Scanned | 2024-02-26T20:32:29+00:00 |
URL | https://testosteronesteroid.com/robots.txt |
Domain IPs | 104.21.95.55, 172.67.143.72, 2606:4700:3035::6815:5f37, 2606:4700:3037::ac43:8f48 |
Response IP | 172.67.143.72 |
Found | Yes |
Hash | 2bd05083801933598d51a5a866556b4a30e7878ef72814fd515a6fdcf0251e5d |
SimHash | 000449682131 |
Groups
*
Rule | Path |
---|---|
Disallow | /cdn-cgi/l/email-protection |
Disallow | *route* |
Disallow | */downloads* |
Disallow | */checkout/* |
Disallow | */?limit=* |
Disallow | */?order=* |
Disallow | */%26order%3D* |
Disallow | */create-account* |
Disallow | */login/* |
Disallow | */price/* |
Disallow | */checkout* |
Disallow | */returns* |
Disallow | */?sort=* |
Disallow | *?search=* |
Disallow | */create-account* |
Disallow | */cart* |
Disallow | */transactions* |
Allow | *.js* |
Allow | *.css* |
Allow | *.png* |
Allow | *.gif* |
Allow | *.jpg* |
Allow | *.jpeg* |
Allow | *.svg* |
Allow | *.webp* |
Allow | *.pdf* |
Other Records
Field | Value |
---|---|
sitemap | https://testosteronesteroid.com/sitemap.xml |
sitemap | https://testosteronesteroid.com/video-sitemap.xml |