americanmuscle.com
robots.txt
Robots Exclusion Standard data for americanmuscle.com
Resource Scan
Scan Details
Site Domain | americanmuscle.com |
Base Domain | americanmuscle.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-08-09T15:43:03+00:00 |
Next Scan | 2024-11-07T15:43:03+00:00 |
Last Successful Scan
Scanned | 2023-01-16T16:12:23+00:00 |
URL | https://americanmuscle.com/robots.txt |
Redirect | https://www.americanmuscle.com/robots.txt |
Redirect Domain | www.americanmuscle.com |
Redirect Base | americanmuscle.com |
Domain IPs | 104.18.2.47, 104.18.3.47, 2606:4700::6812:22f, 2606:4700::6812:32f |
Redirect IPs | 104.18.2.47, 104.18.3.47, 2606:4700::6812:22f, 2606:4700::6812:32f |
Response IP | 104.18.2.47 |
Found | Yes |
Hash | 889e077a90ddef83dc397fe537ae4ef14e062eb6e79c318c70f7dc7c4a5a3fbd |
SimHash | 6935351dddb0 |
Groups
*
Rule | Path |
---|---|
Allow | /ajax/GetPdpPlacementByKey |
Allow | /ajax/GetVehicleCombinations |
Allow | /ajax/RichRelevanceRecommendationsBlockPlacement |
Allow | /ajax/SubCatProductPaging |
Allow | /ajax/GetPlacementForViewBought |
Allow | /ajax/reviews |
Allow | /ajax/questions |
Allow | /ajax/color-photo/* |
Allow | /ajax/photo/page |
Disallow | /cgi-bin/ |
Disallow | /RT/ |
Disallow | /TG/ |
Disallow | /QS/ |
Disallow | /wgl/ |
Disallow | /P/ |
Disallow | /ymix/ |
Disallow | /OS/ |
Disallow | /cs/ |
Disallow | /en%3D |
Disallow | /p/s%3D |
Disallow | /bt%3D |
Disallow | /sid%3D |
Disallow | /io%3D |
Disallow | /ii%3D |
Disallow | /amepiserver/ |
Disallow | /amepiserver |
Disallow | /search |
Disallow | /reviews/ |
Disallow | /photos/* |
Disallow | /ajax/* |
Disallow | /reviews/submission/* |
Disallow | /answers/submission/* |
Disallow | /catalogentrypage/* |
Disallow | /shop/ |
Disallow | /shopf150/ |
Disallow | /shopchallenger/ |
Disallow | /shopcharger/ |
Disallow | /shopcamaro/ |
Disallow | /shopmache/ |
Disallow | /shopcorvette/ |
Disallow | /link/ |
Disallow | */f/ |
Disallow | /viewmode/ |
Disallow | /productphotos/* |
Disallow | /ProductQuestionsAnswers/* |
Disallow | /questions/* |
Other Records
Field | Value |
---|---|
sitemap | https://www.americanmuscle.com/sitemap.xml |
sitemap | https://www.americanmuscle.com/video-sitemap.xml |
sitemap | https://www.americanmuscle.com/product-sitemap.xml |
sitemap | https://www.americanmuscle.com/faceted-nav-sitemap.xml |
Comments