americanmuscle.com
robots.txt

Robots Exclusion Standard data for americanmuscle.com

Resource Scan

Scan Details

Site Domain americanmuscle.com
Base Domain americanmuscle.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-09T15:43:03+00:00
Next Scan 2024-11-07T15:43:03+00:00

Last Successful Scan

Scanned2023-01-16T16:12:23+00:00
URL https://americanmuscle.com/robots.txt
Redirect https://www.americanmuscle.com/robots.txt
Redirect Domain www.americanmuscle.com
Redirect Base americanmuscle.com
Domain IPs 104.18.2.47, 104.18.3.47, 2606:4700::6812:22f, 2606:4700::6812:32f
Redirect IPs 104.18.2.47, 104.18.3.47, 2606:4700::6812:22f, 2606:4700::6812:32f
Response IP 104.18.2.47
Found Yes
Hash 889e077a90ddef83dc397fe537ae4ef14e062eb6e79c318c70f7dc7c4a5a3fbd
SimHash 6935351dddb0

Groups

*

Rule Path
Allow /ajax/GetPdpPlacementByKey
Allow /ajax/GetVehicleCombinations
Allow /ajax/RichRelevanceRecommendationsBlockPlacement
Allow /ajax/SubCatProductPaging
Allow /ajax/GetPlacementForViewBought
Allow /ajax/reviews
Allow /ajax/questions
Allow /ajax/color-photo/*
Allow /ajax/photo/page
Disallow /cgi-bin/
Disallow /RT/
Disallow /TG/
Disallow /QS/
Disallow /wgl/
Disallow /P/
Disallow /ymix/
Disallow /OS/
Disallow /cs/
Disallow /en%3D
Disallow /p/s%3D
Disallow /bt%3D
Disallow /sid%3D
Disallow /io%3D
Disallow /ii%3D
Disallow /amepiserver/
Disallow /amepiserver
Disallow /search
Disallow /reviews/
Disallow /photos/*
Disallow /ajax/*
Disallow /reviews/submission/*
Disallow /answers/submission/*
Disallow /catalogentrypage/*
Disallow /shop/
Disallow /shopf150/
Disallow /shopchallenger/
Disallow /shopcharger/
Disallow /shopcamaro/
Disallow /shopmache/
Disallow /shopcorvette/
Disallow /link/
Disallow */f/
Disallow /viewmode/
Disallow /productphotos/*
Disallow /ProductQuestionsAnswers/*
Disallow /questions/*

roverbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.americanmuscle.com/sitemap.xml
sitemap https://www.americanmuscle.com/video-sitemap.xml
sitemap https://www.americanmuscle.com/product-sitemap.xml
sitemap https://www.americanmuscle.com/faceted-nav-sitemap.xml

Comments

  • Cap is html
  • Rover is a bad dog <http://www.roverbot.com>
  • Sitemaps