americantrucks.com
robots.txt
Robots Exclusion Standard data for americantrucks.com
Resource Scan
Scan Details
Site Domain | americantrucks.com |
Base Domain | americantrucks.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-08-24T01:36:48+00:00 |
Next Scan | 2024-11-22T01:36:48+00:00 |
Last Successful Scan
Scanned | 2023-01-31T06:14:31+00:00 |
URL | https://americantrucks.com/robots.txt |
Redirect | https://www.americantrucks.com/robots.txt |
Redirect Domain | www.americantrucks.com |
Redirect Base | americantrucks.com |
Domain IPs | 104.18.14.131, 104.18.15.131, 2606:4700::6812:e83, 2606:4700::6812:f83 |
Redirect IPs | 104.18.14.131, 104.18.15.131, 2606:4700::6812:e83, 2606:4700::6812:f83 |
Response IP | 104.18.15.131 |
Found | Yes |
Hash | 5a357ba86a10eb1cda8ef859be1228c0ac182d2874181f81e575c823bd51e4e4 |
SimHash | ed34275c8eb8 |
Groups
*
Rule | Path |
---|---|
Allow | /ajax/GetPdpPlacementByKey |
Allow | /ajax/GetVehicleCombinations |
Allow | /ajax/RichRelevanceRecommendationsBlockPlacement |
Allow | /ajax/SubCatProductPaging |
Allow | /ajax/GetPlacementForViewBought |
Allow | /ajax/reviews |
Allow | /ajax/questions |
Allow | /ajax/color-photo/* |
Allow | /ajax/photo/page |
Disallow | /cgi-bin/ |
Disallow | /RT/ |
Disallow | /TG/ |
Disallow | /QS/ |
Disallow | /wgl/ |
Disallow | /P/ |
Disallow | /ymix/ |
Disallow | /OS/ |
Disallow | /cs/ |
Disallow | /en%3D |
Disallow | /p/s%3D |
Disallow | /bt%3D |
Disallow | /sid%3D |
Disallow | /io%3D |
Disallow | /ii%3D |
Disallow | /amepiserver/ |
Disallow | /amepiserver |
Disallow | /atadmin |
Disallow | /search |
Disallow | /reviews/ |
Disallow | /photos/* |
Disallow | /ajax/* |
Disallow | /reviews/submission/* |
Disallow | /answers/submission/* |
Disallow | /catalogentrypage/* |
Disallow | /shop/ |
Disallow | /link/ |
Disallow | /shopsilverado/ |
Disallow | /shopsierra/ |
Disallow | /shopsierra2500/ |
Disallow | /shopsierra3500/ |
Disallow | /shopram/ |
Disallow | /shopf150/ |
Disallow | /shopf250/ |
Disallow | /shopf350/ |
Disallow | /shopranger/ |
Disallow | */f/ |
Disallow | /viewmode/ |
Disallow | /productphotos/* |
Disallow | /ProductQuestionsAnswers/* |
Disallow | /questions/* |
Other Records
Field | Value |
---|---|
sitemap | https://www.americantrucks.com/sitemap.xml |
sitemap | https://www.americantrucks.com/video-sitemap.xml |
sitemap | https://www.americantrucks.com/product-sitemap.xml |
sitemap | https://www.americantrucks.com/generic_truck_sitemap.xml |
sitemap | https://www.americantrucks.com/faceted-nav-sitemap.xml |
Comments