extremeterrain.com
robots.txt
Robots Exclusion Standard data for extremeterrain.com
Resource Scan
Scan Details
| Site Domain | extremeterrain.com |
| Base Domain | extremeterrain.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-08-24T10:54:57+00:00 |
| Next Scan | 2024-11-22T10:54:57+00:00 |
Last Successful Scan
| Scanned | 2023-01-31T23:03:47+00:00 |
| URL | https://extremeterrain.com/robots.txt |
| Redirect | https://www.extremeterrain.com/robots.txt |
| Redirect Domain | www.extremeterrain.com |
| Redirect Base | extremeterrain.com |
| Domain IPs | 104.18.24.121, 104.18.25.121, 2606:4700::6812:1879, 2606:4700::6812:1979 |
| Redirect IPs | 104.18.24.121, 104.18.25.121, 2606:4700::6812:1879, 2606:4700::6812:1979 |
| Response IP | 104.18.25.121 |
| Found | Yes |
| Hash | 9f3b11982b2ac8a6fe39f1e10961c2c3441ad8a4dfae4b9a2cefbe2dc5ce099d |
| SimHash | e934245ccfb8 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /ajax/GetPdpPlacementByKey |
| Allow | /ajax/GetVehicleCombinations |
| Allow | /ajax/RichRelevanceRecommendationsBlockPlacement |
| Allow | /ajax/SubCatProductPaging |
| Allow | /ajax/GetPlacementForViewBought |
| Allow | /ajax/reviews |
| Allow | /ajax/questions |
| Allow | /ajax/color-photo/* |
| Allow | /ajax/photo/page |
| Disallow | /cgi-bin/ |
| Disallow | /RT/ |
| Disallow | /TG/ |
| Disallow | /QS/ |
| Disallow | /wgl/ |
| Disallow | /P/ |
| Disallow | /ymix/ |
| Disallow | /OS/ |
| Disallow | /cs/ |
| Disallow | /en%3D |
| Disallow | /p/s%3D |
| Disallow | /bt%3D |
| Disallow | /sid%3D |
| Disallow | /io%3D |
| Disallow | /ii%3D |
| Disallow | /amepiserver/ |
| Disallow | /amepiserver |
| Disallow | /search |
| Disallow | /reviews/ |
| Disallow | /photos/* |
| Disallow | /ajax/* |
| Disallow | /reviews/submission/* |
| Disallow | /answers/submission/* |
| Disallow | /catalogentrypage/* |
| Disallow | /shop/ |
| Disallow | /shoptacoma/ |
| Disallow | /shoptundra/ |
| Disallow | /shopgladiator/ |
| Disallow | /shopbronco/ |
| Disallow | /shopfourrunner/ |
| Disallow | /link/ |
| Disallow | */f/ |
| Disallow | /viewmode/ |
| Disallow | /productphotos/* |
| Disallow | /ProductQuestionsAnswers/* |
| Disallow | /questions/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.extremeterrain.com/sitemap.xml |
| sitemap | https://www.extremeterrain.com/video-sitemap.xml |
| sitemap | https://www.extremeterrain.com/product-sitemap.xml |
| sitemap | https://www.extremeterrain.com/faceted-nav-sitemap.xml |
Comments