deitycomponents.com
robots.txt
Robots Exclusion Standard data for deitycomponents.com
Resource Scan
Scan Details
| Site Domain | deitycomponents.com |
| Base Domain | deitycomponents.com |
| Scan Status | Ok |
| Last Scan | 2025-12-16T14:01:52+00:00 |
| Next Scan | 2026-01-15T14:01:52+00:00 |
Last Scan
| Scanned | 2025-12-16T14:01:52+00:00 |
| URL | https://deitycomponents.com/robots.txt |
| Redirect | https://www.deitycomponents.com/robots.txt |
| Redirect Domain | www.deitycomponents.com |
| Redirect Base | deitycomponents.com |
| Domain IPs | 199.34.228.77 |
| Redirect IPs | 199.34.228.77 |
| Response IP | 199.34.228.77 |
| Found | Yes |
| Hash | 1a4b10c3249bfa2db7a2d1212e6a3ba0c4ca7f86853b4beb238c7a4149fd6dba |
| SimHash | cb0cb069068b |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /ajax/ |
| Disallow | /apps/ |
| Disallow | /camo_copperhead_dark_room.html |
| Disallow | /rally_limited_edition_grips.html |
| Disallow | /supervillain_harlequin_edition.html |
| Disallow | /ghostface_lockjaw_dark_room.html |
| Disallow | /rally_limited_edition_saddle.html |
| Disallow | /frost_deftrap_dark_room.html |
| Disallow | /indextestsv-445629-532365-814293-971185-885467.html |
| Disallow | /supervillain-camo-drop.html |
| Disallow | /indextestsv-445629-532365.html |
| Disallow | /dark-room-purple-reign.html |
| Disallow | /we-are-hiring-845.html |
| Disallow | /sand-collection.html |
| Disallow | /indextestsv-2.html |
| Disallow | /we-are-hiring-656854.html |
| Disallow | /rally-limited-edition.html |
| Disallow | /indextestsv-445629-532365-236795.html |
| Disallow | /bladerunner-pedals.html |
| Disallow | /indextestsv-445629-532365-814293.html |
| Disallow | /purgoldskywire_dark_room.html |
| Disallow | /indextestsv-445629-150450.html |
| Disallow | /handlebars.html |
| Disallow | /dealers.html |
| Disallow | /stems.html |
| Disallow | /indextestsv-445629-462250.html |
| Disallow | /compound-nylon-pedals.html |
| Disallow | /dealers-cad.html |
| Disallow | /indextestsv-445629.html |
| Disallow | /indextestsv-324827.html |
| Disallow | /indextestsv-229912.html |
| Disallow | /indextestsv.html |
| Disallow | /index-997415.html |
| Disallow | /index-silver-593341-165292.html |
| Disallow | /index-silver.html |
| Disallow | /valve-caps.html |
| Disallow | /index-978194.html |
| Disallow | /test.html |
| Disallow | /products.html |
| Disallow | /softgoods.html |
| Disallow | /support.html |
| Disallow | /ltd-edition-recon-homepage-418427.html |
| Disallow | /ltd-edition-recon-dealers.html |
| Disallow | /mmxxiv_foryoureyesonly.html |
| Disallow | /mmxxiv_supervillain.html |
| Disallow | /mmxxiv_flattrak.html |
| Disallow | /mmxxiv_megattack.html |
| Disallow | /megattack-dark-room-raffle.html |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.deitycomponents.com/sitemap.xml |