webbytroops.com
robots.txt
Robots Exclusion Standard data for webbytroops.com
Resource Scan
Scan Details
Site Domain | webbytroops.com |
Base Domain | webbytroops.com |
Scan Status | Ok |
Last Scan | 2025-10-17T00:01:10+00:00 |
Next Scan | 2025-11-16T00:01:10+00:00 |
Last Scan
Scanned | 2025-10-17T00:01:10+00:00 |
URL | https://webbytroops.com/robots.txt |
Domain IPs | 104.21.95.74, 172.67.169.218, 2606:4700:3031::ac43:a9da, 2606:4700:3033::6815:5f4a |
Response IP | 172.67.169.218 |
Found | Yes |
Hash | 4ff19aa7f88966ebe0ef77e4d1265ddeda0202bc1ee6cd22868339461d0efa5e |
SimHash | a1552b7baa0c |
Groups
*
Rule | Path |
---|---|
Disallow | *?limit=* |
Disallow | *?price=* |
Disallow | *?p=* |
Disallow | /blog/tag/ |
Disallow | /blog/category/ |
Disallow | /*?b2b_compatible= |
Disallow | /*?graphql_compatible= |
Disallow | /*?marketplace_verified= |
Disallow | /*?hyva_compatible= |
Disallow | /*?marketplace_verified= |
Disallow | /*?restapi_compatible= |
Disallow | /checkout/ |
Disallow | /Customer/ |
Disallow | /customer/account/ |
Disallow | /customer/account/login/referer/ |
Disallow | /downloadable/download/sample/ |
Disallow | /cdn-cgi/ |
Disallow | /wishlist/ |
Other Records
Field | Value |
---|---|
sitemap | https://webbytroops.com/sitemap.xml |
sitemap | https://webbytroops.com/sitemap_blog.xml |
Comments