bsgate25.com
robots.txt
Robots Exclusion Standard data for bsgate25.com
Resource Scan
Scan Details
| Site Domain | bsgate25.com |
| Base Domain | bsgate25.com |
| Scan Status | Ok |
| Last Scan | 2025-04-05T03:05:03+00:00 |
| Next Scan | 2025-05-05T03:05:03+00:00 |
Last Scan
| Scanned | 2025-04-05T03:05:03+00:00 |
| URL | https://bsgate25.com/robots.txt |
| Domain IPs | 104.21.12.215, 172.67.167.185, 2606:4700:3030::ac43:a7b9, 2606:4700:3031::6815:cd7 |
| Response IP | 172.67.167.185 |
| Found | Yes |
| Hash | 179c3d2069e9438f418b586ac4f28ab64ba8c7af2562f4bca390ff0697c3643e |
| SimHash | 062d8b036d93 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*route%3Daccount/ |
| Disallow | /*route%3Daffiliate/ |
| Disallow | /*route%3Dcheckout/ |
| Disallow | /*route%3Dcommon/ |
| Disallow | /*route%3Dproduct/compare |
| Disallow | /*route%3Dproduct/search |
| Disallow | /*route%3Dproduct/product*%26manufacturer_id%3D |
| Disallow | /catalog/controller |
| Disallow | /catalog/language |
| Disallow | /catalog/model |
| Disallow | /download |
| Disallow | /system |
| Disallow | /search |
| Disallow | */storage/ |
| Disallow | /*?sort= |
| Disallow | /*%26sort%3D |
| Disallow | /*?order= |
| Disallow | /*%26order%3D |
| Disallow | /*?limit= |
| Disallow | /*%26limit%3D |
| Disallow | /*?filter= |
| Disallow | /*%26filter%3D |
| Disallow | /*?filter_name= |
| Disallow | /*%26filter_name%3D |
| Disallow | /*?filter_sub_category= |
| Disallow | /*%26filter_sub_category%3D |
| Disallow | /*?filter_description= |
| Disallow | /*%26filter_description%3D |
| Disallow | /*?tracking= |
| Disallow | /*%26tracking%3D |
| Disallow | /*%26tag%3D* |
| Disallow | /*?tag=* |
| Allow | *.css |
| Allow | *.js |
| Allow | *.jpg |
| Allow | *.jpeg |
| Allow | *.gif |
| Allow | *.png |
| Allow | *.svg |
| Allow | *.webp |
| Allow | *.ttf |
| Allow | *.woff |
| Allow | *.woff2 |
Comments