miniindustry.com
robots.txt
Robots Exclusion Standard data for miniindustry.com
Resource Scan
Scan Details
| Site Domain | miniindustry.com |
| Base Domain | miniindustry.com |
| Scan Status | Failed |
| Failure Reason | Scan timed out. |
| Last Scan | 2025-09-19T09:41:03+00:00 |
| Next Scan | 2025-10-03T09:41:03+00:00 |
Last Successful Scan
| Scanned | 2025-09-04T09:39:55+00:00 |
| URL | https://miniindustry.com/robots.txt |
| Redirect | https://www.miniindustry.com/robots.txt |
| Redirect Domain | www.miniindustry.com |
| Redirect Base | miniindustry.com |
| Domain IPs | 147.79.103.254, 2a02:4780:27:2006:0:1ddd:d53c:2 |
| Redirect IPs | 147.79.103.254, 2a02:4780:27:2006:0:1ddd:d53c:2 |
| Response IP | 147.79.103.254 |
| Found | Yes |
| Hash | 1349e5ca9e523cae846aa046bbe7d74cfc4636cf9ea9ab17283dca1a19f4e143 |
| SimHash | 4a10a384ea02 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cdn- |
| Disallow | /*/store- |
| Disallow | /*/page/ |
| Disallow | /*/?s= |
| Disallow | /*/tag/ |
| Disallow | /*/wp- |
| Disallow | /*/feed$ |
| Allow | /*.js$ |
| Allow | /*.css$ |
| Allow | /*.jpg$ |
| Allow | /*.png$ |
| Allow | /*.gif$ |
| Allow | /*.webp$ |
| Allow | /*.pdf$ |
| Allow | /*.js? |
| Allow | /*.css? |
| Allow | /*.jpg? |
| Allow | /*.png? |
| Allow | /*.gif? |
| Allow | /*.webp? |
| Allow | /*.pdf? |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.miniindustry.com/d/ar/sitemap_index.xml |
| sitemap | https://www.miniindustry.com/d/sitemap_index.xml |
| sitemap | https://www.miniindustry.com/molar-mass/sitemap.php |