mindhub.com
robots.txt
Robots Exclusion Standard data for mindhub.com
Resource Scan
Scan Details
| Site Domain | mindhub.com |
| Base Domain | mindhub.com |
| Scan Status | Ok |
| Last Scan | 2025-10-10T06:55:53+00:00 |
| Next Scan | 2025-11-09T06:55:53+00:00 |
Last Scan
| Scanned | 2025-10-10T06:55:53+00:00 |
| URL | https://www.mindhub.com/robots.txt |
| Domain IPs | 104.18.41.175, 172.64.146.81, 2606:4700:4402::6812:29af, 2a06:98c1:3107::ac40:9251 |
| Response IP | 104.18.41.175 |
| Found | Yes |
| Hash | 279d988d7dbdeaab8d9404db62e12b8b38b74aaa87abbee7f38091537e1aae08 |
| SimHash | 69351830c7d3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*?startIndex |
| Disallow | /admin/ |
| Disallow | /myaccount |
| Disallow | /cart* |
| Disallow | /user* |
| Disallow | /*?facetValueFilter |
| Disallow | /search |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.mindhub.com/sitemap.xml |