industrymoves.com
robots.txt
Robots Exclusion Standard data for industrymoves.com
Resource Scan
Scan Details
| Site Domain | industrymoves.com |
| Base Domain | industrymoves.com |
| Scan Status | Ok |
| Last Scan | 2026-01-15T02:46:14+00:00 |
| Next Scan | 2026-01-22T02:46:14+00:00 |
Last Scan
| Scanned | 2026-01-15T02:46:14+00:00 |
| URL | https://industrymoves.com/robots.txt |
| Redirect | https://www.industrymoves.com/robots.txt |
| Redirect Domain | www.industrymoves.com |
| Redirect Base | industrymoves.com |
| Domain IPs | 104.21.96.121, 172.67.180.14, 2606:4700:3033::ac43:b40e, 2606:4700:3036::6815:6079 |
| Redirect IPs | 104.21.96.121, 172.67.180.14, 2606:4700:3033::ac43:b40e, 2606:4700:3036::6815:6079 |
| Response IP | 104.21.96.121 |
| Found | Yes |
| Hash | a576f71fe00dec3aeacc3ed4585325965d8c920503e5b70add3df7bfc3eae162 |
| SimHash | e5f2fa16cb12 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /click/ad |
| Disallow | /click/ad/ |
| Disallow | /click/external |
| Disallow | /click/external/ |
| Disallow | /stat/ |
| Disallow | /newsletter/ |
| Disallow | /form_submit |
| Disallow | /form_submit/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |