trendhunter.com
robots.txt
Robots Exclusion Standard data for trendhunter.com
Resource Scan
Scan Details
| Site Domain | trendhunter.com |
| Base Domain | trendhunter.com |
| Scan Status | Ok |
| Last Scan | 2024-09-29T10:19:51+00:00 |
| Next Scan | 2024-10-06T10:19:51+00:00 |
Last Scan
| Scanned | 2024-09-29T10:19:51+00:00 |
| URL | https://trendhunter.com/robots.txt |
| Redirect | https://www.trendhunter.com/robots.txt |
| Redirect Domain | www.trendhunter.com |
| Redirect Base | trendhunter.com |
| Domain IPs | 67.225.198.49 |
| Redirect IPs | 192.229.144.157 |
| Response IP | 192.229.144.157 |
| Found | Yes |
| Hash | 6a14c2cffa597570f10b46bf3485a4e492d2b734bd640f34cd8ecad84e3e6135 |
| SimHash | 03660864cbb2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /thcp/ |
| Disallow | /apps/dev/* |
| Disallow | /resumes/ |
| Disallow | /resumes2/ |
| Disallow | /dev/ |
| Disallow | /pro-tools/* |
| Disallow | /preparse/* |
| Disallow | /submit-new/* |
| Disallow | /include/ |
| Disallow | /cron/* |
| Disallow | /editing/ |
| Disallow | /?URL=http%3A%2F%2F |
| Disallow | /?URL=* |
| Disallow | /embed-templates/ |
| Disallow | /embed-templates/* |
| Disallow | /pdfView-pro/ |
| Disallow | /editing/* |
| Disallow | /old-design/* |
| Disallow | /trendreports/download2 |
| Disallow | /include/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.trendhunter.com/sitemapindex.xml |