nutrend.com
robots.txt
Robots Exclusion Standard data for nutrend.com
Resource Scan
Scan Details
| Site Domain | nutrend.com |
| Base Domain | nutrend.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-10-07T11:17:11+00:00 |
| Next Scan | 2026-01-05T11:17:11+00:00 |
Last Successful Scan
| Scanned | 2025-02-17T11:09:24+00:00 |
| URL | https://www.nutrend.com/robots.txt |
| Domain IPs | 104.18.30.211, 104.18.31.211, 2606:4700::6812:1ed3, 2606:4700::6812:1fd3 |
| Response IP | 104.18.30.211 |
| Found | Yes |
| Hash | ce6bcff2bcbbc146c2d136dd4e866f62e21821a167052b3f47441beeed33c7e6 |
| SimHash | 4c50b05289d1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /iisnode/ |
| Disallow | /logs/ |
| Disallow | /public/ |
| Disallow | /routes/ |
| Disallow | /views/ |
| Disallow | /app.js |
| Disallow | /app_version.js |
| Disallow | /package.json |
| Disallow | /web.config |
| Disallow | /ajax/ |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.nutrend.com/sitemap/sitemap_index.xml |
Warnings
- 2 invalid lines.
Comments