runnersneed.com
robots.txt
Robots Exclusion Standard data for runnersneed.com
Resource Scan
Scan Details
| Site Domain | runnersneed.com |
| Base Domain | runnersneed.com |
| Scan Status | Ok |
| Last Scan | 2025-08-23T23:34:40+00:00 |
| Next Scan | 2025-09-06T23:34:40+00:00 |
Last Scan
| Scanned | 2025-08-23T23:34:40+00:00 |
| URL | https://runnersneed.com/robots.txt |
| Redirect | https://www.runnersneed.com/robots.txt |
| Redirect Domain | www.runnersneed.com |
| Redirect Base | runnersneed.com |
| Domain IPs | 18.161.111.104, 18.161.111.21, 18.161.111.28, 18.161.111.89, 2600:9000:23d1:2e00:f:c8b4:8900:93a1, 2600:9000:23d1:5400:f:c8b4:8900:93a1, 2600:9000:23d1:5e00:f:c8b4:8900:93a1, 2600:9000:23d1:7000:f:c8b4:8900:93a1, 2600:9000:23d1:9400:f:c8b4:8900:93a1, 2600:9000:23d1:a00:f:c8b4:8900:93a1, 2600:9000:23d1:b200:f:c8b4:8900:93a1, 2600:9000:23d1:b600:f:c8b4:8900:93a1 |
| Redirect IPs | 18.161.97.127, 18.161.97.23, 18.161.97.51, 18.161.97.99, 2600:9000:23d0:2e00:9:b4dd:a00:93a1, 2600:9000:23d0:3000:9:b4dd:a00:93a1, 2600:9000:23d0:3600:9:b4dd:a00:93a1, 2600:9000:23d0:6a00:9:b4dd:a00:93a1, 2600:9000:23d0:800:9:b4dd:a00:93a1, 2600:9000:23d0:9c00:9:b4dd:a00:93a1, 2600:9000:23d0:c600:9:b4dd:a00:93a1, 2600:9000:23d0:f000:9:b4dd:a00:93a1 |
| Response IP | 18.244.87.68 |
| Found | Yes |
| Hash | 03ecad404935d56540bda4208ad45982740c242145fa9a9b9c143298095a3ac1 |
| SimHash | 0a1dd27285d1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /api* |
| Allow | /api/aem/search* |
| Disallow | /checkout* |
| Disallow | /account* |
| Disallow | /lister.html* |
| Disallow | /cache/productmanual* |
| Disallow | /content/platform-blueprints/* |
| Disallow | /demo-pages* |
| Disallow | /clearance/* |
| Disallow | /errors.html |
| Disallow | /test/* |
| Disallow | /hosted-tokenisation.html |
| Disallow | /fredhopper-glossary.html |
| Disallow | /newsletter-confirmation.html |
| Disallow | c/fillers* |
| Disallow | /about-us/jeroen-about.html |
| Disallow | /jeroen-flush* |
| Disallow | /lister/no-results.html |
| Disallow | /temporarily-unavailable.html |
| Disallow | /Templates.html |
| Disallow | /errors.html |
| Disallow | /includes* |
| Disallow | /review* |
| Disallow | /content/experience-fragments/* |
| Disallow | /content/dam/content-fragments/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.runnersneed.com/sitemap/index.xml |