trailsnh.com
robots.txt
Robots Exclusion Standard data for trailsnh.com
Resource Scan
Scan Details
| Site Domain | trailsnh.com |
| Base Domain | trailsnh.com |
| Scan Status | Ok |
| Last Scan | 2024-11-13T11:05:37+00:00 |
| Next Scan | 2024-11-20T11:05:37+00:00 |
Last Scan
| Scanned | 2024-11-13T11:05:37+00:00 |
| URL | https://trailsnh.com/robots.txt |
| Domain IPs | 35.215.66.195 |
| Response IP | 35.215.66.195 |
| Found | Yes |
| Hash | f22cf2ea3aef843fb77974fa3a48558e61da0f4df9ba4ff70d3c3a99ee6c6a26 |
| SimHash | 3a1e7e476f9a |
Groups
*
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 800 |
ahrefsbot
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /URL/ |
| Disallow | /api/ |
| Disallow | /admin/ |
| Disallow | /cache/ |
| Disallow | /classes/ |
| Disallow | /includes/ |
| Disallow | /inputs/ |
| Disallow | /static/ |
| Disallow | /scripts/ |
| Disallow | /v2/ |
| Disallow | /SITE/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 400 |
googlebot
| Rule | Path |
|---|---|
| Allow | *.css |
| Allow | *.js |
| Allow | /cache/map-preview/ |
| Disallow | /URL/ |
| Disallow | /api/ |
| Disallow | /admin/ |
| Disallow | /cache/ |
| Disallow | /classes/ |
| Disallow | /detroitchicago/ |
| Disallow | /includes/ |
| Disallow | /inputs/ |
| Disallow | /static/ |
| Disallow | /scripts/ |
| Disallow | /v2/ |
| Disallow | /SITE/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 60 |
duckduckbot
| Rule | Path |
|---|---|
| Allow | *.css |
| Allow | *.js |
| Allow | /cache/map-preview/ |
| Disallow | /URL/ |
| Disallow | /api/ |
| Disallow | /admin/ |
| Disallow | /cache/ |
| Disallow | /classes/ |
| Disallow | /detroitchicago/ |
| Disallow | /includes/ |
| Disallow | /inputs/ |
| Disallow | /static/ |
| Disallow | /scripts/ |
| Disallow | /v2/ |
| Disallow | /SITE/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 60 |
bingbot
| Rule | Path |
|---|---|
| Allow | *.css |
| Allow | *.js |
| Allow | /cache/map-preview/ |
| Disallow | /URL/ |
| Disallow | /api/ |
| Disallow | /admin/ |
| Disallow | /cache/ |
| Disallow | /classes/ |
| Disallow | /includes/ |
| Disallow | /inputs/ |
| Disallow | /static/ |
| Disallow | /scripts/ |
| Disallow | /v2/ |
| Disallow | /SITE/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 60 |
Comments