ricksteves.com
robots.txt
Robots Exclusion Standard data for ricksteves.com
Resource Scan
Scan Details
| Site Domain | ricksteves.com |
| Base Domain | ricksteves.com |
| Scan Status | Ok |
| Last Scan | 2024-10-02T13:03:19+00:00 |
| Next Scan | 2024-11-01T13:03:19+00:00 |
Last Scan
| Scanned | 2024-10-02T13:03:19+00:00 |
| URL | https://ricksteves.com/robots.txt |
| Redirect | https://www.ricksteves.com/robots.txt |
| Redirect Domain | www.ricksteves.com |
| Redirect Base | ricksteves.com |
| Domain IPs | 104.22.42.214, 104.22.43.214, 172.67.27.15, 2606:4700:10::6816:2ad6, 2606:4700:10::6816:2bd6, 2606:4700:10::ac43:1b0f |
| Redirect IPs | 104.22.42.214, 104.22.43.214, 172.67.27.15, 2606:4700:10::6816:2ad6, 2606:4700:10::6816:2bd6, 2606:4700:10::ac43:1b0f |
| Response IP | 104.22.42.214 |
| Found | Yes |
| Hash | 0556b38ef22932261a4fc8a754fe1ceb1f57ad0e4c672602bf7f402831338028 |
| SimHash | acb13f4ded63 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /watch-read-listen/audio/radio/interviews |
| Disallow | /watch-read-listen/audio/radio/interviews/ |
| Disallow | /radio/station-support/programs |
| Disallow | /watch-read-listen/read/travel-news/ |
| Disallow | /search |
| Disallow | /europe-awaits-party/ |
| Disallow | /tv-programmers/europe-awaits-party |
Comments