walkscore.com
robots.txt
Robots Exclusion Standard data for walkscore.com
Resource Scan
Scan Details
Site Domain | walkscore.com |
Base Domain | walkscore.com |
Scan Status | Ok |
Last Scan | 2024-06-27T07:01:20+00:00 |
Next Scan | 2024-07-04T07:01:20+00:00 |
Last Scan
Scanned | 2024-06-27T07:01:20+00:00 |
URL | https://www.walkscore.com/robots.txt |
Domain IPs | 52.7.182.212, 54.163.151.103, 54.197.68.202 |
Response IP | 54.163.151.103 |
Found | Yes |
Hash | 62cc2ffa1cd659814ff225c5c42d18e49cd992b075352d7511352959b78f2e80 |
SimHash | 3e2abc0c8955 |
Groups
*
Rule | Path |
---|---|
Disallow | /2008/ |
Disallow | /apartments/search/ |
Disallow | /auth/ |
Disallow | /badge/ |
Disallow | /choice/ |
Disallow | /commute/ |
Disallow | /debug |
Disallow | /homes/search/ |
Disallow | /homes-for-sale/search/ |
Disallow | /list/ |
Disallow | /nearby/ |
Disallow | /place-details/ |
Disallow | /place-category/ |
Disallow | /report/ |
Disallow | /settings |
Disallow | /serve-walkscore-tile.php |
Disallow | /serve-tile.php |
Disallow | /tile/ |
Disallow | /data/ |
Other Records
Field | Value |
---|---|
sitemap | https://s3.amazonaws.com/sitemaps.walkscore/sitemap_uni.txt |
sitemap | https://s3.amazonaws.com/sitemaps.walkscore/sitemap_cities.txt |
sitemap | https://s3.amazonaws.com/sitemaps.walkscore/sitemap_other.txt |
sitemap | https://s3.amazonaws.com/sitemaps.walkscore/sitemap_index.xml |