harrison.dailyvoice.com
robots.txt
Robots Exclusion Standard data for harrison.dailyvoice.com
Resource Scan
Scan Details
Site Domain | harrison.dailyvoice.com |
Base Domain | dailyvoice.com |
Scan Status | Ok |
Last Scan | 2024-10-22T15:53:15+00:00 |
Next Scan | 2024-11-21T15:53:15+00:00 |
Last Scan
Scanned | 2024-10-22T15:53:15+00:00 |
URL | https://harrison.dailyvoice.com/robots.txt |
Redirect | https://dailyvoice.com/new-york/harrison/robots.txt |
Redirect Domain | dailyvoice.com |
Redirect Base | dailyvoice.com |
Domain IPs | 18.213.200.186, 23.20.98.193 |
Redirect IPs | 18.213.200.186, 23.20.98.193 |
Response IP | 23.20.98.193 |
Found | Yes |
Hash | 1871b6af422d0f6beba23b93e748fd14999d13521e0a98c7f4450cbc4b7aa727 |
SimHash | 3b06de168393 |
Groups
*
Rule | Path |
---|---|
Disallow | */admin/ |
Disallow | */login/ |
Disallow | /user/ |
Disallow | /users/ |
Disallow | /places/ |
Disallow | /email/subscribe/ |
Disallow | /events/this-weekend |
Disallow | /events/tomorrow |
Disallow | /events/today |
Disallow | /events/by-date |
Disallow | /events/by-type |
Disallow | /favicon.ico |
Other Records
Field | Value |
---|---|
crawl-delay | 1 |
Other Records
Field | Value |
---|---|
sitemap | https://dailyvoice.com/sitemap.xml |