mahwah.dailyvoice.com
robots.txt
Robots Exclusion Standard data for mahwah.dailyvoice.com
Resource Scan
Scan Details
Site Domain | mahwah.dailyvoice.com |
Base Domain | dailyvoice.com |
Scan Status | Ok |
Last Scan | 2024-10-23T19:12:19+00:00 |
Next Scan | 2024-11-22T19:12:19+00:00 |
Last Scan
Scanned | 2024-10-23T19:12:19+00:00 |
URL | https://mahwah.dailyvoice.com/robots.txt |
Redirect | https://dailyvoice.com/new-jersey/mahwah/robots.txt |
Redirect Domain | dailyvoice.com |
Redirect Base | dailyvoice.com |
Domain IPs | 18.213.200.186, 54.173.252.0 |
Redirect IPs | 18.213.200.186, 54.173.252.0 |
Response IP | 54.173.252.0 |
Found | Yes |
Hash | 1871b6af422d0f6beba23b93e748fd14999d13521e0a98c7f4450cbc4b7aa727 |
SimHash | 3b06de168393 |
Groups
*
Rule | Path |
---|---|
Disallow | */admin/ |
Disallow | */login/ |
Disallow | /user/ |
Disallow | /users/ |
Disallow | /places/ |
Disallow | /email/subscribe/ |
Disallow | /events/this-weekend |
Disallow | /events/tomorrow |
Disallow | /events/today |
Disallow | /events/by-date |
Disallow | /events/by-type |
Disallow | /favicon.ico |
Other Records
Field | Value |
---|---|
crawl-delay | 1 |
Other Records
Field | Value |
---|---|
sitemap | https://dailyvoice.com/sitemap.xml |