fairfield.dailyvoice.com
robots.txt

Robots Exclusion Standard data for fairfield.dailyvoice.com

Resource Scan

Scan Details

Site Domain fairfield.dailyvoice.com
Base Domain dailyvoice.com
Scan Status Ok
Last Scan2024-10-22T10:05:54+00:00
Next Scan 2024-11-21T10:05:54+00:00

Last Scan

Scanned2024-10-22T10:05:54+00:00
URL https://fairfield.dailyvoice.com/robots.txt
Redirect https://dailyvoice.com/connecticut/fairfield/robots.txt
Redirect Domain dailyvoice.com
Redirect Base dailyvoice.com
Domain IPs 18.213.200.186, 23.20.98.193
Redirect IPs 18.213.200.186, 23.20.98.193
Response IP 23.20.98.193
Found Yes
Hash 1871b6af422d0f6beba23b93e748fd14999d13521e0a98c7f4450cbc4b7aa727
SimHash 3b06de168393

Groups

*

Rule Path
Disallow */admin/
Disallow */login/
Disallow /user/
Disallow /users/
Disallow /places/
Disallow /email/subscribe/
Disallow /events/this-weekend
Disallow /events/tomorrow
Disallow /events/today
Disallow /events/by-date
Disallow /events/by-type
Disallow /favicon.ico

Other Records

Field Value
crawl-delay 1

facebookexternalhit

Rule Path
Disallow
Allow /

Other Records

Field Value
crawl-delay 0

Other Records

Field Value
sitemap https://dailyvoice.com/sitemap.xml