millsdentalcare.com
robots.txt

Robots Exclusion Standard data for millsdentalcare.com

Resource Scan

Scan Details

Site Domain millsdentalcare.com
Base Domain millsdentalcare.com
Scan Status Ok
Last Scan2024-11-05T07:36:43+00:00
Next Scan 2024-11-19T07:36:43+00:00

Last Scan

Scanned2024-11-05T07:36:43+00:00
URL https://millsdentalcare.com/robots.txt
Redirect https://www.millsdentalcare.com/robots.txt
Redirect Domain www.millsdentalcare.com
Redirect Base millsdentalcare.com
Domain IPs 108.156.133.39, 108.156.133.54, 108.156.133.95, 108.156.133.97
Redirect IPs 108.156.133.39, 108.156.133.54, 108.156.133.95, 108.156.133.97
Response IP 108.156.133.97
Found Yes
Hash b4ed4abe742aaf56b85048477d2534a28764bda5b5b74d63aff65270d87882e6
SimHash 71099c60a389

Groups

*

Rule Path
Disallow /dash/
Disallow /pp*
Disallow /trackback
Disallow /cgi-bin
Disallow /search
Disallow /rss
Disallow /comments/feed
Disallow /*/trackback/$
Disallow /hero_slides
Disallow /banners

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.millsdentalcare.com/sitemap.xml