millerferry.com
robots.txt

Robots Exclusion Standard data for millerferry.com

Resource Scan

Scan Details

Site Domain millerferry.com
Base Domain millerferry.com
Scan Status Ok
Last Scan2025-11-17T18:04:45+00:00
Next Scan 2025-12-17T18:04:45+00:00

Last Scan

Scanned2025-11-17T18:04:45+00:00
URL https://millerferry.com/robots.txt
Domain IPs 104.21.39.52, 172.67.143.102, 2606:4700:3033::6815:2734, 2606:4700:3037::ac43:8f66
Response IP 104.21.39.52
Found Yes
Hash 9a5a4b1b12e72135319acb2a0c39b69f88c7d97feb884cc1bb33a9abf6f71e1f
SimHash 682258108df3

Groups

*

Rule Path
Disallow /

googlebot

Rule Path
Disallow
Disallow /wp-admin/
Disallow /miller-old/
Disallow /phpMyAdmin/
Disallow /Sitemap-Generator-Crawler-master/

bing-bot

Rule Path
Disallow
Disallow /wp-admin/
Disallow /miller-old/
Disallow /phpMyAdmin/
Disallow /Sitemap-Generator-Crawler-master/
Allow /wp-admin/admin-ajax.php

twitterbot

Rule Path
Allow /
Disallow /wp-admin/
Disallow /miller-old/
Disallow /phpMyAdmin/
Disallow /Sitemap-Generator-Crawler-master/

facebookexternalhit

Rule Path
Allow /
Disallow /wp-admin/
Disallow /miller-old/
Disallow /phpMyAdmin/
Disallow /Sitemap-Generator-Crawler-master/

Other Records

Field Value
sitemap https://www.millerferry.com/sitemap.xml
sitemap https://www.millerferry.com/news-sitemap.xml