yoderandfrey.com
robots.txt

Robots Exclusion Standard data for yoderandfrey.com

Resource Scan

Scan Details

Site Domain yoderandfrey.com
Base Domain yoderandfrey.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-04-20T04:17:53+00:00
Next Scan 2025-06-19T04:17:53+00:00

Last Successful Scan

Scanned2025-01-28T04:15:34+00:00
URL https://yoderandfrey.com/robots.txt
Domain IPs 104.21.63.89, 172.67.145.19, 2606:4700:3030::6815:3f59, 2606:4700:3037::ac43:9113
Response IP 172.67.145.19
Found Yes
Hash dc3149eef4ae2055be39d139f8fcee9cef3ee97b94b53c1da37a747fea600ac5
SimHash ab2f2d67ea98

Groups

*

Rule Path
Disallow /aspnet_client/
Disallow /bin/
Disallow /config/
Disallow /data/
Disallow /macroScripts/
Disallow /usercontrols/
Disallow /xslt/
Disallow /*?itemId=
Disallow /*?itemsPerPage=
Disallow /*%26itemsPerPage%3D
Disallow /*?orderByField=
Disallow /*%26orderByField%3D
Disallow /*?orderByDescending=
Disallow /*%26orderByDescending%3D
Disallow /*?hasImages=
Disallow /*%26hasImages%3D
Disallow /*?gridView=
Disallow /*%26gridView%3D

scrapy:1.73+

Rule Path
Disallow /

scrapy:1.80+

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

twengabot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

Other Records

Field Value
sitemap https://yoderandfrey.com/en/google-sitemap