Log In Sign Up

brandygillmore.com
robots.txt

Robots Exclusion Standard data for brandygillmore.com

Resource Scan

Scan Details

Site Domain brandygillmore.com
Base Domain brandygillmore.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan6/14/2025, 10:49:48 AM
Next Scan 6/15/2025, 10:49:48 AM

Last Successful Scan

Scanned6/13/2025, 10:49:14 AM
URL https://brandygillmore.com/robots.txt
Domain IPs 172.66.40.138, 172.66.43.118, 2606:4700:3108::ac42:288a, 2606:4700:3108::ac42:2b76
Response IP 172.66.43.118
Found Yes
Hash 91ceb4e87ebaaa863b1d252bc5ac0e616d37e62f27aa5f8d88709cb3c1c55e39
SimHash 455dda635499

Groups

googlebot

Rule Path
Allow /
Allow *.js
Allow *.css

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

googlebot-video

Rule Path
Allow /

slurp

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

baiduspider

Rule Path
Allow /

baiduspider-image

Rule Path
Allow /

yandexbot

Rule Path
Allow /

facebot

Rule Path
Allow /

applebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

msnbot

Rule Path
Allow /

msnbot/2.0b

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

amznkassocbot

Rule Path
Allow /

ia_archiver

Rule Path
Allow /

dotbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

imagesiftbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

gptbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://brandygillmore.com/sitemap.xml
Back to top