hilary3.lat
robots.txt

Robots Exclusion Standard data for hilary3.lat

Resource Scan

Scan Details

Site Domain hilary3.lat
Base Domain hilary3.lat
Scan Status Ok
Last Scan3/22/2025, 1:14:21 AM
Next Scan 4/21/2025, 1:14:21 AM

Last Scan

Scanned3/22/2025, 1:14:21 AM
URL https://hilary3.lat/robots.txt
Redirect https://www.hilary5.lat/robots.txt
Redirect Domain www.hilary5.lat
Redirect Base hilary5.lat
Domain IPs 104.21.52.207, 172.67.203.229, 2606:4700:3030::6815:34cf, 2606:4700:3037::ac43:cbe5
Redirect IPs 104.21.52.42, 172.67.195.17, 2606:4700:3032::6815:342a, 2606:4700:3036::ac43:c311
Response IP 104.21.52.42
Found Yes
Hash 4c95b854ac259d6e0f3f540b33aa959d4f0c3452d2a8c3fbc2f76bc1089f0b29
SimHash 501c8848c8b2

Groups

*

Rule Path
Allow /wp-admin/admin-ajax.php
Disallow /wp-admin/

ia_archiver

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

twitterbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

bytedance

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.hilary5.lat/sitemap.xml