Log In Sign Up

ufra.com.mx
robots.txt

Robots Exclusion Standard data for ufra.com.mx

Resource Scan

Scan Details

Site Domain ufra.com.mx
Base Domain ufra.com.mx
Scan Status Ok
Last Scan2025-03-01T17:47:19+00:00
Next Scan 2025-03-31T17:47:19+00:00

Last Scan

Scanned2025-03-01T17:47:19+00:00
URL https://ufra.com.mx/robots.txt
Domain IPs 148.113.187.182
Response IP 148.113.187.182
Found Yes
Hash 87d7b40145aec8097584ec9c834ce3ef8f1689dfbcfe7a834f91301f361c1257
SimHash db1fd468ee93

Groups

amazonbot

Rule Path
Disallow /

amazon-kendra

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

crawler4j

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

duckduckbot

Rule Path
Disallow /

duckduckbot-https

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

linkedinbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

yadirectfetcher

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandexbot/3.0

Rule Path
Disallow /

yandexwebmaster

Rule Path
Disallow /
Back to top

Comments

  • Bots que se estan
  • Bloqueando en todos los sitios
Back to top