lp.unibf.com.br
robots.txt

Robots Exclusion Standard data for lp.unibf.com.br

Resource Scan

Scan Details

Site Domain lp.unibf.com.br
Base Domain unibf.com.br
Scan Status Ok
Last Scan2026-01-31T10:49:32+00:00
Next Scan 2026-03-02T10:49:32+00:00

Last Scan

Scanned2026-01-31T10:49:32+00:00
URL https://lp.unibf.com.br/robots.txt
Domain IPs 104.18.43.16, 172.64.144.240, 2a06:98c1:3101::ac40:90f0, 2a06:98c1:3103::6812:2b10
Response IP 104.18.43.16
Found Yes
Hash 6c17bbc7a760d86350e499c665bfe4de3ee01a57a25a18d809a10115506fd43c
SimHash 6d12da726711

Groups

*

Rule Path
Allow /

googlebot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 1

googlebot-image

Rule Path
Disallow

Other Records

Field Value
crawl-delay 1

mediapartners-google

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

adsbot-google

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

bingbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 2

slurp

Rule Path
Allow /

Other Records

Field Value
crawl-delay 2

duckduckbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 2

baiduspider

Rule Path
Allow /

Other Records

Field Value
crawl-delay 2

yandexbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 2

Other Records

Field Value
sitemap https://lp.unibf.com.br/sitemap.xml