page.albertopompeu.com
robots.txt

Robots Exclusion Standard data for page.albertopompeu.com

Resource Scan

Scan Details

Site Domain page.albertopompeu.com
Base Domain albertopompeu.com
Scan Status Ok
Last Scan2026-03-02T16:29:38+00:00
Next Scan 2026-04-01T16:29:38+00:00

Last Scan

Scanned2026-03-02T16:29:38+00:00
URL https://page.albertopompeu.com/robots.txt
Domain IPs 104.18.43.16, 172.64.144.240, 2a06:98c1:3101::ac40:90f0, 2a06:98c1:3103::6812:2b10
Response IP 104.18.43.16
Found Yes
Hash d48f13cb76fb15cf292549a653560fe3aa92f1677f32e0d9155142c1f8c1542b
SimHash 6d14da766793

Groups

*

Rule Path
Allow /

googlebot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 1

googlebot-image

Rule Path
Disallow

Other Records

Field Value
crawl-delay 1

mediapartners-google

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

adsbot-google

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

bingbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 2

slurp

Rule Path
Allow /

Other Records

Field Value
crawl-delay 2

duckduckbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 2

baiduspider

Rule Path
Allow /

Other Records

Field Value
crawl-delay 2

yandexbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 2

Other Records

Field Value
sitemap https://page.albertopompeu.com/sitemap.xml