popeek.com.br
robots.txt

Robots Exclusion Standard data for popeek.com.br

Resource Scan

Scan Details

Site Domain popeek.com.br
Base Domain popeek.com.br
Scan Status Ok
Last Scan2024-09-22T04:55:18+00:00
Next Scan 2024-09-29T04:55:18+00:00

Last Scan

Scanned2024-09-22T04:55:18+00:00
URL https://popeek.com.br/robots.txt
Domain IPs 104.21.59.65, 172.67.217.66, 2606:4700:3032::6815:3b41, 2606:4700:3033::ac43:d942
Response IP 104.21.59.65
Found Yes
Hash 189f996ff905a5822489f84a14b0a30a486f204adeea5e195a3d3bc70f6feade
SimHash 452f5105f774

Groups

googlebot

Rule Path
Allow /wp-content/uploads/*
Disallow /wp-content/*
Disallow /wp-includes/*
Disallow /wp-admin/*

Other Records

Field Value
crawl-delay 15

yahoo! slurp

Rule Path
Allow /wp-content/uploads/*
Disallow /wp-content/*
Disallow /wp-includes/*
Disallow /wp-admin/*

Other Records

Field Value
crawl-delay 15

bingbot

Rule Path
Allow /wp-content/uploads/*
Disallow /wp-content/*
Disallow /wp-includes/*
Disallow /wp-admin/*

Other Records

Field Value
crawl-delay 15

mediapartners-google

Rule Path
Allow /wp-content/uploads/*
Disallow /wp-content/*
Disallow /wp-includes/*
Disallow /wp-admin/*

Other Records

Field Value
crawl-delay 3

googlebot-images

Rule Path
Allow /wp-content/uploads/*
Disallow /wp-content/*
Disallow /wp-includes/*
Disallow /wp-admin/*