popeek.com.br
robots.txt
Robots Exclusion Standard data for popeek.com.br
Resource Scan
Scan Details
Site Domain | popeek.com.br |
Base Domain | popeek.com.br |
Scan Status | Ok |
Last Scan | 2024-09-22T04:55:18+00:00 |
Next Scan | 2024-09-29T04:55:18+00:00 |
Last Scan
Scanned | 2024-09-22T04:55:18+00:00 |
URL | https://popeek.com.br/robots.txt |
Domain IPs | 104.21.59.65, 172.67.217.66, 2606:4700:3032::6815:3b41, 2606:4700:3033::ac43:d942 |
Response IP | 104.21.59.65 |
Found | Yes |
Hash | 189f996ff905a5822489f84a14b0a30a486f204adeea5e195a3d3bc70f6feade |
SimHash | 452f5105f774 |
Groups
googlebot
Rule | Path |
---|---|
Allow | /wp-content/uploads/* |
Disallow | /wp-content/* |
Disallow | /wp-includes/* |
Disallow | /wp-admin/* |
Other Records
Field | Value |
---|---|
crawl-delay | 15 |
yahoo! slurp
Rule | Path |
---|---|
Allow | /wp-content/uploads/* |
Disallow | /wp-content/* |
Disallow | /wp-includes/* |
Disallow | /wp-admin/* |
Other Records
Field | Value |
---|---|
crawl-delay | 15 |
bingbot
Rule | Path |
---|---|
Allow | /wp-content/uploads/* |
Disallow | /wp-content/* |
Disallow | /wp-includes/* |
Disallow | /wp-admin/* |
Other Records
Field | Value |
---|---|
crawl-delay | 15 |