buk.pe
robots.txt

Robots Exclusion Standard data for buk.pe

Resource Scan

Scan Details

Site Domain buk.pe
Base Domain buk.pe
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-08-03T00:38:05+00:00
Next Scan 2024-11-01T00:38:05+00:00

Last Successful Scan

Scanned2023-06-18T00:08:42+00:00
URL https://www.buk.pe/robots.txt
Domain IPs 199.60.103.226, 199.60.103.30, 2606:2c40::c73c:671e, 2606:2c40::c73c:67e2
Response IP 199.60.103.30
Found Yes
Hash d3c058a2843fabb4e06fc76f3aa6405be559a8bfe5bff3aac35f56125374d4ef
SimHash 7e15cd8cedb1

Groups

*

Rule Path
Disallow /blog/tag
Disallow /blog/author
Disallow /_hcms/preview/
Disallow /hs/manage-preferences/
Disallow /hs*
Disallow /hs-fs*
Disallow /_hcms*
Disallow /gracias-ebook*
Disallow /gracias-webinar*

Other Records

Field Value
sitemap https://www.buk.pe/sitemap.xml

Comments

  • Disallow all crawlers access to certain pages.