buk.mx
robots.txt

Robots Exclusion Standard data for buk.mx

Resource Scan

Scan Details

Site Domain buk.mx
Base Domain buk.mx
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-05-20T11:56:11+00:00
Next Scan 2024-08-18T11:56:11+00:00

Last Successful Scan

Scanned2023-07-03T00:25:03+00:00
URL https://www.buk.mx/robots.txt
Domain IPs 199.60.103.226, 199.60.103.30, 2606:2c40::c73c:671e, 2606:2c40::c73c:67e2
Response IP 199.60.103.226
Found Yes
Hash 42fb08837f6062146e1ce27d88f36cf4b68964fb726bc478a417cc7d1cc2d3be
SimHash 1e95ef946db1

Groups

*

Rule Path
Disallow /blog/tag
Disallow /blog/author
Disallow /_hcms/preview/
Disallow /hs/manage-preferences/
Disallow /hs/manage-preferences/
Disallow /hs*
Disallow /hs-fs*
Disallow /_hcms*
Disallow /gracias-ebook*
Disallow /_hstc*

Other Records

Field Value
sitemap https://www.buk.mx/sitemap.xml

Comments

  • Disallow all crawlers access to certain pages.