hf-store.pk
robots.txt

Robots Exclusion Standard data for hf-store.pk

Resource Scan

Scan Details

Site Domain hf-store.pk
Base Domain hf-store.pk
Scan Status Ok
Last Scan2026-01-30T05:00:27+00:00
Next Scan 2026-03-01T05:00:27+00:00

Last Scan

Scanned2026-01-30T05:00:27+00:00
URL https://hf-store.pk/robots.txt
Domain IPs 191.101.228.92, 2a02:4780:15:1fdb:f926:cbb5:70ef:68e3, 2a02:4780:16:d258:8105:7971:a94a:ee32, 77.37.115.5
Response IP 77.37.115.124
Found Yes
Hash 2acc5f9152a0a6897e4fa343d0082b3d1f2f3c78d4b3aa1090d2ba9866abda4b
SimHash a9394b11ebd3

Groups

googlebot

Rule Path
Allow /pages/
Allow /products/
Allow /posts/
Allow /assets/
Allow /css/
Allow /js/
Allow /images/
Allow /media/
Disallow /wp-admin/
Disallow /cart/
Disallow /checkout/
Disallow /my-account/
Disallow /wishlist/
Disallow /order-received/
Disallow /track-order/
Disallow /search/
Disallow /?s=
Disallow /*add-to-cart%3D*
Disallow /*orderby%3D*
Disallow /*filter_*
Disallow /*min_price%3D*
Disallow /*max_price%3D*
Disallow /tag/
Disallow /product-tag/
Disallow /product-tag/*

googlebot-image

Rule Path
Allow /images/
Allow /media/

*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://hf-store.pk/sitemap_index.xml

Comments

  • Allow Googlebot to crawl main content, block the rest
  • Block all other bots