spicebazaar.pk
robots.txt

Robots Exclusion Standard data for spicebazaar.pk

Resource Scan

Scan Details

Site Domain spicebazaar.pk
Base Domain spicebazaar.pk
Scan Status Ok
Last Scan2025-04-09T21:57:35+00:00
Next Scan 2025-05-09T21:57:35+00:00

Last Scan

Scanned2025-04-09T21:57:35+00:00
URL https://spicebazaar.pk/robots.txt
Domain IPs 104.21.95.126, 172.67.144.244, 2606:4700:3035::6815:5f7e, 2606:4700:3037::ac43:90f4
Response IP 172.67.144.244
Found Yes
Hash 16f8908e21a148609941596b8b06b559c40b7ad614f2a5ed666a032bd40ebf1a
SimHash 6b04084f85fb

Groups

*

Rule Path
Allow /

facebookexternalhit

Rule Path
Allow /
Disallow /website/ajax_cart
Disallow /show/wishlist
Disallow /place-order
Disallow /show/cart
Disallow /index.php/website/ajax_cart
Disallow /set/time
Disallow /index.php/set/time
Disallow /website/set_time
Disallow /index.php/website/set_time
Disallow /website/ajax_homepage_items
Disallow /index.php/website/ajax_homepage_items
Disallow /website/ajax_main_search
Disallow /website/ajax_menu_detail
Disallow /website/ajax_cart_view
Disallow /website/ga4
Disallow /website/ajax_delivery_charges_by_lat_log
Disallow /index.php/website/ajax_main_search
Disallow /index.php/website/ajax_menu_detail
Disallow /search?cat_filter%5B%5D
Disallow /wishlist/remove_wishlist
Disallow /wishlist/reset_wishlist
Disallow /signup/forgot_password
Disallow /website/ajax_update_branch_id
Disallow /wishlist/add_wishlist
Disallow /website/subscribe_user_by_email
Disallow /signup/generateOTP
Disallow /search
Disallow /wishlist/restore_wishlist
Disallow /website/ajax_menu_id
Disallow /*?*

Other Records

Field Value
sitemap https://spicebazaar.pk/sitemap.xml