tanzib.com
robots.txt

Robots Exclusion Standard data for tanzib.com

Resource Scan

Scan Details

Site Domain tanzib.com
Base Domain tanzib.com
Scan Status Ok
Last Scan2025-12-31T17:02:55+00:00
Next Scan 2026-01-30T17:02:55+00:00

Last Scan

Scanned2025-12-31T17:02:55+00:00
URL https://tanzib.com/robots.txt
Domain IPs 62.60.196.2
Response IP 62.60.196.2
Found Yes
Hash 5e5aeb99560e6771cbfb11691fc9c4efca1a5bc12211eb8f192ed5f41d2e9636
SimHash e0249ed20421

Groups

*

Rule Path Comment
Disallow /wp-admin/ -
Disallow *?s=* block access to internal search result pages
Disallow *?p=* block access to pages for which permalinks fails
Disallow *%26p%3D* block access to pages for which permalinks fails
Disallow *%26preview%3D* block access to preview pages
Disallow /cart* -
Disallow */search?q=* -
Disallow /search/ -
Disallow /wishlist* -
Disallow /checkout* -
Disallow /my-account* -
Disallow /*?remove_item=* -
Disallow /*?add-to-cart=* -
Disallow /*?login=* -
Disallow /*?type=* -
Disallow /*?page=* -
Disallow /*digits* -
Disallow /signin/* -
Disallow */feed/ -
Disallow *?per_page=* -
Disallow *stock_status%3D* -
Disallow *orderby%3D* -
Disallow *?shop_view=%3F* -
Disallow *?per_row=* -
Disallow *?lang=en* -
Disallow *?lang=ar* -
Disallow *?lang=ru* -
Disallow *opts%3D* -
Disallow /rss/ -
Disallow /comments/feed/ -
Disallow /date/ -
Disallow /comments/ -
Disallow /*?preview_id= -
Disallow /en/* -
Disallow *?clang* -
Disallow *?product_cat* -
Disallow *nocache%3D* -
Allow /wp-admin/admin-ajax.php -

*

Rule Path
Disallow /cdn-cgi/

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

petalbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://tanzib.com/mag/sitemap_index.xml
sitemap https://tanzib.com/sitemap_index.xml

Comments

  • Crawl delay for overly enthusiastic bots
  • Block PetalBot