justpiece.com
robots.txt

Robots Exclusion Standard data for justpiece.com

Resource Scan

Scan Details

Site Domain justpiece.com
Base Domain justpiece.com
Scan Status Ok
Last Scan2025-04-04T15:12:18+00:00
Next Scan 2025-04-18T15:12:18+00:00

Last Scan

Scanned2025-04-04T15:12:18+00:00
URL https://justpiece.com/robots.txt
Domain IPs 104.26.12.14, 104.26.13.14, 172.67.71.161, 2606:4700:20::681a:c0e, 2606:4700:20::681a:d0e, 2606:4700:20::ac43:47a1
Response IP 104.26.12.14
Found Yes
Hash 6b041e812a888c8f56becff1db79bc5c9e88ca0cec6e62828c5b7049e860d6b1
SimHash 71562ca08a13

Groups

*

Rule Path
Disallow /en/register/
Disallow /en/user/seller/register/
Disallow /en/login/
Disallow /admin/
Disallow /en/tel%3A%2B201278881777/
Disallow /en/resetting/
Disallow /en/e-commerce/
Disallow /en/user/
Disallow /ar/register/
Disallow /ar/user/seller/register/
Disallow /ar/login/
Disallow /ar/tel%3A%2B201278881777/
Disallow /ar/resetting/
Disallow /ar/e-commerce/
Disallow /ar/user/
Disallow /en/magazine/comment/blogger-comment-ajax/
Disallow /ar/magazine/comment/blogger-comment-ajax/
Disallow /en/product/product-review-ajax/
Disallow /ar/product/product-review-ajax/
Disallow /ar/shipping/address/calculate-shipping_price-ajax/
Disallow /en/shipping/address/calculate-shipping_price-ajax/
Disallow /ar/auto-complete
Disallow /ar/auto-complete
Disallow /en/product-review-ajax
Disallow /ar/product-review-ajax
Disallow /cdn-cgi/l/email-protection
Disallow /app_dev.php/en/
Disallow /app_dev.php/ar/

petalbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449
  • Crawl-delay: 10