urmet.fr
robots.txt

Robots Exclusion Standard data for urmet.fr

Resource Scan

Scan Details

Site Domain urmet.fr
Base Domain urmet.fr
Scan Status Ok
Last Scan2026-02-16T07:09:53+00:00
Next Scan 2026-03-18T07:09:53+00:00

Last Scan

Scanned2026-02-16T07:09:53+00:00
URL https://urmet.fr/robots.txt
Redirect https://www.urmet.fr/robots.txt
Redirect Domain www.urmet.fr
Redirect Base urmet.fr
Domain IPs 217.147.199.224
Redirect IPs 217.147.204.81
Response IP 217.147.204.81
Found Yes
Hash 59cbd8ed5b88e8546765ff6cbc989ac73150a16520ffc220f9e909659403a464
SimHash 4d145860c759

Groups

*

Rule Path
Disallow /index.php/
Disallow /*SID%3D
Disallow /checkout/
Disallow /onestepcheckout/
Disallow /customer/
Disallow /customer/account/
Disallow /customer/account/login
Disallow /catalogsearch/
Disallow /catalog/product_compare/
Disallow /catalog/category/view/
Disallow /catalog/product/view/
Disallow /wishlist/
Disallow /*?dir*
Disallow /*?dir=desc
Disallow /*?dir=asc
Disallow /*?limit=all
Disallow /?mode

Other Records

Field Value
crawl-delay 2

Warnings

  • 11 invalid lines.
  • `noindex` is not a known field.