size.name
robots.txt

Robots Exclusion Standard data for size.name

Resource Scan

Scan Details

Site Domain size.name
Base Domain size.name
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-21T05:49:19+00:00
Next Scan 2024-09-28T05:49:19+00:00

Last Successful Scan

Scanned2023-08-31T23:32:16+00:00
URL https://size.name/robots.txt
Domain IPs 104.21.11.101, 172.67.165.185, 2606:4700:3033::6815:b65, 2606:4700:3037::ac43:a5b9
Response IP 104.21.11.101
Found Yes
Hash 7a5af13240bed3277cad85a16f718d47b97a41a89d5d2af085d05faa60d4cbd4
SimHash 6c955666cc13

Groups

*

Rule Path
Disallow /cdn-cgi/
Disallow /sections/404
Disallow /admin/
Disallow /order/
Disallow /user/
Disallow /js/
Disallow /captcha/
Disallow /Smarty/
Disallow /api/
Disallow /compiled/
Disallow /cart/
Disallow /resize/
Disallow /router
Disallow /password.php
Disallow /compare*
Disallow /wishlist*
Disallow /ajax
Disallow /ajax/plug.php*
Disallow /?url=*
Disallow /*view%3D*
Disallow /go.php*
Disallow /service/
Disallow /catalog/*brand%3D*__*
Disallow /*/catalog/*brand%3D*__*

yandex

Rule Path
Disallow
Disallow /?url=*
Disallow /go.php*
Disallow /catalog/*brand%3D*__*
Disallow /*/catalog/*brand%3D*__*

semrushbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://size.name/sitemap.xml

Comments

  • Disallow: /design/

Warnings

  • `clean-param` is not a known field.