m.commerce-league.com
robots.txt

Robots Exclusion Standard data for m.commerce-league.com

Resource Scan

Scan Details

Site Domain m.commerce-league.com
Base Domain commerce-league.com
Scan Status Ok
Last Scan2024-09-23T08:12:42+00:00
Next Scan 2024-10-23T08:12:42+00:00

Last Scan

Scanned2024-09-23T08:12:42+00:00
URL https://m.commerce-league.com/robots.txt
Domain IPs 13.33.30.100, 13.33.30.101, 13.33.30.103, 13.33.30.73, 2600:9000:229f:1400:1e:8074:c840:93a1, 2600:9000:229f:1e00:1e:8074:c840:93a1, 2600:9000:229f:3200:1e:8074:c840:93a1, 2600:9000:229f:6800:1e:8074:c840:93a1, 2600:9000:229f:7600:1e:8074:c840:93a1, 2600:9000:229f:9e00:1e:8074:c840:93a1, 2600:9000:229f:b400:1e:8074:c840:93a1, 2600:9000:229f:f600:1e:8074:c840:93a1
Response IP 13.33.30.100
Found Yes
Hash 9a4cfaff4d66f86abd5d2342e5321c3c67fee8c56e83e87b6128f3a2fe5652e5
SimHash 680847600361

Groups

googlebot
yeti

Rule Path
Disallow /
Allow /$
Allow /favicon.ico
Allow /products/
Allow /reviews/
Allow /category-products
Disallow /*.gif
Disallow /*.jpg
Disallow /*.png
Disallow /products/*/

*

Rule Path
Disallow /