berls.com
robots.txt

Robots Exclusion Standard data for berls.com

Resource Scan

Scan Details

Site Domain berls.com
Base Domain berls.com
Scan Status Ok
Last Scan2024-05-17T10:23:10+00:00
Next Scan 2024-06-16T10:23:10+00:00

Last Scan

Scanned2024-05-17T10:23:10+00:00
URL https://www.berls.com/robots.txt
Domain IPs 23.32.29.104, 23.32.29.106
Response IP 23.52.40.107
Found Yes
Hash 8e946a9bea6382e9cd650739b2bf48d512c48ba2b0be0ab333a94c13f710b810
SimHash 810152e26bb3

Groups

*

Rule Path
Allow /
Disallow */custitem*
Disallow */pricelevel5*
Disallow */quantity%3D*
Disallow */show%3D*
Disallow */keywords%3D*
Disallow */display%3D*
Disallow */msclkid%3D*
Disallow */newReview