lips-shopping.com
robots.txt

Robots Exclusion Standard data for lips-shopping.com

Resource Scan

Scan Details

Site Domain lips-shopping.com
Base Domain lips-shopping.com
Scan Status Ok
Last Scan2024-09-30T07:52:39+00:00
Next Scan 2024-10-07T07:52:39+00:00

Last Scan

Scanned2024-09-30T07:52:39+00:00
URL https://lips-shopping.com/robots.txt
Domain IPs 18.155.68.13, 18.155.68.42, 18.155.68.6, 18.155.68.65
Response IP 18.155.68.6
Found Yes
Hash c80d8e4b336c05665a46fa07051624888472f39ce6b3d13abb82913acf4d2adb
SimHash 6a15816ca4b2

Groups

gptbot
chatgpt-user
ccbot
google-extended
claudebot
anthropic-ai
facebookbot

Rule Path
Disallow /

*

Rule Path
Disallow /search
Allow /search?brandId=*
Disallow /search?brandId=*&*
Allow /search?brandId=*&categoryIds=*
Disallow /search?brandId=*&categoryIds=*&*
Disallow /search?brandId=*&*&categoryIds=*
Allow /search?categoryIds=*
Disallow /search?categoryIds=*&*
Allow /search/*
Disallow /search/*?
Disallow /webview/

Other Records

Field Value
sitemap https://lips-shopping.com/sitemaps/sitemap.xml.gz