thefaceshop.com.vn
robots.txt

Robots Exclusion Standard data for thefaceshop.com.vn

Resource Scan

Scan Details

Site Domain thefaceshop.com.vn
Base Domain thefaceshop.com.vn
Scan Status Ok
Last Scan2024-11-12T21:17:32+00:00
Next Scan 2024-12-12T21:17:32+00:00

Last Scan

Scanned2024-11-12T21:17:32+00:00
URL https://thefaceshop.com.vn/robots.txt
Domain IPs 108.156.133.103, 108.156.133.23, 108.156.133.24, 108.156.133.52
Response IP 108.156.133.24
Found Yes
Hash d68f26596ff98bb46d2f92f609cd27bc20aa8136d66cba88b3f8ef83106a14f9
SimHash 094cc5519790

Groups

*

Rule Path
Allow /

black-listed-bot

Rule Path
Disallow /500
Disallow /404
Disallow /check-out
Disallow /check-out-preview

Other Records

Field Value
sitemap https://thefaceshop.com.vn/sitemap.xml
sitemap https://thefaceshop.com.vn/api/site-map

Comments

  • *
  • black-listed-bot
  • Host
  • Sitemaps

Warnings

  • `host` is not a known field.