mabel.jewelry
robots.txt

Robots Exclusion Standard data for mabel.jewelry

Resource Scan

Scan Details

Site Domain mabel.jewelry
Base Domain mabel.jewelry
Scan Status Ok
Last Scan2024-10-02T21:27:28+00:00
Next Scan 2024-10-09T21:27:28+00:00

Last Scan

Scanned2024-10-02T21:27:28+00:00
URL https://mabel.jewelry/robots.txt
Redirect https://www.mabel.jewelry/robots.txt
Redirect Domain www.mabel.jewelry
Redirect Base mabel.jewelry
Domain IPs 13.33.88.18, 13.33.88.27, 13.33.88.68, 13.33.88.98
Redirect IPs 13.33.88.18, 13.33.88.27, 13.33.88.68, 13.33.88.98, 2600:9000:223b:2800:0:f7f3:5e40:93a1, 2600:9000:223b:3c00:0:f7f3:5e40:93a1, 2600:9000:223b:7a00:0:f7f3:5e40:93a1, 2600:9000:223b:9a00:0:f7f3:5e40:93a1, 2600:9000:223b:aa00:0:f7f3:5e40:93a1, 2600:9000:223b:d000:0:f7f3:5e40:93a1, 2600:9000:223b:d200:0:f7f3:5e40:93a1, 2600:9000:223b:d600:0:f7f3:5e40:93a1
Response IP 13.33.88.18
Found Yes
Hash 7d0aff8f21b8b13c70a0ca51592fc8659ca50c1ece913e5b587135958743da13
SimHash 4851c952e632

Groups

*

Rule Path
Allow /

googlebot

Rule Path
Disallow /nogooglebot/

*

Rule Path
Disallow /accounts

Other Records

Field Value
sitemap https://www.mabel.jewelry/sitemap.xml
sitemap https://www.mabel.jewelry/products.xml
sitemap https://www.mabel.jewelry/catagory.xml
sitemap https://www.mabel.jewelry/blogs.xml

Comments

  • Allow all crawlers
  • Block all crawlers for /accounts