pixiegirl.com
robots.txt

Robots Exclusion Standard data for pixiegirl.com

Resource Scan

Scan Details

Site Domain pixiegirl.com
Base Domain pixiegirl.com
Scan Status Ok
Last Scan2025-04-24T06:45:40+00:00
Next Scan 2025-05-08T06:45:40+00:00

Last Scan

Scanned2025-04-24T06:45:40+00:00
URL https://pixiegirl.com/robots.txt
Redirect https://www.pixiegirl.com/robots.txt
Redirect Domain www.pixiegirl.com
Redirect Base pixiegirl.com
Domain IPs 104.18.42.182, 172.64.145.74, 2606:4700:4400::6812:2ab6, 2606:4700:4400::ac40:914a
Redirect IPs 104.18.42.182, 172.64.145.74, 2606:4700:4400::6812:2ab6, 2606:4700:4400::ac40:914a
Response IP 104.18.42.182
Found Yes
Hash 3c6fef99f5affb0750a95dee51b6972ef5f27054fd50af35e56cc2a86f88f715
SimHash b12cd8d56bb3

Groups

*

Rule Path
Disallow /checkout*
Disallow /Checkout*
Disallow /basket*
Disallow /Basket*
Disallow /login*
Disallow /Admin*
Disallow /account*
Disallow /*size-guide?nolayout*
Disallow /*newproductlist.aspx*
Disallow /*filter%3Dtrue*
Disallow /*f%3Dt*
Disallow /mens*
Disallow /Product/Video/
Disallow /quickview/
Disallow /outfit*
Disallow /Outfit*
Disallow /ajax/
Disallow /Ajax/
Disallow /premier-delivery
Disallow /*page%3D*
Disallow */api/*
Disallow */Api/*
Disallow */api.*
Disallow /*model%3D*
Disallow /*Model%3D*
Disallow /cdn-cgi/*
Disallow */getzoomimages*
Disallow /*?q=*
Disallow /*s%3Dinstantsearch*
Disallow /*queryid%3D*

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.pixiegirl.com/sitemap.xml

Comments

  • AllBots
  • BlockSecureAreas
  • NoIndex
  • Search
  • DiscoverSitemap