juliahair.com
robots.txt

Robots Exclusion Standard data for juliahair.com

Resource Scan

Scan Details

Site Domain juliahair.com
Base Domain juliahair.com
Scan Status Ok
Last Scan2024-09-19T16:00:46+00:00
Next Scan 2024-10-19T16:00:46+00:00

Last Scan

Scanned2024-09-19T16:00:46+00:00
URL https://juliahair.com/robots.txt
Redirect https://www.juliahair.com/robots.txt
Redirect Domain www.juliahair.com
Redirect Base juliahair.com
Domain IPs 3.12.253.161, 3.130.248.36
Redirect IPs 23.215.7.20, 23.215.7.21, 2600:1413:b000:1b::17d7:714, 2600:1413:b000:1b::17d7:715
Response IP 23.52.40.19
Found Yes
Hash 28101af35fe4a65693eb99beca06cb61f0237c382ca2cfb7be1b9c3885148ded
SimHash bc449e298cf0

Groups

*

Rule Path
Disallow /403
Disallow /404
Disallow /cart
Disallow /order
Disallow /search?*
Disallow /*?limit=*
Disallow /*?page=*
Disallow /customer
Disallow /login
Disallow /register
Disallow /forgotpassword
Disallow /test
Disallow /data.json
Disallow /sw.js

Other Records

Field Value
sitemap https://www.juliahair.com/sitemap/sitemap.xml
sitemap https://m.juliahair.com/sitemap/sitemap.xml

Comments

  • Crawlers Setup
  • Website Sitemap
  • Paths
  • Files