ghdhair.com
robots.txt

Robots Exclusion Standard data for ghdhair.com

Resource Scan

Scan Details

Site Domain ghdhair.com
Base Domain ghdhair.com
Scan Status Ok
Last Scan2025-02-25T14:51:43+00:00
Next Scan 2025-03-27T14:51:43+00:00

Last Scan

Scanned2025-02-25T14:51:43+00:00
URL https://ghdhair.com/robots.txt
Redirect https://www.ghdhair.com/robots.txt
Redirect Domain www.ghdhair.com
Redirect Base ghdhair.com
Domain IPs 23.202.133.174
Redirect IPs 23.210.104.229
Response IP 23.202.133.174
Found Yes
Hash d817cd07c002d8e33ae6b3546c1fc197fc68f8fd9a84468238048d5ae945dad4
SimHash 29fc98e2d5f0

Groups

*

Rule Path
Allow /login/register$
Allow /*/login/register$
Disallow /ajax/*
Disallow /*/ajax/*
Disallow /cart/*
Disallow /*/cart/*
Disallow /cart$
Disallow /*/cart$
Disallow /checkout/*
Disallow /*/checkout/*
Disallow /checkout$
Disallow /*/checkout$
Disallow /ghd-expert/*
Disallow /*/ghd-expert/*
Disallow /ghd-training-calendar/*
Disallow /*/ghd-training-calendar/*
Disallow /people-team/*
Disallow /*/people-team/*
Disallow /buy/*
Disallow /*/buy/*
Disallow /*/send-message*
Disallow /*/offset/*
Disallow /forgotpassword*
Disallow /*/forgotpassword*
Disallow /login*
Disallow /*/login*
Disallow /category/*
Disallow /*/category/*
Disallow /submit-content*
Disallow /*/submit-content*
Disallow /pages/subscribe*
Disallow /*/pages/subscribe*
Disallow /post/view*
Disallow /*/post/view*
Disallow /collection/view*
Disallow /*/collection/view*
Disallow /profile/vip*
Disallow /*/profile/vip*
Disallow /pages$
Disallow /*/pages$
Disallow /medias/sys_master/returns/*
Disallow /*/print/order/*
Disallow /oracle/*
Disallow /*/oracle/*
Disallow /search
Disallow /*/search
Disallow /profile/*
Disallow /*/profile/*
Disallow *?PID*
Disallow *?CMP*
Disallow *?rev*
Disallow *?slide_story*
Disallow *?source*
Disallow /my-account
Disallow /*/my-account
Disallow /*jsessionid%3D*

sogou spider

Rule Path
Disallow /

haosouspider

Rule Path
Disallow /

zumbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

kraken

Rule Path
Disallow /

kraken/0.1

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

screaming frog

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.ghdhair.com/sitemap-index.xml

Comments

  • Block URLs With Session IDs

Warnings

  • 2 invalid lines.