hairboutique.com
robots.txt
Robots Exclusion Standard data for hairboutique.com
Resource Scan
Scan Details
| Site Domain | hairboutique.com |
| Base Domain | hairboutique.com |
| Scan Status | Ok |
| Last Scan | 2024-06-27T20:37:49+00:00 |
| Next Scan | 2024-07-04T20:37:49+00:00 |
Last Scan
| Scanned | 2024-06-27T20:37:49+00:00 |
| URL | https://hairboutique.com/robots.txt |
| Redirect | https://www.hairboutique.com:443/robots.txt |
| Redirect Domain | www.hairboutique.com |
| Redirect Base | hairboutique.com |
| Domain IPs | 13.250.129.152, 2600:1f13:393:63d:2ad4:3898:9a7f:827c, 2600:1f13:393:63e:1004:3e15:f1a:6bb, 2600:1f13:393:63f:e2fe:15a2:b5f1:fde0, 54.151.156.30 |
| Redirect IPs | 104.21.17.158, 172.67.177.19, 2606:4700:3030::ac43:b113, 2606:4700:3032::6815:119e |
| Response IP | 104.21.17.158 |
| Found | Yes |
| Hash | 35680b02247e8c95e35706101eaacb7a33c690f543a07ed64279e4acd09ddea0 |
| SimHash | 3d5f4e620513 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*.css |
| Disallow | /*.js |
| Allow | / |
| Disallow | /_includes/ |
| Disallow | /_mobile/ |
| Disallow | /_private/ |
| Disallow | /_style/ |
| Disallow | /_themes/ |
| Disallow | /_templates/ |
| Disallow | /absolutepm/ |
| Disallow | /admin/ |
| Disallow | /articles_m/ |
| Disallow | /askkaren/ |
| Disallow | /askspencer/ |
| Disallow | /aspnet_client/ |
| Disallow | /books/ |
| Disallow | /burst/ |
| Disallow | /CAPTCHA/ |
| Disallow | /cgallery/ |
| Disallow | /classifieds_p/ |
| Disallow | /classes/ |
| Disallow | /Connections/ |
| Disallow | /content/ |
| Disallow | /diva/ |
| Disallow | /dressingroom_p/ |
| Disallow | /flowplayer/ |
| Disallow | /forum/ |
| Disallow | /funzone/ |
| Disallow | /gallery/ |
| Disallow | /HairFormula37/ |
| Disallow | /hairstyles_p/* |
| Disallow | /hairscope/ |
| Disallow | /HairTopia/ |
| Disallow | /holloweengallery/ |
| Disallow | /harrisheadbandgiveaway/ |
| Disallow | /hb_ads/ |
| Disallow | /hb_inventory/ |
| Disallow | /hm/ |
| Disallow | /images/ |
| Disallow | /includes/ |
| Disallow | /JerkyFlea/ |
| Disallow | /jPicker/ |
| Disallow | /jquery/ |
| Disallow | /jsgallery/ |
| Disallow | /kms/ |
| Disallow | /LHAGallery/ |
| Disallow | /hwgallery/ |
| Disallow | /mailinglist/ |
| Disallow | /menus/ |
| Disallow | /messages/ |
| Disallow | /mgallery/ |
| Disallow | /mobile/ |
| Disallow | /motm/ |
| Disallow | /mp2/ |
| Disallow | /music/ |
| Disallow | /MyHairBoutique/ |
| Disallow | /myspace/ |
| Disallow | /nbproject/ |
| Disallow | /newblogs/ |
| Disallow | /news/ |
| Disallow | /newsletters/ |
| Disallow | /pvgallery/ |
| Disallow | /polls/ |
| Disallow | /portal/ |
| Disallow | /posts/ |
| Disallow | /potm/ |
| Disallow | /press/ |
| Disallow | /PromDresses/ |
| Disallow | /qanda_p/ |
| Disallow | /recipes/ |
| Disallow | /reviews_p/ |
| Disallow | /salondirectory_p/ |
| Disallow | /scripts/ |
| Disallow | /search_p/ |
| Disallow | /sms_p/ |
| Disallow | /snippits/ |
| Disallow | /static/ |
| Disallow | /StyleStar/ |
| Disallow | /swf/ |
| Disallow | /tcgallery/ |
| Disallow | /tcmgallery/ |
| Disallow | /thecosmobar_p/ |
| Disallow | /tilhgallery/ |
| Disallow | /tipoftheday/ |
| Disallow | /tips/ |
| Disallow | /todo/ |
| Disallow | /tatoo/ |
| Disallow | /video/ |
| Disallow | /videos/ |
| Disallow | /videos_p/ |
| Disallow | /weddinggallery/ |
| Disallow | /wgallery/ |
| Disallow | /whgallery/ |
| Disallow | /work/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.hairboutique.com/sitemap.txt |