stylecraze.com
robots.txt

Robots Exclusion Standard data for stylecraze.com

Resource Scan

Scan Details

Site Domain stylecraze.com
Base Domain stylecraze.com
Scan Status Ok
Last Scan2024-04-29T22:01:29+00:00
Next Scan 2024-05-06T22:01:29+00:00

Last Scan

Scanned2024-04-29T22:01:29+00:00
URL https://stylecraze.com/robots.txt
Redirect https://www.stylecraze.com/robots.txt
Redirect Domain www.stylecraze.com
Redirect Base stylecraze.com
Domain IPs 108.156.133.15, 108.156.133.39, 108.156.133.64, 108.156.133.99
Redirect IPs 23.52.171.241, 23.52.171.57, 2600:1413:b000:1b::17d7:707, 2600:1413:b000:1b::17d7:718
Response IP 23.52.171.241
Found Yes
Hash d44f2596119edede55b40e10a58951031aadfb447ebfeab4331ea74ff1ace65e
SimHash ea4df073f3b1

Groups

*

Product Comment
* applies to all robots
Rule Path
Disallow /inputfile1.txt
Disallow /wp-dp.php
Disallow /fork/stylecraze.html
Disallow /feed-stylecrazev44.php
Disallow /tag/
Disallow /banners/
Disallow /staging/
Disallow /activity/
Disallow /affiliates/
Disallow /questions/tags/
Disallow /disscussion-forums/
Disallow /filter-products
Disallow /xn/
Disallow /pages/
Disallow /page/
Disallow /photo/
Disallow /video/
Disallow /blog/
Disallow /profiles/
Disallow /forum/
Disallow /article/
Disallow /groups/
Disallow /comment-subscriptions
Disallow /questions/
Disallow /photos/
Disallow /videos/
Disallow /members/
Disallow /brands/
Disallow /add-blog-post/
Disallow /create/
Disallow /upload-video/
Disallow /shop/*
Disallow /blogs/
Disallow */view/slideshow/
Disallow /wp-admin/
Disallow /venus*
Disallow /fb-posts/
Disallow /links/
Disallow /mobile*
Disallow /sponsored/
Disallow /search-results/
Disallow /fblivevid.html
Disallow /members*
Disallow /*/feed/$
Disallow /v.lkqd.net/*
Disallow /*?pid=*
Disallow /*aul_class
Disallow /wp-login.php*
Disallow /giveways/*
Disallow /nootropics/*
Disallow /slideshow/*
Disallow /exclude-homepageads/*
Disallow /sc-admin-login/*
Disallow /errors/error403.htm
Disallow /pn/*
Disallow /find/*
Disallow /search/*

mj12bot

Rule Path
Disallow

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

ia_archiver

Rule Path
Disallow /

boomtrain-content-bot*

Rule Path
Disallow
Allow /*

Other Records

Field Value
sitemap https://www.stylecraze.com/sitemap_index.xml