stylecnc.com
robots.txt

Robots Exclusion Standard data for stylecnc.com

Resource Scan

Scan Details

Site Domain stylecnc.com
Base Domain stylecnc.com
Scan Status Ok
Last Scan2024-11-11T06:36:17+00:00
Next Scan 2024-11-18T06:36:17+00:00

Last Scan

Scanned2024-11-11T06:36:17+00:00
URL https://stylecnc.com/robots.txt
Redirect https://www.stylecnc.com/robots.txt
Redirect Domain www.stylecnc.com
Redirect Base stylecnc.com
Domain IPs 172.66.40.192, 172.66.43.64, 2606:4700:3108::ac42:28c0, 2606:4700:3108::ac42:2b40
Redirect IPs 172.66.40.192, 172.66.43.64, 2606:4700:3108::ac42:28c0, 2606:4700:3108::ac42:2b40
Response IP 172.66.43.64
Found Yes
Hash 5c5df0775af0e022beb85302f08441f06ffa83822c3a220c518d134ab29b4b6f
SimHash ee63c3b6b411

Groups

*
googlebot
googlebot-image
googlebot-news
googlebot-video
storebot-google
google-inspectiontool
googleother
google-extended
apis-google
adsbot-google-mobile
adsbot-google
mediapartners-google
feedfetcher-google
google-read-aloud
duplexweb-google
googleweblight
google-site-verification
baiduspider-video
baiduspider-news
baiduspider-image
baiduspider
msnbot-media
msnbot
bingbot
slurp
yandex
youdaobot
sogou spider

Rule Path
Allow *.html
Allow /*.html
Allow */*.html
Allow /*/*.html
Allow */*/*.html
Allow /*/*/*.html
Allow */*/*/*.html
Allow /*/*/*/*.html
Allow */*/*/*/*.html
Allow /data/rss/
Allow /data/rssmap.html
Allow /data/sitemap.html
Allow /member/index.php
Allow /cdn-cgi/scripts/7d0fa10a/cloudflare-static/rocket-loader.min.js
Disallow /publics/
Disallow /amp/
Disallow /qrcode/
Disallow /member/
Disallow /cnc/
Disallow /api/
Disallow /data/
Disallow /include/
Disallow /plus/
Disallow /templets/
Disallow /uc_client/
Disallow /error/
Disallow /cdn-cgi/
Disallow /cgi-bin/
Disallow /*.tar.gz$
Disallow /*.sql.gz$
Disallow /*.php$

nuclei
wikido
riddler
petalbot
zoominfobot
go-http-client
node/simplecrawler
cazoodlebot
dotbot/1.0
gigabot
barkrowler
blexbot
magpie-crawler

Rule Path
Disallow /

googlebot
googlebot-image
googlebot-news
googlebot-video
baiduspider-video
baiduspider-news
baiduspider-image
baiduspider
msnbot-media
msnbot
bingbot
slurp
yandex
youdaobot
sogou spider

No rules defined. All paths allowed.

Other Records

Field Value
sitemap https://www.stylecnc.com/sitemaps.xml.gz
sitemap https://www.stylecnc.com/sitemap.xml.gz
sitemap https://www.stylecnc.com/image_sitemap.xml.gz
sitemap https://www.stylecnc.com/news_sitemap.xml.gz
sitemap https://www.stylecnc.com/video_sitemap.xml.gz
sitemap https://www.stylecnc.com/video_sitemap.xml.gz
sitemap https://www.stylecnc.com/news_sitemap.xml.gz
sitemap https://www.stylecnc.com/image_sitemap.xml.gz
sitemap https://www.stylecnc.com/baidu_sitemap.xml.gz
sitemap https://www.stylecnc.com/image_sitemap.xml.gz
sitemap https://www.stylecnc.com/video_sitemap.xml.gz
sitemap https://www.stylecnc.com/sitemaps.xml.gz
sitemap https://www.stylecnc.com/360_sitemap.xml.gz

Warnings

  • 2 invalid lines.