Log In Sign Up

888starz7.com
robots.txt

Robots Exclusion Standard data for 888starz7.com

Resource Scan

Scan Details

Site Domain 888starz7.com
Base Domain 888starz7.com
Scan Status Ok
Last Scan2026-03-01T01:51:31+00:00
Next Scan 2026-03-08T01:51:31+00:00

Last Scan

Scanned2026-03-01T01:51:31+00:00
URL https://888starz7.com/robots.txt
Domain IPs 104.21.95.112, 172.67.144.166, 2606:4700:3031::6815:5f70, 2606:4700:3037::ac43:90a6
Response IP 172.67.144.166
Found Yes
Hash 61d829ff62ec66efb3343e2fe9a1e8f37bd2b02db88a69d743610e3112ed1aa2
SimHash 3116d351a4a7

Groups

*

Rule Path
Allow /
Allow /index.html
Allow /
Allow /blog.html
Allow /articles/
Allow /articles/*.html
Allow /contact.html
Allow /favicon.ico
Allow /favicon.png
Allow /favicon.svg
Allow /styles.css
Allow /script.js
Allow /manifest.json
Allow /sitemap.xml
Allow /robots.txt
Allow /images/
Allow /images/hero/
Allow /images/games/
Allow /images/articles/
Allow /images/blog/
Allow /images/logos/
Allow /*.jpg$
Allow /*.jpeg$
Allow /*.png$
Allow /*.gif$
Allow /*.svg$
Allow /*.webp$
Disallow /.htaccess
Disallow /.DS_Store
Disallow /r/
Disallow /admin/
Disallow /private/

googlebot

Rule Path
Allow /
Allow /images/

Other Records

Field Value
crawl-delay 1

googlebot-image

Rule Path
Allow /
Allow /images/

msnbot-media

Rule Path
Allow /
Allow /images/

bingbot

Rule Path
Allow /
Allow /images/

Other Records

Field Value
crawl-delay 1

slurp

Rule Path
Allow /
Allow /images/

Other Records

Field Value
crawl-delay 1

baiduspider

Rule Path
Allow /
Allow /images/

Other Records

Field Value
crawl-delay 2

baiduspider-image

Rule Path
Allow /
Allow /images/

sogou web spider

Rule Path
Allow /

Other Records

Field Value
crawl-delay 2

yisouspider

Rule Path
Allow /

Other Records

Field Value
crawl-delay 2

alibababot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 2

yandexbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 2

yandeximages

Rule Path
Allow /
Allow /images/

duckduckbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

yeti

Rule Path
Allow /

Other Records

Field Value
crawl-delay 2

teoma

Rule Path
Allow /

Other Records

Field Value
crawl-delay 2

pinterestbot

Rule Path
Allow /
Allow /images/

gptbot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

google-extended

Rule Path
Allow /

anthropic-ai

Rule Path
Allow /

claudebot

Rule Path
Allow /

facebookbot

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

ccbot

Rule Path
Allow /

cohere-ai

Rule Path
Allow /

applebot

Rule Path
Allow /

youbot

Rule Path
Allow /

ia_archiver

Rule Path
Allow /

bravebot

Rule Path
Allow /

twitterbot

Rule Path
Allow /
Allow /images/

linkedinbot

Rule Path
Allow /
Allow /images/

ahrefsbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 2

semrushbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 2

rogerbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 2

mj12bot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 2

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2
Back to top

Other Records

Field Value
sitemap https://888starz7.com/sitemap.xml
Back to top

Comments

  • Robots.txt - Professional Website SEO Guidelines
  • This file controls how search engines crawl and index our website
  • General bot permissions
  • === MAIN PAGES - HIGH PRIORITY FOR CRAWLING ===
  • Homepage - primary entry point
  • Blog and articles - content marketing pages
  • Contact and business pages
  • === STATIC ASSETS - ESSENTIAL FOR PAGE RENDERING ===
  • Favicons and branding
  • Stylesheets and scripts
  • PWA and mobile assets
  • SEO and crawling files
  • === MEDIA DIRECTORIES - IMAGES AND VISUAL CONTENT ===
  • All image directories for proper content indexing
  • Image file types - essential for visual content
  • === MINIMAL SECURITY - BLOCK ONLY NECESSARY ITEMS ===
  • System files that should not be crawled
  • Redirect/affiliate pages - not for search engines
  • Future-proofing: Block common sensitive areas if they exist
  • === SEARCH ENGINE SPECIFIC GUIDELINES ===
  • Google - primary search engine optimization
  • Google Images - for image indexing
  • Bing Images - for image indexing
  • Bing - secondary search engine
  • Yahoo - uses Bing but has own crawler
  • Baidu - largest search engine in China
  • Baidu Images - for image indexing in China
  • Sogou - second largest in China
  • 360 Search (So.com) - third largest in China
  • Alibaba/Shenma - mobile search in China
  • Alibaba - general Alibaba services
  • Yandex - for Russia/CIS regions
  • Yandex Images - for image indexing in Russia
  • DuckDuckGo - privacy-focused search
  • Naver - largest search engine in South Korea
  • Ask.com - general search engine
  • Pinterest - visual discovery platform
  • === AI/LLM BOTS - FOR AI SEARCH VISIBILITY ===
  • OpenAI GPTBot - ChatGPT browsing and training
  • OpenAI ChatGPT-User - ChatGPT browsing feature
  • Google Gemini/Bard - AI training and responses
  • Anthropic Claude - AI training
  • Anthropic Claude crawler
  • Meta AI - Facebook AI training
  • Perplexity AI - AI-powered search engine
  • Common Crawl - open dataset for AI training
  • Cohere AI - AI training
  • Apple AI/Siri - Applebot for AI features
  • You.com - AI-powered search engine
  • Amazon Alexa - rankings and AI
  • Brave Search - privacy-focused browser search
  • === SOCIAL MEDIA BOTS - FOR LINK PREVIEWS ===
  • Twitter/X - social media link previews
  • LinkedIn - social media link previews
  • === SEO TOOLS - FOR SEO VISIBILITY ===
  • Ahrefs - SEO analysis tool
  • SEMrush - SEO analysis tool
  • Moz - SEO analysis tool
  • Majestic - SEO backlink analysis
  • === SITEMAP LOCATION ===
  • === DEFAULT CRAWL BEHAVIOR ===
  • Polite crawl delay for all other bots
  • Last updated: Professional development team
  • Generated on: 2025-12-26 13:27:55 UTC
Back to top

Warnings

  • 3 invalid lines.
Back to top