Log In Sign Up

atmostfear-entertainment.com
robots.txt

Robots Exclusion Standard data for atmostfear-entertainment.com

Resource Scan

Scan Details

Site Domain atmostfear-entertainment.com
Base Domain atmostfear-entertainment.com
Scan Status Ok
Last Scan2025-05-15T08:10:24+00:00
Next Scan 2025-06-14T08:10:24+00:00

Last Scan

Scanned2025-05-15T08:10:24+00:00
URL https://atmostfear-entertainment.com/robots.txt
Domain IPs 162.159.135.42
Response IP 162.159.135.42
Found Yes
Hash ac711a0dc847b52d619033c73f4ddc2d230259c032c2e1c1d7cbf7dcb5c3ba25
SimHash 716d1cc2e4ea

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-login.php
Disallow /xmlrpc.php
Disallow /wp-content/plugins/
Disallow /comments/feed/
Disallow /trackback/
Disallow /feed/
Disallow */feed/
Disallow /?s=
Disallow /?search=
Disallow /?fluentcrm=
Allow /wp-admin/admin-ajax.php
Allow /wp-content/uploads/

googlebot

Rule Path
Allow /
Allow /wp-content/uploads/

googlebot-mobile

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

googlebot-video

Rule Path
Allow /

google-extended

Rule Path Comment
Disallow / Blocking Bard/Vertex AI from using content for training

mediapartners-google

Rule Path
Allow /

bingbot

Rule Path
Allow /

bingpreview

Rule Path
Allow /

applebot

Rule Path
Allow /

yandex

Rule Path
Allow /

baiduspider

Rule Path
Allow /

baiduspider-image

Rule Path
Allow /

baiduspider-video

Rule Path
Allow /

facebookbot

Rule Path
Allow /

twitterbot

Rule Path
Allow /

ia_archiver

Rule Path
Allow /

claudebot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

anthropicai

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

perplexity-ai

Rule Path
Disallow /

common crawl

Rule Path
Disallow /

commoncrawl

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

cohere-training-data-crawler

Rule Path
Disallow /

meta-ai

Rule Path
Disallow /

metaai

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

meta-externalfetcher

Rule Path
Disallow /

gemini

Rule Path
Disallow /

deepseek

Rule Path
Disallow /

hugging face

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

open ai

Rule Path
Disallow /

ai21 labs

Rule Path
Disallow /

ai seo crawler

Rule Path
Disallow /

ai writer

Rule Path
Disallow /

crawlq ai

Rule Path
Disallow /

webchatgpt

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.atmostfear-entertainment.com/sitemap_index.xml
sitemap https://www.atmostfear-entertainment.com/news-sitemap.xml
sitemap https://www.atmostfear-entertainment.com/post-sitemap.xml
sitemap https://www.atmostfear-entertainment.com/page-sitemap.xml
sitemap https://www.atmostfear-entertainment.com/category-sitemap.xml
sitemap https://www.atmostfear-entertainment.com/product-sitemap.xml
sitemap https://www.atmostfear-entertainment.com/product_brand-sitemap.xml
sitemap https://www.atmostfear-entertainment.com/product_cat-sitemap.xml
sitemap https://www.atmostfear-entertainment.com/video-sitemap.xml
sitemap https://www.atmostfear-entertainment.com/locations.kml
Back to top

Comments

  • =====================================================
  • Atmostfear Entertainment – robots.txt
  • Purpose: Optimize crawlability, SEO visibility, and content protection
  • Last updated: 2025-04-05
  • =====================================================
  • ===========================
  • General Rules (User-agent: *)
  • ===========================
  • ===========================
  • Allow Search Engines and Social Media Bots
  • ===========================
  • ===========================
  • Block AI Content Scrapers & LLM Training Bots
  • ===========================
  • User-agent: GPTBot
  • Disallow: /
  • User-agent: OpenAI
  • Disallow: /
  • ===========================
  • Block Competitive SEO Tools (Optional)
  • ===========================
  • ===========================
  • Sitemap Index
  • ===========================
Back to top