post-tenebras-lire.net
robots.txt

Robots Exclusion Standard data for post-tenebras-lire.net

Resource Scan

Scan Details

Site Domain post-tenebras-lire.net
Base Domain post-tenebras-lire.net
Scan Status Ok
Last Scan2024-10-06T12:26:46+00:00
Next Scan 2024-10-13T12:26:46+00:00

Last Scan

Scanned2024-10-06T12:26:46+00:00
URL https://post-tenebras-lire.net/robots.txt
Domain IPs 108.157.254.15, 108.157.254.3, 108.157.254.30, 108.157.254.88
Response IP 108.157.254.88
Found Yes
Hash 86f0fffde535e539399e822029e93fc014d23264512e530616e80edffc519897
SimHash 618059e3c0b0

Groups

*

Rule Path
Disallow /assets

adbeat_bot
adidxbot
adsbot-google-mobile
adsbot-google
google-adstxt

Rule Path
Disallow /

amazonbot
anthropic-ai
applebot
applebot-extended
bytespider
ccbot
chatgpt-user
claude-web
claudebot
cohere
cohere-ai
diffbot
facebookbot
google-extended
gptbot
img2dataset
omgili
omgilibot
perplexitybot
youbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

baiduspider-image
baiduspider-news
baiduspider-video
googlebot-image
googlebot-news
googlebot-video

Rule Path
Disallow /

mediapartners-google
googleother

Rule Path
Disallow /

facebookexternalhit
linkedinbot
pinterestbot
redditbot
snapchat
twitterbot
whatsapp

Rule Path
Disallow /

Other Records

Field Value
sitemap https://post-tenebras-lire.net/sitemap.xml

Comments

  • Disallow all assets (images) from indexing
  • disallow Ads
  • Disable AI
  • SEO
  • News Images and Video
  • Other Google
  • Fetchers