Log In Sign Up

underlayer.mef.space
robots.txt

Robots Exclusion Standard data for underlayer.mef.space

Resource Scan

Scan Details

Site Domain underlayer.mef.space
Base Domain mef.space
Scan Status Ok
Last Scan2025-12-10T18:40:25+00:00
Next Scan 2025-12-17T18:40:25+00:00

Last Scan

Scanned2025-12-10T18:40:25+00:00
URL https://underlayer.mef.space/robots.txt
Domain IPs 104.21.38.239, 172.67.168.211, 2606:4700:3031::ac43:a8d3, 2606:4700:3033::6815:26ef
Response IP 172.67.168.211
Found Yes
Hash 82cf9a6913944b6f585bd6095e2ca92214bbdd878dd8372efddf0a38175b9c8a
SimHash 2c20c8988182

Groups

*

Rule Path
Allow /
Allow /app-ads.txt
Allow /sitemap.xml
Allow /icon.png
Allow /splash.png
Allow /styles.css
Allow /translations.js
Allow /privacy.html
Allow /humans.txt
Allow /ai-meta.json
Allow /ai-context.json
Allow /ai-sitemap.txt

gptbot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

ccbot

Rule Path
Allow /

anthropic-ai

Rule Path
Allow /

claude-web

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

claude-web

Rule Path
Allow /

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

slurp

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

baiduspider

Rule Path
Allow /

google-adstxt

Rule Path
Disallow
Back to top

Other Records

Field Value
sitemap https://underlayer.mef.space/sitemap.xml
Back to top

Comments

  • AI Agent specific instructions
  • Allow all AI agents and crawlers
  • Sitemap location
  • AI Context files
  • AI-Context: https://underlayer.mef.space/ai-context.json
  • AI-Sitemap: https://underlayer.mef.space/ai-sitemap.txt
  • AI Agent Instructions
  • This site contains information about Underlayer mobile application
  • Content type: Mobile app landing page
  • Technology: LSB steganography, image processing, share intent
  • Target audience: Privacy enthusiasts, security-conscious users, steganography users
  • Languages: Russian, English
  • Platforms: Android, iOS
  • Pricing: Freemium (free with optional premium subscription)
  • Allow indexing of the entire site and specifically app-ads.txt
  • This ensures search engines and AI agents can crawl and index all content including advertising configuration
Back to top