Log In Sign Up

beperfect.ro
robots.txt

Robots Exclusion Standard data for beperfect.ro

Resource Scan

Scan Details

Site Domain beperfect.ro
Base Domain beperfect.ro
Scan Status Ok
Last Scan2025-10-01T21:23:28+00:00
Next Scan 2025-10-31T21:23:28+00:00

Last Scan

Scanned2025-10-01T21:23:28+00:00
URL https://beperfect.ro/robots.txt
Domain IPs 45.86.220.151
Response IP 45.86.220.151
Found Yes
Hash ec16a221f3d3e41681421113a8e501590d3100e3f3c3701637fd3e794de51d05
SimHash 6093da71cef0

Groups

*

Rule Path
Allow /wp-content/uploads/
Disallow /wp-content/plugins/
Disallow /wp-admin/

perplexitybot

Rule Path
Allow /

claudebot

Rule Path
Allow /

oai-searchbot

Rule Path
Allow /

chatgpt-user
chatgpt-user/2.0

Rule Path
Allow /

google-extended

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://beperfect.ro/sitemap_index.xml
Back to top

Comments

  • Allow AI user-agents
  • --- Perplexity ---
  • Search Primary PerplexityBot crawler that indexes sites to build the Perplexity AI search engine.
  • Search Real-time fetcher used by Claude to retrieve cited URLs during AI chat sessions.
  • --- OPENAI ---
  • Search (shows my webpages as links inside ChatGPT search). NOT used for model training.
  • User-driven browsing from ChatGPT and Custom GPTs. Acts after a human click.
  • --- GOOGLE (Gemini) ---
Back to top