Log In Sign Up

helpnet.ro
robots.txt

Robots Exclusion Standard data for helpnet.ro

Resource Scan

Scan Details

Site Domain helpnet.ro
Base Domain helpnet.ro
Scan Status Ok
Last Scan2025-08-24T15:07:18+00:00
Next Scan 2025-09-07T15:07:18+00:00

Last Scan

Scanned2025-08-24T15:07:18+00:00
URL https://helpnet.ro/robots.txt
Redirect https://www.helpnet.ro/robots.txt
Redirect Domain www.helpnet.ro
Redirect Base helpnet.ro
Domain IPs 185.59.211.106
Redirect IPs 185.59.211.106
Response IP 185.59.211.106
Found Yes
Hash 8e50ced6061d4f7795930ecfd7e8779cbed0deedb3790f822a58939d8055afcc
SimHash 72979261cef2

Groups

*

Rule Path
Disallow /*?*&do=*
Disallow /*?do=*
Allow /*.webp$
Allow /*.jpg$
Allow /*.png$
Allow /*/*webp*
Allow /*/*jpg*
Allow /*/*png*
Disallow /watchdog-add-product
Disallow *?ajax=*
Disallow *?p2*&p2*p2
Disallow *?p1From=*&p1To=*
Disallow *?w=*
Disallow */transport-gratuit
Allow *?w=*&rxReservations=0&supplyPoints=0&exOpenHours=0&openSat=0&openSun=0&kraj=*

perplexitybot

Rule Path
Allow /

claudebot

Rule Path
Allow /

oai-searchbot

Rule Path
Allow /

chatgpt-user
chatgpt-user/2.0

Rule Path
Allow /

google-extended

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://www.helpnet.ro/sitemap.xml
Back to top

Comments

  • Allow AI user-agents
  • --- Perplexity ---
  • Search Primary PerplexityBot crawler that indexes sites to build the Perplexity AI search engine.
  • Search Real-time fetcher used by Claude to retrieve cited URLs during AI chat sessions.
  • --- OPENAI ---
  • Search (shows my webpages as links inside ChatGPT search). NOT used for model training.
  • User-driven browsing from ChatGPT and Custom GPTs. Acts after a human click.
  • --- GOOGLE (Gemini) ---
Back to top