auvio.rtbf.be
robots.txt

Robots Exclusion Standard data for auvio.rtbf.be

Resource Scan

Scan Details

Site Domain auvio.rtbf.be
Base Domain rtbf.be
Scan Status Ok
Last Scan2025-11-02T11:02:56+00:00
Next Scan 2025-11-16T11:02:56+00:00

Last Scan

Scanned2025-11-02T11:02:56+00:00
URL https://auvio.rtbf.be/robots.txt
Domain IPs 151.101.1.63, 151.101.129.63, 151.101.193.63, 151.101.65.63, 2a04:4e42:200::319, 2a04:4e42:400::319, 2a04:4e42:600::319, 2a04:4e42::319
Response IP 199.232.113.63
Found Yes
Hash 4d96eee6bde9d6bce910205bbeb047c01cefd6d22069e6887e61c1b847bc0e0f
SimHash 61059812c191

Groups

*

Rule Path
Allow /

gptbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

meta-externalfetcher

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://auvio.rtbf.be/sitemap.xml

Comments

  • GPTBot
  • Meta-ExternalAgent
  • Meta-ExternalFetcher
  • OAI-SearchBot
  • PerplexityBot