Log In Sign Up

omroepbrabant.nl
robots.txt

Robots Exclusion Standard data for omroepbrabant.nl

Resource Scan

Scan Details

Site Domain omroepbrabant.nl
Base Domain omroepbrabant.nl
Scan Status Ok
Last Scan2025-12-24T00:10:38+00:00
Next Scan 2025-12-31T00:10:38+00:00

Last Scan

Scanned2025-12-24T00:10:38+00:00
URL https://omroepbrabant.nl/robots.txt
Redirect https://www.omroepbrabant.nl/robots.txt
Redirect Domain www.omroepbrabant.nl
Redirect Base omroepbrabant.nl
Domain IPs 104.20.36.99, 172.66.151.237, 2606:4700:10::6814:2463, 2606:4700:10::ac42:97ed
Redirect IPs 104.20.36.99, 172.66.151.237, 2606:4700:10::6814:2463, 2606:4700:10::ac42:97ed
Response IP 172.66.151.237
Found Yes
Hash 6b5d86c204a689ba1d339ed33f1644253853d66a13055f2353317f9fc9961c90
SimHash 6d11ca122581

Groups

*

Rule Path
Allow /
Disallow /?news%2F
Disallow /content/
Disallow /embedded/
Disallow /data/
Disallow /inc/
Disallow /nos/
Disallow /zoeken?q=

gptbot

Rule Path
Allow /
Disallow /?news%2F
Disallow /content/
Disallow /embedded/
Disallow /data/
Disallow /inc/
Disallow /nos/
Disallow /zoeken?q=

bingbot

Rule Path
Allow /
Disallow /?news%2F
Disallow /content/
Disallow /embedded/
Disallow /data/
Disallow /inc/
Disallow /nos/
Disallow /zoeken?q=

geminibot

Rule Path
Allow /
Disallow /?news%2F
Disallow /content/
Disallow /embedded/
Disallow /data/
Disallow /inc/
Disallow /nos/
Disallow /zoeken?q=

perplexitybot

Rule Path
Allow /
Disallow /?news%2F
Disallow /content/
Disallow /embedded/
Disallow /data/
Disallow /inc/
Disallow /nos/
Disallow /zoeken?q=

meta-externalagent

Rule Path
Allow /
Disallow /?news%2F
Disallow /content/
Disallow /embedded/
Disallow /data/
Disallow /inc/
Disallow /nos/
Disallow /zoeken?q=

googlebot-news

Rule Path
Allow /
Disallow /?news%2F
Disallow /content/
Disallow /embedded/
Disallow /data/
Disallow /inc/
Disallow /nos/
Disallow /zoeken?q=
Back to top

Other Records

Field Value
sitemap https://www.omroepbrabant.nl/sitemap.xml
Back to top

Comments

  • Main sitemap index containing all sub-sitemaps
  • Individual sitemaps (referenced in main index):
  • - sitemap-gemeenten.xml (static municipality pages)
  • - sitemap-nieuws-recent.xml (news from last month)
  • - sitemap-nieuws-YYYYMM.xml (archived news by year-month)
  • - sitemap-videos.xml (video content, optional)
Back to top

Warnings

  • 7 invalid lines.
Back to top