Log In Sign Up

bedrijfspand.com
robots.txt

Robots Exclusion Standard data for bedrijfspand.com

Resource Scan

Scan Details

Site Domain bedrijfspand.com
Base Domain bedrijfspand.com
Scan Status Ok
Last Scan2026-01-26T19:00:21+00:00
Next Scan 2026-02-02T19:00:21+00:00

Last Scan

Scanned2026-01-26T19:00:21+00:00
URL https://bedrijfspand.com/robots.txt
Redirect https://www.bedrijfspand.com/robots.txt
Redirect Domain www.bedrijfspand.com
Redirect Base bedrijfspand.com
Domain IPs 2a02:2770:8:0:21a:4aff:fe44:d7cc, 84.22.112.54
Redirect IPs 2a02:2770:8:0:21a:4aff:fe44:d7cc, 84.22.112.54
Response IP 84.22.112.54
Found Yes
Hash ca746e0947891b31e7c9d1b425d7e906aa441790e66b03d54c3cf500a6b18289
SimHash e1111350cb22

Groups

*

Rule Path
Disallow /inloggen?*
Disallow /zoeken/
Disallow /mailform/
Disallow /tip/
Disallow /djangocms/
Disallow /data/
Disallow /dashboard/
Disallow /checkout/
Disallow /advertisement/share_count/
Disallow /*srt%3D*

oai-searchbot

Rule Path
Disallow /inloggen?*
Disallow /zoeken/
Disallow /mailform/
Disallow /tip/
Disallow /djangocms/
Disallow /data/
Disallow /dashboard/
Disallow /checkout/
Disallow /advertisement/share_count/
Disallow /*srt%3D*

chatgpt-user

Rule Path
Disallow /inloggen?*
Disallow /zoeken/
Disallow /mailform/
Disallow /tip/
Disallow /djangocms/
Disallow /data/
Disallow /dashboard/
Disallow /checkout/
Disallow /advertisement/share_count/
Disallow /*srt%3D*

gptbot

Rule Path
Disallow /

mediapartners-google*

Rule Path
Disallow /djangocms/
Disallow /data/

vagabondo
mozilla/4.0 (compatible; vagabondo/4.0; http://webagent.wise-guys.nl/)
mozilla/4.0 (compatible; vagabondo/4.0; webcrawler at wise-guys dot nl; http://webagent.wise-guys.nl/; http://www.wise-guys.nl/)
mozilla/5.0 (compatible; linux x86_64; mail.ru_bot/2.0; +http://go.mail.ru/help/robots)

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.bedrijfspand.com/sitemap.xml
Back to top

Comments

  • OpenAI Bots Configuration
  • https://platform.openai.com/docs/bots
  • Allow OAI-SearchBot for ChatGPT search features but restrict sensitive areas
  • Allow ChatGPT-User for user actions in ChatGPT and Custom GPTs but restrict sensitive areas
  • Restrict GPTBot to prevent training on our content
  • Less strict settings for AdSense bot
Back to top