Log In Sign Up

alle-tests.nl
robots.txt

Robots Exclusion Standard data for alle-tests.nl

Resource Scan

Scan Details

Site Domain alle-tests.nl
Base Domain alle-tests.nl
Scan Status Ok
Last Scan2024-09-21T14:01:57+00:00
Next Scan 2024-09-28T14:01:57+00:00

Last Scan

Scanned2024-09-21T14:01:57+00:00
URL https://alle-tests.nl/robots.txt
Redirect https://www.alle-tests.nl/robots.txt
Redirect Domain www.alle-tests.nl
Redirect Base alle-tests.nl
Domain IPs 77.235.58.192
Redirect IPs 77.235.58.192
Response IP 77.235.58.192
Found Yes
Hash 3c0312be052b0508e888e7c0e691007592ace1a9ebfafbc8fb000b83e375116e
SimHash c8d4034244b4

Groups

*

Rule Path
Disallow /livesearch/livesearch_script/livesearch.php

ccbot
google-extended
gptbot
chatgpt-user
omgilibot
omgili
facebookbot
anthropic-ai
cohere-ai
anthropic-ai
bytespider
chatgpt
claudebot
claude-web
diffbot
facebookbot
perplexitybot

Rule Path
Disallow /

googlebot

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

googlebot-image

Rule Path
Disallow
Back to top

Other Records

Field Value
sitemap https://www.alle-tests.nl/sitemap.xml
Back to top

Comments

  • Disallow: /widget.php
  • Disallow: /illegaltest.php
  • Disallow: /newstickeronhpalg.php3
  • Disallow: /quiz*/code.php
  • Disallow: /quiz*/quizerstellung3pu.php
  • Disallow: /quiz*/mailtocreater.php
  • Disallow: /quiz*/showquizstat.php
  • Disallow: /quiz*/flash.php
  • Disallow: /recommender.php
  • Disallow: /yourquiz.php
  • Disallow: /usertest.php
  • Disallow: /*utm_source*
  • Disallow: /*utm_medium*
  • Disallow: /*utm_campaign*
  • Disallow: /*sortby!bewertung*
  • Disallow: /*sortby=*
  • Disallow: /*comments_page=*
  • Disallow: /*antwortEinzelnja=*
  • Disallow: /*pflegeja=*
  • Disallow: /*PageSpeed=*
  • Disallow: /*ved=*
  • Disallow: /*usg=*
  • Disallow: /*newsurl=*
  • Disallow: /*ModPagespeed=*
  • Disallow: /*katname=*
  • Disallow: /*erstellemail=*
  • Disallow: /*placeholder
  • User-Agent: Googlebot-Image
  • Disallow: /
  • das block die AI Robots
  • das erlaubt alles
Back to top