Log In Sign Up

quizvragen.eu
robots.txt

Robots Exclusion Standard data for quizvragen.eu

Resource Scan

Scan Details

Site Domain quizvragen.eu
Base Domain quizvragen.eu
Scan Status Ok
Last Scan2025-09-27T23:51:11+00:00
Next Scan 2025-10-04T23:51:11+00:00

Last Scan

Scanned2025-09-27T23:51:11+00:00
URL https://quizvragen.eu/robots.txt
Redirect https://www.quizvragen.eu/robots.txt
Redirect Domain www.quizvragen.eu
Redirect Base quizvragen.eu
Domain IPs 2a00:1c98:1000:11d4:0:2:9444:630f, 5.134.7.2
Redirect IPs 2a00:1c98:1000:11d4:0:2:9444:630f, 5.134.7.2
Response IP 5.134.7.2
Found Yes
Hash 80c214a0865431c5a4adb4550fee055a926b9b38a5cf68d9209e9c1032527b61
SimHash 98789c5525cb

Groups

*

Rule Path
Allow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

spambot

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

emailwolf

Rule Path
Disallow /

extractorpro

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

python-urllib

Rule Path
Disallow /

java-http-client

Rule Path
Disallow /

wget

Rule Path
Disallow /

curl

Rule Path
Disallow /

httrack

Rule Path
Disallow /

nutch

Rule Path
Disallow /

crawldaddy

Rule Path
Disallow /
Disallow /functions/
Disallow /js/
Disallow /img/
Disallow /css/
Disallow /demos/
Disallow /include/
Disallow /mijn-zone/
Disallow /admin/
Disallow /foutmelding.php*
Disallow /quizkalender-detail*
Disallow /quizniveau-*
Back to top

Other Records

Field Value
sitemap https://www.quizvragen.eu/sitemap-main.xml
sitemap https://www.quizvragen.eu/sitemap-afbeeldingen.xml
sitemap https://www.quizvragen.eu/sitemap-jaar.xml
sitemap https://www.quizvragen.eu/sitemap-kalender.xml
sitemap https://www.quizvragen.eu/sitemap-quizzen.xml
sitemap https://www.quizvragen.eu/sitemap-tags.xml
Back to top

Comments

  • Blokkeren van bekende malafide scrapers en bots
Back to top