Log In Sign Up

twinkl.nl
robots.txt

Robots Exclusion Standard data for twinkl.nl

Resource Scan

Scan Details

Site Domain twinkl.nl
Base Domain twinkl.nl
Scan Status Ok
Last Scan2024-11-11T02:02:35+00:00
Next Scan 2024-11-25T02:02:35+00:00

Last Scan

Scanned2024-11-11T02:02:35+00:00
URL https://twinkl.nl/robots.txt
Redirect https://www.twinkl.nl/robots.txt
Redirect Domain www.twinkl.nl
Redirect Base twinkl.nl
Domain IPs 45.60.64.75, 45.60.71.75
Redirect IPs 45.60.66.75
Response IP 45.60.66.75
Found Yes
Hash f2f4b84bc87bb2b4d02e484dd062043c57c7159e947936a9157a1acbb28be07f
SimHash df88cb3fa880

Groups

*

Rule Path
Disallow /premium_signupandin_offer.php
Disallow /php/
Disallow /create_folder/
Disallow /fancybox/
Disallow /forum_folder/
Disallow /uploadify/
Disallow /vouchers/
Disallow /ajax-download/
Disallow /download/
Disallow /download-alt-pack/
Disallow /user/
Disallow /_Incapsula_Resource*
Disallow /search/sayt/
Disallow /create/load*
Disallow /resources/0/
Disallow /payment-thanks
Disallow /payment-thanks/
Disallow /payment
Disallow /payment/
Disallow /payments
Disallow /payments/
Disallow /a-payment/
Disallow /integration/

ahrefsbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

owlin bot v. 3.0

Rule Path
Disallow /

owlin bot

Rule Path
Disallow /

owlin

Rule Path
Disallow /

owlin domain resolver

Rule Path
Disallow /

bubing

Rule Path
Disallow /

ltx71 - (http://ltx71.com/)

Rule Path
Disallow /

riddler

Rule Path
Disallow /

expo9

Rule Path
Disallow /

idg/uk (http://spaziodati.eu/)

Rule Path
Disallow /

idg/it (http://spaziodati.eu/)

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

centurybot9@gmail.com

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

geniebot

Rule Path
Disallow /

genieo

Rule Path
Disallow /

dts agent

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

experiancrawluk

Rule Path
Disallow /

changedetection

Rule Path
Disallow /

the knowledge ai

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

um-ic

Rule Path
Disallow /

um-ic/1.0

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

proximic

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

buck

Rule Path
Disallow /

buck/2.2

Rule Path
Disallow /

buck/2.3.2

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

semrushbot-seoab

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

awariorssbot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

peer39_crawler

Rule Path
Disallow /

peer39_crawler/1.0

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

youbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-news

Rule Path
Disallow /

baiduspider-favo

Rule Path
Disallow /

baiduspider-cpro

Rule Path
Disallow /

baiduspider-ads

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

sogou inst spider

Rule Path
Disallow /

sogou spider2

Rule Path
Disallow /

sogou blog

Rule Path
Disallow /

sogou news spider

Rule Path
Disallow /

sogou orion spider

Rule Path
Disallow /

chinasospider

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

easouspider

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.twinkl.nl/sitemap/www.twinkl.nl/sitemap_index_basic-pages.xml
sitemap https://www.twinkl.nl/sitemap/www.twinkl.nl/sitemap_index_help-categories-and-articles.xml
sitemap https://www.twinkl.nl/sitemap/www.twinkl.nl/sitemap_index_pages.xml
sitemap https://www.twinkl.nl/sitemap/www.twinkl.nl/sitemap_index_resource-categories.xml
sitemap https://www.twinkl.nl/sitemap/www.twinkl.nl/sitemap_index_resources.xml
sitemap https://www.twinkl.nl/sitemap/www.twinkl.nl/sitemap_index_teaching-wiki.xml
sitemap https://www.twinkl.nl/sitemap/www.twinkl.nl/sitemap_index_parenting-wiki.xml
sitemap https://www.twinkl.nl/sitemap/www.twinkl.nl/sitemap_index_builder-pages.xml
sitemap https://www.twinkl.nl/sitemap/www.twinkl.nl/sitemap_index_book-categories.xml
sitemap https://www.twinkl.nl/sitemap/www.twinkl.nl/sitemap_index_books.xml
sitemap https://www.twinkl.nl/sitemap/www.twinkl.nl/sitemap_index_classroom-display-categories.xml
sitemap https://www.twinkl.nl/sitemap/www.twinkl.nl/sitemap_index_classroom-displays.xml
sitemap https://www.twinkl.nl/sitemap/www.twinkl.nl/sitemap_index_event-months.xml
sitemap https://www.twinkl.nl/sitemap/www.twinkl.nl/sitemap_index_events.xml
sitemap https://www.twinkl.nl/sitemap/www.twinkl.nl/sitemap_index_store.xml
sitemap https://www.twinkl.nl/sitemap/www.twinkl.nl/sitemap_index_blog.xml
sitemap https://www.twinkl.nl/sitemap/www.twinkl.nl/sitemap_index_guide.xml
sitemap https://www.twinkl.nl/sitemap/www.twinkl.nl/sitemap_index_imagine.xml
sitemap https://www.twinkl.nl/sitemap/www.twinkl.nl/sitemap_index_create-templates.xml
sitemap https://www.twinkl.nl/sitemap/www.twinkl.nl/sitemap_index_newsroom.xml
sitemap https://www.twinkl.nl/sitemap/www.twinkl.nl/sitemap_index_homework-help.xml
sitemap https://www.twinkl.nl/sitemap/www.twinkl.nl/sitemap_index_search.xml
sitemap https://www.twinkl.nl/sitemap/www.twinkl.nl/sitemap_index_school_directory.xml
sitemap https://www.twinkl.nl/sitemap/www.twinkl.nl/google-news-sitemap.xml
Back to top