Log In Sign Up

twinkl.dk
robots.txt

Robots Exclusion Standard data for twinkl.dk

Resource Scan

Scan Details

Site Domain twinkl.dk
Base Domain twinkl.dk
Scan Status Ok
Last Scan2024-11-16T01:59:29+00:00
Next Scan 2024-11-30T01:59:29+00:00

Last Scan

Scanned2024-11-16T01:59:29+00:00
URL https://twinkl.dk/robots.txt
Redirect https://www.twinkl.dk/robots.txt
Redirect Domain www.twinkl.dk
Redirect Base twinkl.dk
Domain IPs 45.60.46.117, 45.60.52.117
Redirect IPs 45.60.48.117
Response IP 45.60.48.117
Found Yes
Hash 7aa0f7b34c9596445ff45b1f92cfee41555c039202e3a7dad572165a7fa8ec95
SimHash c100f93fac80

Groups

*

Rule Path
Disallow /premium_signupandin_offer.php
Disallow /php/
Disallow /create_folder/
Disallow /fancybox/
Disallow /forum_folder/
Disallow /uploadify/
Disallow /vouchers/
Disallow /ajax-download/
Disallow /download/
Disallow /download-alt-pack/
Disallow /user/
Disallow /_Incapsula_Resource*
Disallow /search/sayt/
Disallow /create/load*
Disallow /resources/0/
Disallow /payment-thanks
Disallow /payment-thanks/
Disallow /payment
Disallow /payment/
Disallow /payments
Disallow /payments/
Disallow /a-payment/
Disallow /integration/

ahrefsbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

owlin bot v. 3.0

Rule Path
Disallow /

owlin bot

Rule Path
Disallow /

owlin

Rule Path
Disallow /

owlin domain resolver

Rule Path
Disallow /

bubing

Rule Path
Disallow /

ltx71 - (http://ltx71.com/)

Rule Path
Disallow /

riddler

Rule Path
Disallow /

expo9

Rule Path
Disallow /

idg/uk (http://spaziodati.eu/)

Rule Path
Disallow /

idg/it (http://spaziodati.eu/)

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

centurybot9@gmail.com

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

geniebot

Rule Path
Disallow /

genieo

Rule Path
Disallow /

dts agent

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

experiancrawluk

Rule Path
Disallow /

changedetection

Rule Path
Disallow /

the knowledge ai

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

um-ic

Rule Path
Disallow /

um-ic/1.0

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

proximic

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

buck

Rule Path
Disallow /

buck/2.2

Rule Path
Disallow /

buck/2.3.2

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

semrushbot-seoab

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

awariorssbot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

peer39_crawler

Rule Path
Disallow /

peer39_crawler/1.0

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

youbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-news

Rule Path
Disallow /

baiduspider-favo

Rule Path
Disallow /

baiduspider-cpro

Rule Path
Disallow /

baiduspider-ads

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

sogou inst spider

Rule Path
Disallow /

sogou spider2

Rule Path
Disallow /

sogou blog

Rule Path
Disallow /

sogou news spider

Rule Path
Disallow /

sogou orion spider

Rule Path
Disallow /

chinasospider

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

easouspider

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.twinkl.dk/sitemap/www.twinkl.dk/sitemap_index_basic-pages.xml
sitemap https://www.twinkl.dk/sitemap/www.twinkl.dk/sitemap_index_help-categories-and-articles.xml
sitemap https://www.twinkl.dk/sitemap/www.twinkl.dk/sitemap_index_pages.xml
sitemap https://www.twinkl.dk/sitemap/www.twinkl.dk/sitemap_index_resource-categories.xml
sitemap https://www.twinkl.dk/sitemap/www.twinkl.dk/sitemap_index_resources.xml
sitemap https://www.twinkl.dk/sitemap/www.twinkl.dk/sitemap_index_teaching-wiki.xml
sitemap https://www.twinkl.dk/sitemap/www.twinkl.dk/sitemap_index_parenting-wiki.xml
sitemap https://www.twinkl.dk/sitemap/www.twinkl.dk/sitemap_index_builder-pages.xml
sitemap https://www.twinkl.dk/sitemap/www.twinkl.dk/sitemap_index_book-categories.xml
sitemap https://www.twinkl.dk/sitemap/www.twinkl.dk/sitemap_index_books.xml
sitemap https://www.twinkl.dk/sitemap/www.twinkl.dk/sitemap_index_classroom-display-categories.xml
sitemap https://www.twinkl.dk/sitemap/www.twinkl.dk/sitemap_index_classroom-displays.xml
sitemap https://www.twinkl.dk/sitemap/www.twinkl.dk/sitemap_index_event-months.xml
sitemap https://www.twinkl.dk/sitemap/www.twinkl.dk/sitemap_index_events.xml
sitemap https://www.twinkl.dk/sitemap/www.twinkl.dk/sitemap_index_store.xml
sitemap https://www.twinkl.dk/sitemap/www.twinkl.dk/sitemap_index_blog.xml
sitemap https://www.twinkl.dk/sitemap/www.twinkl.dk/sitemap_index_guide.xml
sitemap https://www.twinkl.dk/sitemap/www.twinkl.dk/sitemap_index_imagine.xml
sitemap https://www.twinkl.dk/sitemap/www.twinkl.dk/sitemap_index_create-templates.xml
sitemap https://www.twinkl.dk/sitemap/www.twinkl.dk/sitemap_index_newsroom.xml
sitemap https://www.twinkl.dk/sitemap/www.twinkl.dk/sitemap_index_homework-help.xml
sitemap https://www.twinkl.dk/sitemap/www.twinkl.dk/sitemap_index_search.xml
sitemap https://www.twinkl.dk/sitemap/www.twinkl.dk/sitemap_index_school_directory.xml
sitemap https://www.twinkl.dk/sitemap/www.twinkl.dk/google-news-sitemap.xml
Back to top