Log In Sign Up

twinkl.my
robots.txt

Robots Exclusion Standard data for twinkl.my

Resource Scan

Scan Details

Site Domain twinkl.my
Base Domain twinkl.my
Scan Status Ok
Last Scan2024-11-04T06:16:40+00:00
Next Scan 2024-12-04T06:16:40+00:00

Last Scan

Scanned2024-11-04T06:16:40+00:00
URL https://twinkl.my/robots.txt
Redirect https://www.twinkl.my/robots.txt
Redirect Domain www.twinkl.my
Redirect Base twinkl.my
Domain IPs 45.60.64.75, 45.60.71.75
Redirect IPs 45.60.66.75
Response IP 45.60.66.75
Found Yes
Hash da380db8a777ca2360ff91eff9eb4c587099413695cc352d3b42e9630a062db5
SimHash cf08edbda912

Groups

*

Rule Path
Disallow /premium_signupandin_offer.php
Disallow /php/
Disallow /create_folder/
Disallow /fancybox/
Disallow /forum_folder/
Disallow /uploadify/
Disallow /vouchers/
Disallow /ajax-download/
Disallow /download/
Disallow /download-alt-pack/
Disallow /user/
Disallow /_Incapsula_Resource*
Disallow /search/sayt/
Disallow /create/load*
Disallow /resources/0/
Disallow /payment-thanks
Disallow /payment-thanks/
Disallow /payment
Disallow /payment/
Disallow /payments
Disallow /payments/
Disallow /a-payment/
Disallow /integration/

ahrefsbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

owlin bot v. 3.0

Rule Path
Disallow /

owlin bot

Rule Path
Disallow /

owlin

Rule Path
Disallow /

owlin domain resolver

Rule Path
Disallow /

bubing

Rule Path
Disallow /

ltx71 - (http://ltx71.com/)

Rule Path
Disallow /

riddler

Rule Path
Disallow /

expo9

Rule Path
Disallow /

idg/uk (http://spaziodati.eu/)

Rule Path
Disallow /

idg/it (http://spaziodati.eu/)

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

centurybot9@gmail.com

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

geniebot

Rule Path
Disallow /

genieo

Rule Path
Disallow /

dts agent

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

experiancrawluk

Rule Path
Disallow /

changedetection

Rule Path
Disallow /

the knowledge ai

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

um-ic

Rule Path
Disallow /

um-ic/1.0

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

proximic

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

buck

Rule Path
Disallow /

buck/2.2

Rule Path
Disallow /

buck/2.3.2

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

semrushbot-seoab

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-news

Rule Path
Disallow /

baiduspider-favo

Rule Path
Disallow /

baiduspider-cpro

Rule Path
Disallow /

baiduspider-ads

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

sogou inst spider

Rule Path
Disallow /

sogou spider2

Rule Path
Disallow /

sogou blog

Rule Path
Disallow /

sogou news spider

Rule Path
Disallow /

sogou orion spider

Rule Path
Disallow /

chinasospider

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

easouspider

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.twinkl.my/sitemap/www.twinkl.my/sitemap_index_basic-pages.xml
sitemap https://www.twinkl.my/sitemap/www.twinkl.my/sitemap_index_help-categories-and-articles.xml
sitemap https://www.twinkl.my/sitemap/www.twinkl.my/sitemap_index_pages.xml
sitemap https://www.twinkl.my/sitemap/www.twinkl.my/sitemap_index_resource-categories.xml
sitemap https://www.twinkl.my/sitemap/www.twinkl.my/sitemap_index_resources.xml
sitemap https://www.twinkl.my/sitemap/www.twinkl.my/sitemap_index_teaching-wiki.xml
sitemap https://www.twinkl.my/sitemap/www.twinkl.my/sitemap_index_parenting-wiki.xml
sitemap https://www.twinkl.my/sitemap/www.twinkl.my/sitemap_index_builder-pages.xml
sitemap https://www.twinkl.my/sitemap/www.twinkl.my/sitemap_index_book-categories.xml
sitemap https://www.twinkl.my/sitemap/www.twinkl.my/sitemap_index_books.xml
sitemap https://www.twinkl.my/sitemap/www.twinkl.my/sitemap_index_classroom-display-categories.xml
sitemap https://www.twinkl.my/sitemap/www.twinkl.my/sitemap_index_classroom-displays.xml
sitemap https://www.twinkl.my/sitemap/www.twinkl.my/sitemap_index_event-months.xml
sitemap https://www.twinkl.my/sitemap/www.twinkl.my/sitemap_index_events.xml
sitemap https://www.twinkl.my/sitemap/www.twinkl.my/sitemap_index_store.xml
sitemap https://www.twinkl.my/sitemap/www.twinkl.my/sitemap_index_blog.xml
sitemap https://www.twinkl.my/sitemap/www.twinkl.my/sitemap_index_guide.xml
sitemap https://www.twinkl.my/sitemap/www.twinkl.my/sitemap_index_imagine.xml
sitemap https://www.twinkl.my/sitemap/www.twinkl.my/sitemap_index_create-templates.xml
sitemap https://www.twinkl.my/sitemap/www.twinkl.my/sitemap_index_newsroom.xml
sitemap https://www.twinkl.my/sitemap/www.twinkl.my/sitemap_index_homework-help.xml
sitemap https://www.twinkl.my/sitemap/www.twinkl.my/sitemap_index_search.xml
sitemap https://www.twinkl.my/sitemap/www.twinkl.my/sitemap_index_school_directory.xml
sitemap https://www.twinkl.my/sitemap/www.twinkl.my/google-news-sitemap.xml
Back to top