lego.tr
robots.txt

Robots Exclusion Standard data for lego.tr

Archived Snapshots

Resource Scan

Scan Details

Site Domain	lego.tr
Base Domain	lego.tr
Scan Status	Ok
Last Scan	2025-10-18T00:09:52+00:00
Next Scan	2025-11-17T00:09:52+00:00

Last Scan

Scanned	2025-10-18T00:09:52+00:00
URL	https://lego.tr/robots.txt
Domain IPs	104.21.5.179, 172.67.133.177, 2606:4700:3034::ac43:85b1, 2606:4700:3036::6815:5b3
Response IP	104.21.5.179
Found	Yes
Hash	8b9b09421bdae42d46aa37a49730f38f370510481e054705d91b2cee4a2821f3
SimHash	020c7772cc91

Groups

*

Rule	Path
Allow	/
Disallow	/AsiriYogunluk.php
Disallow	/ajax.php
Disallow	/Cache/GelismisVitrin/
Disallow	/SecCode.php*
Disallow	/uye*
Disallow	/uye-girisi-sayfasi

Rule

Path

Allow

Disallow

/AsiriYogunluk.php

Disallow

/ajax.php

Disallow

/Cache/GelismisVitrin/

Disallow

/SecCode.php*

Disallow

/uye*

Disallow

/uye-girisi-sayfasi

w3c-checklink

Rule	Path
Disallow	/

Rule

Path

Disallow

w3c_validator

Rule	Path
Disallow	/

Rule

Path

Disallow

w3c_css_validator

Rule	Path
Disallow	/

Rule

Path

Disallow

baiduspider

Rule	Path
Disallow	/

Rule

Path

Disallow

archive.org_bot

Rule	Path
Disallow	/

Rule

Path

Disallow

ia_archiver

Rule	Path
Disallow	/

Rule

Path

Disallow

faviconizer

Rule	Path
Disallow	/

Rule

Path

Disallow

ahrefsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

a6-indexer/1.0

Rule	Path
Disallow	/

Rule

Path

Disallow

butterfly

Rule	Path
Disallow	/

Rule

Path

Disallow

exabot

Rule	Path
Disallow	/

Rule

Path

Disallow

grapeshot

Rule	Path
Disallow	/

Rule

Path

Disallow

mail.ru

Rule	Path
Disallow	/

Rule

Path

Disallow

nutch

Rule	Path
Disallow	/

Rule

Path

Disallow

pingdom

Rule	Path
Disallow	/

Rule

Path

Disallow

proximic

Rule	Path
Disallow	/

Rule

Path

Disallow

python

Rule	Path
Disallow	/

Rule

Path

Disallow

searchmetricsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

seznambot

Rule	Path
Disallow	/

Rule

Path

Disallow

sogou web spider

Rule	Path
Disallow	/

Rule

Path

Disallow

sogou spider

Rule	Path
Disallow	/

Rule

Path

Disallow

sogou

Rule	Path
Disallow	/

Rule

Path

Disallow

youdaobot

Rule	Path
Disallow	/

Rule

Path

Disallow

sosospider

Rule	Path
Disallow	/

Rule

Path

Disallow

spbot

Rule	Path
Disallow	/

Rule

Path

Disallow

wget

Rule	Path
Disallow	/

Rule

Path

Disallow

yie8

Rule	Path
Disallow	/

Rule

Path

Disallow

mj12bot

Rule	Path
Disallow	/

Rule

Path

Disallow

turnitinbot

Rule	Path
Disallow	/

Rule

Path

Disallow

blexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

hivabot

Rule	Path
Disallow	/

Rule

Path

Disallow

nerdybot

Rule	Path
Disallow	/

Rule

Path

Disallow

updown_tester

Rule	Path
Disallow	/

Rule

Path

Disallow

androiddownloadmanager

Rule	Path
Disallow	/

Rule

Path

Disallow

voltron

Rule	Path
Disallow	/

Rule

Path

Disallow

xenu's link sleuth 1.1c

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot-sa

Rule	Path
Disallow	/

Rule

Path

Disallow

obot

Rule	Path
Disallow	/

Rule

Path

Disallow

riddler

Rule	Path
Disallow	/

Rule

Path

Disallow

Other Records

Field	Value
sitemap	https://lego.tr/xml/sitemap/sitemap.xml

Field

Value

sitemap

https://lego.tr/xml/sitemap/sitemap.xml

Warnings

2 invalid lines.

lego.trrobots.txt

Resource Scan

Scan Details

Last Scan

Groups

*

w3c-checklink

w3c_validator

w3c_css_validator

baiduspider

archive.org_bot

ia_archiver

faviconizer

ahrefsbot

a6-indexer/1.0

butterfly

exabot

grapeshot

mail.ru

nutch

pingdom

proximic

python

searchmetricsbot

seznambot

sogou web spider

sogou spider

sogou

youdaobot

sosospider

spbot

wget

yie8

mj12bot

turnitinbot

blexbot

hivabot

nerdybot

updown_tester

androiddownloadmanager

voltron

xenu's link sleuth 1.1c

semrushbot

semrushbot-sa

obot

riddler

Other Records

Warnings

lego.tr
robots.txt