tilelook.com
robots.txt

Robots Exclusion Standard data for tilelook.com

Resource Scan

Scan Details

Site Domain tilelook.com
Base Domain tilelook.com
Scan Status Ok
Last Scan2024-09-30T10:39:09+00:00
Next Scan 2024-10-30T10:39:09+00:00

Last Scan

Scanned2024-09-30T10:39:09+00:00
URL https://tilelook.com/robots.txt
Redirect https://www.tilelook.com/robots.txt
Redirect Domain www.tilelook.com
Redirect Base tilelook.com
Domain IPs 104.21.18.88, 172.67.181.132, 2606:4700:3034::6815:1258, 2606:4700:3034::ac43:b584
Redirect IPs 104.21.18.88, 172.67.181.132, 2606:4700:3034::6815:1258, 2606:4700:3034::ac43:b584
Response IP 104.21.18.88
Found Yes
Hash a90ff8232142377ea45ac3bc541b3bed594bb636b38027c602a34961eca81e9b
SimHash 5278cc70dcf3

Groups

cookiebot

Rule Path
Disallow /

panscient.com

Rule Path
Disallow /

sqlmap

Rule Path
Disallow /

bubing

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

cognitiveseo

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

screaming

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

vebidoobot

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

zoombot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

checkmarknetwork

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

deusu

Rule Path
Disallow /

domainstatsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ecairn-grabber

Rule Path
Disallow /

exabot

Rule Path
Disallow /

fatbot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

haosouspider

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

memorybot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

roboto

Rule Path
Disallow /

securityresearch.bot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

surdotlybot

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

yoozbot-2.2

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.tilelook.com/sitemap.xml

Warnings

  • 2 invalid lines.