teknoops.com
robots.txt

Robots Exclusion Standard data for teknoops.com

Resource Scan

Scan Details

Site Domain teknoops.com
Base Domain teknoops.com
Scan Status Ok
Last Scan2024-11-13T03:34:47+00:00
Next Scan 2024-11-20T03:34:47+00:00

Last Scan

Scanned2024-11-13T03:34:47+00:00
URL https://teknoops.com/robots.txt
Redirect https://www.teknoops.com/robots.txt
Redirect Domain www.teknoops.com
Redirect Base teknoops.com
Domain IPs 216.239.32.21, 216.239.34.21, 216.239.36.21, 216.239.38.21
Redirect IPs 172.217.194.121, 2404:6800:4003:c11::79
Response IP 172.253.118.121
Found Yes
Hash 2756021dca5c77a5086635b3f3876ab6b80ae1c771070eb5d0673df3093e3f39
SimHash 701571400d33

Groups

*

Rule Path
Allow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

mazbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

sogou

Rule Path
Disallow /

baidu

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

ip-web-crawler.com

Rule Path
Disallow /

exabot

Rule Path
Disallow /

aboundexbot

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

siteliner

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

nutch

Rule Path
Disallow /

spbot

Rule Path
Disallow /

wesee

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

advbot

Rule Path
Disallow /

deepcrawl

Rule Path
Disallow /

brightbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.teknoops.com/sitemap.xml
sitemap https://www.teknoops.com/sitemap-pages.xml

Warnings

  • 2 invalid lines.