Log In Sign Up

klnew.com
robots.txt

Robots Exclusion Standard data for klnew.com

Resource Scan

Scan Details

Site Domain klnew.com
Base Domain klnew.com
Scan Status Ok
Last Scan2026-02-24T23:23:20+00:00
Next Scan 2026-03-26T23:23:20+00:00

Last Scan

Scanned2026-02-24T23:23:20+00:00
URL https://klnew.com/robots.txt
Domain IPs 104.21.63.111, 172.67.145.100, 2606:4700:3031::ac43:9164, 2606:4700:3032::6815:3f6f
Response IP 172.67.145.100
Found Yes
Hash 191b0b93aff26a4efea0d8449d0dff8b24e1e9026169916187549473daef0b52
SimHash 15147fe16e09

Groups

*

Rule Path
Disallow /admin
Disallow /login
Disallow /logout
Disallow /api/*
Disallow /private/*
Allow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

sogou

Rule Path
Disallow /

exabot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

spbot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

crawlbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

sitelockspider

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

internetarchive

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

httrack

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

wget

Rule Path
Disallow /

backlinkcrawler

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://klnew.com/sitemap.xml
Back to top