codns.com
robots.txt

Robots Exclusion Standard data for codns.com

Archived Snapshots

Resource Scan

Scan Details

Site Domain	codns.com
Base Domain	codns.com
Scan Status	Ok
Last Scan	2025-06-05T10:59:12+00:00
Next Scan	2025-06-12T10:59:12+00:00

Last Scan

Scanned	2025-06-05T10:59:12+00:00
URL	http://codns.com/robots.txt
Domain IPs	211.49.97.56
Response IP	211.49.97.56
Found	Yes
Hash	e74e799361662656e83e8ac4ef12e1850356d9e2132c6b52474957ccdf12a931
SimHash	70731c64e8c1

Groups

gptbot

Rule	Path
Disallow	/

Rule

Path

Disallow

scrapy

Rule	Path
Disallow	/

Rule

Path

Disallow

curl

Rule	Path
Disallow	/

Rule

Path

Disallow

ahrefsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

archive.org_bot

Rule	Path
Disallow	/

Rule

Path

Disallow

bdcbot

Rule	Path
Disallow	/

Rule

Path

Disallow

businessbot

Rule	Path
Disallow	/

Rule

Path

Disallow

dataprovider.com

Rule	Path
Disallow	/

Rule

Path

Disallow

dialogsearch.com bot

Rule	Path
Disallow	/

Rule

Path

Disallow

digincore crawler bot

Rule	Path
Disallow	/

Rule

Path

Disallow

domainsigmacrawler

Rule	Path
Disallow	/

Rule

Path

Disallow

kisabot

Rule	Path
Disallow	/

Rule

Path

Disallow

mail.ru_bot

Rule	Path
Disallow	/

Rule

Path

Disallow

mediavbot

Rule	Path
Disallow	/

Rule

Path

Disallow

memorybot

Rule	Path
Disallow	/

Rule

Path

Disallow

mfibot

Rule	Path
Disallow	/

Rule

Path

Disallow

mj12bot

Rule	Path
Disallow	/

Rule

Path

Disallow

msnbot-media

Rule	Path
Disallow	/

Rule

Path

Disallow

neumobbot

Rule	Path
Disallow	/

Rule

Path

Disallow

pageanalyzer

Rule	Path
Disallow	/

Rule

Path

Disallow

pagesinventory

Rule	Path
Disallow	/

Rule

Path

Disallow

plukkie

Rule	Path
Disallow	/

Rule

Path

Disallow

roboto

Rule	Path
Disallow	/

Rule

Path

Disallow

rogerbot

Rule	Path
Disallow	/

Rule

Path

Disallow

rsnbot

Rule	Path
Disallow	/

Rule

Path

Disallow

safednsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

semanticbot

Rule	Path
Disallow	/

Rule

Path

Disallow

smtbot

Rule	Path
Disallow	/

Rule

Path

Disallow

surveybot

Rule	Path
Disallow	/

Rule

Path

Disallow

turnitinbot

Rule	Path
Disallow	/

Rule

Path

Disallow

uxcrawlerbot

Rule	Path
Disallow	/

Rule

Path

Disallow

wotbox

Rule	Path
Disallow	/

Rule

Path

Disallow

yandexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

mediapartners-google

Rule	Path
Allow	/

Rule

Path

Allow

adsbot-naver

Rule	Path
Allow

Rule

Path

Allow

bingbot

Rule	Path
Allow

Rule

Path

Allow

daum

Rule	Path
Allow

Rule

Path

Allow

googlebot

Rule	Path
Allow

Rule

Path

Allow

googlebot-mobile

Rule	Path
Allow

Rule

Path

Allow

haosouspider

Rule	Path
Allow

Rule

Path

Allow

yeti

Rule	Path
Allow

Rule

Path

Allow

zumbot

Rule	Path
Allow
Disallow	/search/
Disallow	/bbs/search.php
Disallow	/managers/
Disallow	/multi_codns/
Disallow	/board_manager/
Disallow	/data/
Disallow	/extend/
Disallow	/install/
Disallow	/js/
Disallow	/lib/
Disallow	/plugin/
Disallow	/skin/

Rule

Path

Allow

Disallow

/search/

Disallow

/bbs/search.php

Disallow

/managers/

Disallow

/multi_codns/

Disallow

/board_manager/

Disallow

/data/

Disallow

/extend/

Disallow

/install/

Disallow

/js/

Disallow

/lib/

Disallow

/plugin/

Disallow

/skin/

Other Records

Field	Value
sitemap	https://www.codns.com/sitemap.xml

Field

Value

sitemap

https://www.codns.com/sitemap.xml

Warnings

8 invalid lines.

codns.comrobots.txt

Resource Scan

Scan Details

Last Scan

Groups

gptbot

scrapy

curl

ahrefsbot

archive.org_bot

bdcbot

businessbot

dataprovider.com

dialogsearch.com bot

digincore crawler bot

domainsigmacrawler

kisabot

mail.ru_bot

mediavbot

memorybot

mfibot

mj12bot

msnbot-media

neumobbot

pageanalyzer

pagesinventory

plukkie

roboto

rogerbot

rsnbot

safednsbot

semanticbot

smtbot

surveybot

turnitinbot

uxcrawlerbot

wotbox

yandexbot

mediapartners-google

adsbot-naver

bingbot

daum

googlebot

googlebot-mobile

haosouspider

yeti

zumbot

Other Records

Warnings

codns.com
robots.txt