cnyweather.com
robots.txt

Robots Exclusion Standard data for cnyweather.com

Archived Snapshots

Resource Scan

Scan Details

Site Domain	cnyweather.com
Base Domain	cnyweather.com
Scan Status	Ok
Last Scan	2024-05-23T20:51:13+00:00
Next Scan	2024-05-30T20:51:13+00:00

Last Scan

Scanned	2024-05-23T20:51:13+00:00
URL	https://cnyweather.com/robots.txt
Domain IPs	2607:f1c0:100f:f000::268, 74.208.236.120
Response IP	74.208.236.120
Found	Yes
Hash	da92015e31165f7d47f18eb577691fddf5dc5cd956e6b090a58d172e9ef0a8cd
SimHash	711692624f12

Groups

ia_archiver

Rule	Path
Allow	/

Rule

Path

Allow

archive.org_bot

Rule	Path
Allow	/

Rule

Path

Allow

mj12bot

Rule	Path
Disallow	/

Rule

Path

Disallow

turn it in

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot

Rule	Path
Disallow	/

Rule

Path

Disallow

yahoo slurp

Rule	Path
Disallow	/

Rule

Path

Disallow

baiduspider

Rule	Path
Disallow	/

Rule

Path

Disallow

baiduspider

Rule	Path
Disallow	/

Rule

Path

Disallow

java

Rule	Path
Disallow	/

Rule

Path

Disallow

seznambot

Rule	Path
Disallow	/

Rule

Path

Disallow

y!j yahoo japan

Rule	Path
Disallow	/

Rule

Path

Disallow

ahrefsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

livelapbot

Rule	Path
Disallow	/

Rule

Path

Disallow

ahrefsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

ahrefsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

exabot

Rule	Path
Disallow	/

Rule

Path

Disallow

openhosebot

Rule	Path
Disallow	/

Rule

Path

Disallow

tweetmemebot

Rule	Path
Disallow	/

Rule

Path

Disallow

google-http-java-client/1.17.0-rc (gzip)

Rule	Path
Disallow	/

Rule

Path

Disallow

blexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

facebook bot

Rule	Path
Disallow	/

Rule

Path

Disallow

duckduckgo-favicons-bot/1.0

Rule	Path
Disallow	/

Rule

Path

Disallow

mail.ru_bot/2.0

Rule	Path
Disallow	/

Rule

Path

Disallow

exabot/3.0

Rule	Path
Disallow	/

Rule

Path

Disallow

riddler

Rule	Path
Disallow	/

Rule

Path

Disallow

dotbot/1.1

Rule	Path
Disallow	/

Rule

Path

Disallow

safedns search bot/nutch-1.9

Rule	Path
Disallow	/

Rule

Path

Disallow

omgili/0.5

Rule	Path
Disallow	/

Rule

Path

Disallow

lipperhey-kaus-australis/5.0

Rule	Path
Disallow	/

Rule

Path

Disallow

ccbot/2.0

Rule	Path
Disallow	/

Rule

Path

Disallow

metauri api/2.0

Rule	Path
Disallow	/

Rule

Path

Disallow

princetonbot/1.0

Rule	Path
Disallow	/

Rule

Path

Disallow

newsharecounts.com/1.0

Rule	Path
Disallow	/

Rule

Path

Disallow

veoozbot/1.0

Rule	Path
Disallow	/

Rule

Path

Disallow

uptimebot/1.0

Rule	Path
Disallow	/

Rule

Path

Disallow

domainstatsbot/1.0

Rule	Path
Disallow	/

Rule

Path

Disallow

*

Rule	Path	Comment
Disallow	/wuhistory.php/*	This is an infinite space

Rule

Path

Comment

Disallow

/wuhistory.php/*

This is an infinite space

*

Rule	Path	Comment
Disallow	/wxgraphs.php	This is an infinite space

Rule

Path

Comment

Disallow

/wxgraphs.php

This is an infinite space

*

Rule	Path	Comment
Disallow	/wxradar.php	This is an infinite space

Rule

Path

Comment

Disallow

/wxradar.php

This is an infinite space

*

Rule	Path
Disallow	/history.php/*

Rule

Path

Disallow

/history.php/*

Comments

robots.txt file
For domain: http://www.cnyweather.com

cnyweather.comrobots.txt

Resource Scan

Scan Details

Last Scan

Groups

ia_archiver

archive.org_bot

mj12bot

turn it in

semrushbot

yahoo slurp

baiduspider

baiduspider

java

seznambot

y!j yahoo japan

ahrefsbot

livelapbot

ahrefsbot

ahrefsbot

exabot

openhosebot

tweetmemebot

google-http-java-client/1.17.0-rc (gzip)

blexbot

facebook bot

duckduckgo-favicons-bot/1.0

mail.ru_bot/2.0

exabot/3.0

riddler

dotbot/1.1

safedns search bot/nutch-1.9

omgili/0.5

lipperhey-kaus-australis/5.0

ccbot/2.0

metauri api/2.0

princetonbot/1.0

newsharecounts.com/1.0

veoozbot/1.0

uptimebot/1.0

domainstatsbot/1.0

*

*

*

*

Comments

cnyweather.com
robots.txt