cosmiannews.com
robots.txt

Robots Exclusion Standard data for cosmiannews.com

Resource Scan

Scan Details

Site Domain cosmiannews.com
Base Domain cosmiannews.com
Scan Status Ok
Last Scan2024-10-04T05:36:13+00:00
Next Scan 2024-10-11T05:36:13+00:00

Last Scan

Scanned2024-10-04T05:36:13+00:00
URL https://cosmiannews.com/robots.txt
Domain IPs 115.91.5.139
Response IP 115.91.5.139
Found Yes
Hash 1a0593d490b0cc4a89f066aa1ecd98d74db95fe5d7b3a5dd9aa7f63fa19b7977
SimHash 15b167360673

Groups

yeti

Rule Path
Allow /

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

daum

Rule Path
Allow /

msnbot

Rule Path
Allow /

bingbot

Rule Path
Allow /

facebookscraper

Rule Path
Allow /

facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)

Rule Path
Allow /

facebookexternalhit/1.1

Rule Path
Allow /

facebookcatalog/1.0

Rule Path
Allow /

facebookexternalhit

Rule Path
Allow /
Disallow /layouts/
Disallow /modules/
Disallow /_install/
Disallow /_tmp/
Disallow /application/
Disallow /aws/
Disallow /pages/
Disallow /plugins/
Disallow /switchs/
Disallow /widgets/
Disallow /*system%3Dedit
Disallow /*_themeConfig
Disallow /admin
Disallow /*m%3Dadmin
Disallow /p/login
Disallow /*mod%3Dlogin
Disallow /p/join
Disallow /*mod%3Djoin
Disallow /*mod%3Dwrite
Disallow /*iframe%3DY
Disallow /*keyword%3D
Disallow /*mod%3Ddelete
Disallow /*%26a%3D
Disallow /*?a=
Disallow /*action/
Disallow /*type%3Dmodify

Comments

  • DaumWebMasterTool:970cf6fae82e2fa9db0caa30ff0636b00c5e73c14f4d2a64236ea49cd45c4694:zpbzIdkR0LJ3MUU2ZMcW8Q==