Log In Sign Up

cs-cs.net
robots.txt

Robots Exclusion Standard data for cs-cs.net

Resource Scan

Scan Details

Site Domain cs-cs.net
Base Domain cs-cs.net
Scan Status Ok
Last Scan2025-10-05T00:36:34+00:00
Next Scan 2025-11-04T00:36:34+00:00

Last Scan

Scanned2025-10-05T00:36:34+00:00
URL https://cs-cs.net/robots.txt
Domain IPs 78.108.80.146
Response IP 78.108.80.146
Found Yes
Hash 8059be08b0aa0ebfd91b03d3f13b6268dd508c999188244b0adee569f2b40416
SimHash 797c7a51e6e8

Groups

*

Rule Path Comment
Allow / -
Allow /wp-uploads Allow Uploads to Index
Allow /wp-content/uploads Allow Uploads to Index
Allow /wp-uplocmi Allow Comment Images Uploads to Index
Disallow /ExxChange Disallow ExxChange files to index!
Disallow /? ¢á¥ ¯ à ¬¥âàë § ¯à®á  ­  £« ¢­®©
Disallow /wp-login.php -
Disallow /xmlrpc.php Block XML-RPC Hole!
Disallow /fileData Disable file data for statuses
Disallow /cgi-bin Disable System Folders from Index
Disallow /wp-admin -
Disallow /wp-admin/ -
Disallow /wp-includes -
Disallow /wp-content/plugins -
Disallow /wp-content/cache -
Disallow /wp-content/themes -
Disallow /?author=* -
Disallow /trackback Disable RSS, Ping & TrackBack URLs
Disallow /trackback/ -
Disallow */trackback -
Disallow */trackback -
Disallow /feed -
Disallow /feed/ -
Disallow */*/feed/*/ -
Disallow */feed -
Disallow */*/feed -
Disallow /?feed= -
Disallow */feed -
Disallow /comments -
Disallow */comments -
Disallow /category/*/* Disallow multi-site index (single page - single content)
Disallow /category/ -
Disallow /*?* -
Disallow /archives/ -
Disallow /tag/ -
Disallow /tag/* -
Disallow *?s= Disable Search phrases from index
Disallow /?s=* -
Disallow *?s= -
Disallow *%26s%3D -
Disallow /search -
Disallow /search/ -
Disallow /author/* -
Disallow /author/ -
Disallow *?attachment_id= áâà ­¨æ  ¢«®¦¥­¨ï. ‚®®¡é¥-â® ­  ­¥© ।¨à¥ªâ...
Disallow */embed ¢á¥ ¢áâà ¨¢ ­¨ï
Disallow */2000/* -
Disallow */2001/* -
Disallow */2002/* -
Disallow */2003/* -
Disallow */2004/* -
Disallow */2005/* -
Disallow */2006/* -
Disallow */2007/* -
Disallow */2008/* -
Disallow */2009/* -
Disallow */2010/* -
Disallow */2011/* -
Disallow */2012/* -
Disallow */2013/* -
Disallow */2014/* -
Disallow */2015/* -
Disallow */2016/* -
Disallow */2017/* -
Disallow */2018/* -
Disallow */2019/* -
Disallow */2020/* -
Disallow */2021/* -
Disallow */2022/* -
Disallow */2023/* -
Disallow */2024/* -
Disallow */2025/* -
Disallow */2026/* -
Disallow */2027/* -
Disallow */2028/* -
Disallow */2029/* -
Disallow */2030/* -
Disallow */2031/* -
Disallow */2032/* -
Disallow */2033/* -
Disallow */2034/* -
Disallow */2035/* -
Disallow */2036/* -
Disallow */2037/* -
Disallow */2038/* -
Disallow */2039/* -
Disallow */2040/* -
Disallow */2041/* -
Disallow */2042/* -
Disallow */2043/* -
Disallow */2044/* -
Disallow */2045/* -
Disallow */2046/* -
Disallow */2047/* -
Disallow */2048/* -
Disallow */2049/* -
Disallow */2050/* -

Other Records

Field Value Comment
crawl-delay 80 80 Second delay to stop 100% loading site!

googlebot-image

Product Comment
googlebot-image Google Image
Rule Path
Disallow
Allow /*

mediapartners-google*

Product Comment
mediapartners-google* Google AdSense
Rule Path
Disallow
Allow /*

ia_archiver

Product Comment
ia_archiver Internet Archiver Wayback Machine
Rule Path
Allow /*

duggmirror

Product Comment
duggmirror digg mirror
Rule Path
Disallow /
Back to top

Other Records

Field Value Comment
sitemap https://cs-cs.net/sitemap.xml Site Map Link
Back to top

Comments

  • MAIN SECTION - BLOG Indexing
  • MAIN SECTION - BLOG Indexing (Block Unused pages & WP Stuff)
  • Taken from http://mainview.ru/wordpress/kak-zakryt-ot-indeksacii-dubli-v-wordpress
  • http://dmitriydenisov.com/indexing-wordpress/
  • http://wp-kama.ru/id_803/pishem-pravilnyiy-robotstxt-dlya-wordpress.html
  • Allow System WP Folders to index
  • Forbid System WP Folders to index
  • Forbid Unused Links to index (WP Navigation)
  • Disallow: /page/*
  • Disallow: */page/ # ¢á¥ ¢¨¤ë ¯ £¨­ æ¨¨
  • Forbid Year archives
  • SEARCH & ARCHIVE BOTS SECTION
  • @2018.10.06 = Enable Archiving Pages
  • Disallow: /
  • (C) Cs-Cs.Net 2015-2016, 2021
Back to top

Warnings

  • `host` is not a known field.
Back to top