Log In Sign Up

clickstream.cc
robots.txt

Robots Exclusion Standard data for clickstream.cc

Resource Scan

Scan Details

Site Domain clickstream.cc
Base Domain clickstream.cc
Scan Status Ok
Last Scan2025-09-03T06:00:03+00:00
Next Scan 2025-10-03T06:00:03+00:00

Last Scan

Scanned2025-09-03T06:00:03+00:00
URL https://clickstream.cc/robots.txt
Domain IPs 104.21.72.165, 172.67.153.80, 2606:4700:3035::6815:48a5, 2606:4700:3037::ac43:9950
Response IP 172.67.153.80
Found Yes
Hash 2aff660ac54f6750d7407d782ad16e668dae89ab5bf692abe1d9318cfb028451
SimHash 5d31e45c8b79

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /psa-coronavirus/
Disallow /xmlrpc.php
Disallow /click/
Disallow /tweet/
Disallow /copyright-notice
Disallow /website-terms-conditions/
Disallow /related-keywords_from_url-trial-demo_sep2015/
Disallow /privacy-statement/
Disallow /category/
Disallow /2011/
Disallow /author
Disallow /wp-login.php
Disallow /wp-login.php?action=lostpassword
Disallow /wp-login.php?redirect_to=%2F35%2F
Disallow /wp-login.php?redirect_to=%2Fa-friend-from-japan%2F
Disallow /wp-login.php?redirect_to=%2Frank-tracking-tools-distributed-to-websites-free%2F
Disallow /wp-login.php?redirect_to=%2Fsearch-and-social-media%2F
Disallow /wp-login.php?redirect_to=%2Fsocial-media-budget%2F
Disallow /wp-login.php?redirect_to=%2Fsocial-media-today%2F
Disallow /wp-login.php?redirect_to=%2Fsocial-media-trends%2F
Disallow /wp-login.php?redirect_to=%2Fsteve-jobs-pbs-interview%2F
Disallow /wp-login.php?redirect_to=%2Fthe-semantic-web-its-come-a-long-way-baby%2F
Disallow /wp-login.php?redirect_to=%2Ftwitter-word-cloud%2F
Disallow /weekly-twitter-updates-for-2011-04-17/
Disallow /weekly-twitter-updates-for-2011-04-24/
Disallow /weekly-twitter-updates-for-2011-05-01/
Disallow /weekly-twitter-updates-for-2011-05-08/
Disallow /weekly-twitter-updates-for-2011-05-15/
Disallow /weekly-twitter-updates-for-2011-05-22/
Disallow /weekly-twitter-updates-for-2011-05-30/
Disallow /weekly-twitter-updates-for-2011-06-06/
Disallow /weekly-twitter-updates-for-2011-06-13/
Disallow /weekly-twitter-updates-for-2011-06-20/
Disallow /weekly-twitter-updates-for-2011-06-27/
Disallow /weekly-twitter-updates-for-2011-07-04/
Disallow /weekly-twitter-updates-for-2011-07-11/
Disallow /weekly-twitter-updates-for-2011-07-18/
Disallow /weekly-twitter-updates-for-2011-07-25/
Disallow /weekly-twitter-updates-for-2011-08-08/
Disallow /weekly-twitter-updates-for-2011-08-15/
Disallow /domains-keywords-subscriber/
Disallow /domain-overview-members/
Disallow /bulk-url-subscriber/
Disallow /subscribers-related-keywords/
Disallow /domains-competitors
Disallow /3284-2/
Disallow /google-search/
Back to top