clickastro.com
robots.txt
Robots Exclusion Standard data for clickastro.com
Resource Scan
Scan Details
| Site Domain | clickastro.com |
| Base Domain | clickastro.com |
| Scan Status | Ok |
| Last Scan | 2025-11-28T19:28:51+00:00 |
| Next Scan | 2025-12-05T19:28:51+00:00 |
Last Scan
| Scanned | 2025-11-28T19:28:51+00:00 |
| URL | https://clickastro.com/robots.txt |
| Redirect | https://www.clickastro.com:443/robots.txt |
| Redirect Domain | www.clickastro.com |
| Redirect Base | clickastro.com |
| Domain IPs | 13.234.199.83, 3.7.116.184 |
| Redirect IPs | 13.234.199.83, 3.7.116.184 |
| Response IP | 13.234.199.83 |
| Found | Yes |
| Hash | 57f2fe6a0b823911a20484e96aa280b5692737554855b88a6156e5dcb75ee4ef |
| SimHash | 782bd16249bd |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /articlemanager/ |
| Disallow | /astro-campaign/ |
| Disallow | /astroload/ |
| Disallow | /astrology-article/ |
| Disallow | /astrology-articles/ |
| Disallow | /astrology-zone/ |
| Disallow | /astroservices/ |
| Disallow | /av-advt/ |
| Disallow | /avnetdirect/ |
| Disallow | /avservices/ |
| Disallow | /campaign/ |
| Disallow | /ccreport/ |
| Disallow | /common/ |
| Disallow | /ecommerce* |
| Disallow | /error/ |
| Disallow | /Error-404/ |
| Disallow | /fifa/ |
| Disallow | /general/ |
| Disallow | /horoscope-samples/ |
| Disallow | /index_reliance.php |
| Disallow | /indian-astrology.php |
| Disallow | /indian-astrology/ |
| Disallow | /mailer/ |
| Disallow | /marriageconsultancy/ |
| Disallow | /marriageconsultancy_malayalam/ |
| Disallow | /misscall |
| Disallow | /news/ |
| Disallow | /onam-prediction.php |
| Disallow | /pay-done/ |
| Disallow | /py/ |
| Disallow | /refer-a-friend/ |
| Disallow | /review/ |
| Disallow | /search-results* |
| Disallow | /super-test/ |
| Disallow | /support/ |
| Disallow | /tellafriend/ |
| Disallow | /test/ |
| Disallow | /testing/ |
| Disallow | /testingrd/ |
| Disallow | /toolbar/ |
| Disallow | /tp/ |
| Disallow | /vishu-prediction.php |
| Disallow | /western-astrology/ |
| Disallow | /widget/ |
| Disallow | /your-2011-prediction.php |
| Disallow | /logs/ |
| Disallow | /archive/ |
| Disallow | /test-thank-you2/ |
| Disallow | /test-thank-you3/ |
| Disallow | /thank-you2/ |
| Disallow | /medium-cpc/ |
| Disallow | /cgi-bin/ |
| Disallow | /home-test.html |
| Disallow | /serv-info.php |
| Disallow | /login-form.html |
| Disallow | /offline.html |
| Disallow | /widget/ |
| Disallow | /blog/tag/ |
| Disallow | /blog/page-ads/ |
| Disallow | /blog/category/ |
| Disallow | /blog/wp-admin/ |
| Disallow | /*?ref=* |
| Disallow | /*?predTomorrow* |
| Disallow | /fb-ads/ |
| Disallow | /js/local-storage.js |
| Disallow | /js/jquery-3.3.1.js |
| Disallow | /js/cad/form-entry-script-card.js |
| Disallow | /js/cad/google_place_for_cards-solar.js |
| Disallow | /horoscope/aries-horoscope-tomorrow-new.php |
| Allow | /vrishabha-rashifal-daily-english?test=mutest |
| Disallow | /paytm* |
| Disallow | /freecharge* |
| Disallow | /host.php |
| Disallow | /info.php |
| Disallow | /inf0.php |
| Disallow | /free-pdf/ |
| Disallow | /pooja-suggestion-thanks |
| Disallow | /myhoroscopes |
| Allow | /celebrity-horoscopes/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.clickastro.com/sitemap.xml |