castanet.net
robots.txt
Robots Exclusion Standard data for castanet.net
Resource Scan
Scan Details
| Site Domain | castanet.net |
| Base Domain | castanet.net |
| Scan Status | Ok |
| Last Scan | 2024-11-08T13:46:57+00:00 |
| Next Scan | 2024-11-15T13:46:57+00:00 |
Last Scan
| Scanned | 2024-11-08T13:46:57+00:00 |
| URL | https://castanet.net/robots.txt |
| Redirect | https://www.castanet.net/robots.txt |
| Redirect Domain | www.castanet.net |
| Redirect Base | castanet.net |
| Domain IPs | 104.26.12.15, 104.26.13.15, 172.67.74.243, 2606:4700:20::681a:c0f, 2606:4700:20::681a:d0f, 2606:4700:20::ac43:4af3 |
| Redirect IPs | 104.26.12.15, 104.26.13.15, 172.67.74.243, 2606:4700:20::681a:c0f, 2606:4700:20::681a:d0f, 2606:4700:20::ac43:4af3 |
| Response IP | 104.26.12.15 |
| Found | Yes |
| Hash | 7fc73efb45738d3fb77f55b689579a4eedf0eb4ff1b6311e27533ea8158ef1c6 |
| SimHash | c9150142b4b1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /sales/ |
| Disallow | /postcomment.php |
| Disallow | /viewcomments.php |
| Disallow | /cgi-bin/ |
| Allow | /templates/weather/images/ |
| Disallow | /templates/ |
| Disallow | /ccs/ |
| Disallow | /lists/ |
| Disallow | /logs/ |
| Disallow | /menus/ |
| Disallow | /quote/ |
| Disallow | /survey/ |
| Disallow | /traffic/ |
| Disallow | /webmail/ |
| Disallow | /events_dev/ |
| Disallow | /demo.htm |
| Disallow | /search.htm |
| Disallow | /crash.htm |
| Disallow | /index-jc.htm |
| Disallow | /chances.htm |
| Disallow | /chances1.htm |
| Disallow | /boats.htm |
| Disallow | /v.htm |
| Disallow | /index-irish.htm |
| Disallow | /index-noirish.htm |
| Disallow | /index-troy.htm |
| Disallow | /index-troy2.htm |
| Disallow | /troy/ |
| Disallow | /homepage/ |
| Disallow | /fred/ |
| Disallow | /real-v2/ |
| Disallow | /refresh/ |
| Disallow | /widgets/ |
| Disallow | /wine/example/ |
| Disallow | /realestatenew/ |
| Disallow | /cat/marketplace/home_leisure/store_-_hot_tub_essentials/ |
| Disallow | /clients/img/ |
| Disallow | /realestate-old/ |
| Disallow | /ryan/ |
| Disallow | /h/ |
| Disallow | /1/ |
| Disallow | /feeds/ |
| Disallow | /cdn-cgi/ |
| Disallow | /TCadmin/ |
| Disallow | /garagesalesnew/ |