crowdwisdom.live
robots.txt
Robots Exclusion Standard data for crowdwisdom.live
Resource Scan
Scan Details
| Site Domain | crowdwisdom.live |
| Base Domain | crowdwisdom.live |
| Scan Status | Ok |
| Last Scan | 2024-11-16T19:23:37+00:00 |
| Next Scan | 2024-11-23T19:23:37+00:00 |
Last Scan
| Scanned | 2024-11-16T19:23:37+00:00 |
| URL | https://crowdwisdom.live/robots.txt |
| Domain IPs | 104.26.4.200, 104.26.5.200, 172.67.75.186, 2606:4700:20::681a:4c8, 2606:4700:20::681a:5c8, 2606:4700:20::ac43:4bba |
| Response IP | 172.67.75.186 |
| Found | Yes |
| Hash | 515891cded675a4642fed6e967c01318f653de742ba0dfc6dea69ab2abbc8642 |
| SimHash | 6d095c920bd3 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /wp-admin/admin-ajax.php |
| Disallow | /forecaster-accuracy/ |
| Disallow | /forecaster-accuracy-share/?* |
| Disallow | /forecaster-accuracy-share-dev-mode/?* |
| Disallow | /shop/ |
| Disallow | /price-forecasts/ |
| Disallow | /video-category/ |
| Disallow | /cricket/* |
| Disallow | /g/ |
| Disallow | /tag/* |
| Disallow | /coronavirus/ |
| Disallow | /discussion-topics/ |
| Disallow | /politics/*achievements |
| Disallow | /election-2019-national/* |
| Disallow | /?p= |
| Disallow | /2020/ |
| Disallow | /2019/ |
| Disallow | /2021/ |
| Disallow | /2022/ |
| Disallow | /2018/ |
| Disallow | /page/ |
| Disallow | /*/page |
| Disallow | /m/ |
| Disallow | /clients-7/ |
| Disallow | /wp-admin/ |
| Disallow | /wp-login.php? |
| Disallow | /xmlrpc.php |
| Disallow | /wp-includes/ |
| Disallow | /wp-includes/js |
| Disallow | /*/*/?amp |
| Disallow | /*/*/?preview |
| Disallow | */feed/ |
| Disallow | /*?action=* |
| Disallow | /*?redirect_to=* |
| Disallow | /*?utm_source=* |
| Disallow | /?amp |
| Disallow | /search/ |
| Disallow | /*/*/?fbclid |
| Disallow | /*/*/?__twitter |
Other Records
| Field | Value |
|---|---|
| sitemap | https://crowdwisdom.live/sitemap_index.xml |
| sitemap | https://crowdwisdom.live/news-sitemap.xml |