toluna.com
robots.txt
Robots Exclusion Standard data for toluna.com
Resource Scan
Scan Details
| Site Domain | toluna.com |
| Base Domain | toluna.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-06-10T04:21:28+00:00 |
| Next Scan | 2024-07-10T04:21:28+00:00 |
Last Successful Scan
| Scanned | 2024-04-19T03:42:50+00:00 |
| URL | https://www.toluna.com/robots.txt |
| Domain IPs | 65.9.112.11, 65.9.112.45, 65.9.112.65, 65.9.112.86 |
| Response IP | 18.165.171.51 |
| Found | Yes |
| Hash | f440726957bc3151ce4152d43ffefdeabab7ba99fdccc103a834c9667a9cf9da |
| SimHash | 014df57dc5f8 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /home-old |
| Disallow | /register-old |
| Disallow | /register-no-theme |
| Disallow | /unsubscribeme |
| Disallow | /coregvalidation |
| Disallow | /registration-test-jason |
| Disallow | /contactus |
| Disallow | /adminregister |
| Disallow | /programme-exclusif1 |
| Disallow | /programme-exclusif |
| Disallow | /ennz-welcome |
| Disallow | /promos-za |
| Disallow | /promos-ie |
| Disallow | /test |
| Disallow | /pollsresults |
| Disallow | /contact-us-impl |
| Disallow | /contact-us-impl1 |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.toluna.com/sitemap.xml |