opinionworld.be
robots.txt
Robots Exclusion Standard data for opinionworld.be
Resource Scan
Scan Details
| Site Domain | opinionworld.be |
| Base Domain | opinionworld.be |
| Scan Status | Ok |
| Last Scan | 2024-05-21T22:00:10+00:00 |
| Next Scan | 2024-06-20T22:00:10+00:00 |
Last Scan
| Scanned | 2024-05-21T22:00:10+00:00 |
| URL | https://opinionworld.be/robots.txt |
| Redirect | https://www.opinionworld.be:443/robots.txt |
| Redirect Domain | www.opinionworld.be |
| Redirect Base | opinionworld.be |
| Domain IPs | 15.197.227.85, 3.33.246.177 |
| Redirect IPs | 2600:9000:229f:3c00:11:62c8:4140:93a1, 2600:9000:229f:4e00:11:62c8:4140:93a1, 2600:9000:229f:c00:11:62c8:4140:93a1, 2600:9000:229f:c800:11:62c8:4140:93a1, 2600:9000:229f:d800:11:62c8:4140:93a1, 2600:9000:229f:e200:11:62c8:4140:93a1, 2600:9000:229f:f600:11:62c8:4140:93a1, 2600:9000:229f:fa00:11:62c8:4140:93a1, 54.192.18.109, 54.192.18.15, 54.192.18.8, 54.192.18.88 |
| Response IP | 13.33.30.94 |
| Found | Yes |
| Hash | 30f5df96f87efae25f513605201af8a5f0dd906bb8c5e093c670bbadde8f7aa6 |
| SimHash | 5992269401f2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /translation/preview/ |
| Disallow | /mobile_eula/ |
| Disallow | /mobile-privacy-policy/ |
| Disallow | /unsubscribe |
| Disallow | /affiliate |
| Disallow | /auth/ |
| Disallow | /legal |
| Disallow | /cookies |
| Disallow | /SocialSignup |
| Disallow | /secured/ |
| Disallow | /*/secured/* |
| Disallow | /Signup/ |
| Disallow | /Signup/* |
| Disallow | /general/news/ |
| Disallow | */general/news/* |
| Disallow | /general/recruitment/ |
| Disallow | */general/recruitment/* |
| Disallow | /general/facebook/ |
| Disallow | */general/facebook/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.opinionworld.be/sitemap.xml |