deriv.com
robots.txt
Robots Exclusion Standard data for deriv.com
Resource Scan
Scan Details
| Site Domain | deriv.com |
| Base Domain | deriv.com |
| Scan Status | Ok |
| Last Scan | 2024-11-09T06:30:33+00:00 |
| Next Scan | 2024-11-23T06:30:33+00:00 |
Last Scan
| Scanned | 2024-11-09T06:30:33+00:00 |
| URL | https://deriv.com/robots.txt |
| Domain IPs | 172.66.40.156, 172.66.43.100, 2606:4700:3108::ac42:289c, 2606:4700:3108::ac42:2b64 |
| Response IP | 172.66.43.100 |
| Found | Yes |
| Hash | aa66f23c90766422f8d8ab7fdeea35eef31c678e6fa9ee54c518b1ea605cd8d7 |
| SimHash | 2829a890c593 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /404/ |
| Disallow | /homepage/ |
| Disallow | /landing/ |
| Disallow | /endpoint/ |
| Disallow | /livechat/ |
| Disallow | /storybook/ |
| Disallow | *.binary.sx |
| Disallow | /?region=*%2F |
| Disallow | */eu/* |
| Disallow | *_page%3D* |
| Disallow | *?s=* |
| Disallow | /cdn-cgi/ |
| Disallow | *?term=* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://deriv.com/sitemap.xml |