ar.expertoption.com
robots.txt
Robots Exclusion Standard data for ar.expertoption.com
Resource Scan
Scan Details
Site Domain | ar.expertoption.com |
Base Domain | expertoption.com |
Scan Status | Ok |
Last Scan | 2025-03-30T18:20:19+00:00 |
Next Scan | 2025-04-06T18:20:19+00:00 |
Last Scan
Scanned | 2025-03-30T18:20:19+00:00 |
URL | https://ar.expertoption.com/robots.txt |
Domain IPs | 104.20.74.162, 104.20.75.162, 172.67.16.51, 2606:4700:10::6814:4aa2, 2606:4700:10::6814:4ba2, 2606:4700:10::ac43:1033 |
Response IP | 104.20.74.162 |
Found | Yes |
Hash | 7f9641d2b56b91bcd6e230ba9acfe6a1356fa3b21a2e38b50b731327f5644896 |
SimHash | 690cc421c398 |
Groups
*
Rule | Path |
---|---|
Disallow | /app |
Disallow | /templates |
Disallow | /email-confirm |
Disallow | /demo |
Allow | /.well-known/ |
Disallow | /company/policy/terms$ |
Disallow | /company/policy/payment-policy$ |
Disallow | /company/policy/return-and-refund-policy$ |
Disallow | /partnership/ |
Disallow | /referral/ |
Disallow | /referral-alt/ |
Other Records
Field | Value |
---|---|
sitemap | https://expertoption.com/sitemap.xml |
Warnings
- `host` is not a known field.