ar.expertoption.com
robots.txt

Robots Exclusion Standard data for ar.expertoption.com

Resource Scan

Scan Details

Site Domain ar.expertoption.com
Base Domain expertoption.com
Scan Status Ok
Last Scan2025-03-30T18:20:19+00:00
Next Scan 2025-04-06T18:20:19+00:00

Last Scan

Scanned2025-03-30T18:20:19+00:00
URL https://ar.expertoption.com/robots.txt
Domain IPs 104.20.74.162, 104.20.75.162, 172.67.16.51, 2606:4700:10::6814:4aa2, 2606:4700:10::6814:4ba2, 2606:4700:10::ac43:1033
Response IP 104.20.74.162
Found Yes
Hash 7f9641d2b56b91bcd6e230ba9acfe6a1356fa3b21a2e38b50b731327f5644896
SimHash 690cc421c398

Groups

*

Rule Path
Disallow /app
Disallow /templates
Disallow /email-confirm
Disallow /demo
Allow /.well-known/
Disallow /company/policy/terms$
Disallow /company/policy/payment-policy$
Disallow /company/policy/return-and-refund-policy$
Disallow /partnership/
Disallow /referral/
Disallow /referral-alt/

clickfrogbot

Rule Path
Disallow /$

Other Records

Field Value
sitemap https://expertoption.com/sitemap.xml

Warnings

  • `host` is not a known field.