highlightai.com
robots.txt
Robots Exclusion Standard data for highlightai.com
Resource Scan
Scan Details
Site Domain | highlightai.com |
Base Domain | highlightai.com |
Scan Status | Ok |
Last Scan | 2025-09-23T01:55:35+00:00 |
Next Scan | 2025-10-07T01:55:35+00:00 |
Last Scan
Scanned | 2025-09-23T01:55:35+00:00 |
URL | https://highlightai.com/robots.txt |
Domain IPs | 172.66.40.80, 172.66.43.176, 2606:4700:3108::ac42:2850, 2606:4700:3108::ac42:2bb0 |
Response IP | 172.66.43.176 |
Found | Yes |
Hash | 99c021710770e588ec54f9693e22cec214886d9376da93acc284b813c7648f0f |
SimHash | 3c7d4cf0e9e4 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /admin/ |
Disallow | /api/ |
Disallow | /.well-known/ |
Disallow | /_next/ |
Disallow | /static/private/ |
Disallow | /account/ |
Disallow | /callback/ |
Disallow | /signout/ |
Disallow | /uninstall/ |
Disallow | /test-meta/ |
Disallow | /migrate/ |
Disallow | /trial/error/ |
Disallow | /subscription/canceled/ |
Disallow | /connect/ |
Disallow | /deeplink/ |
Disallow | /plugin-deeplink/ |
Disallow | /share/ |
Disallow | /lite/ |
Disallow | /tag/ |
Disallow | /all-prompts |
Disallow | /all-tags |
Disallow | /apps |
Disallow | /discord |
Disallow | /meeting-notes |
Allow | /api/og/* |
Allow | /.well-known/apple-app-site-association |
Allow | /assets/ |
Allow | /fonts/ |
Allow | /install/ |
Allow | /landing-page/ |
Allow | /_next/static/ |
Other Records
Field | Value |
---|---|
sitemap | https://highlightai.com/sitemap.xml |
Comments