roundtable.ai
robots.txt

Robots Exclusion Standard data for roundtable.ai

Resource Scan

Scan Details

Site Domain roundtable.ai
Base Domain roundtable.ai
Scan Status Ok
Last Scan2025-10-05T02:11:27+00:00
Next Scan 2025-11-04T02:11:27+00:00

Last Scan

Scanned2025-10-05T02:11:27+00:00
URL https://roundtable.ai/robots.txt
Domain IPs 13.215.239.219, 2406:da18:b3d:e201::258, 2406:da18:b3d:e201::259, 52.74.6.109
Response IP 52.74.6.109
Found Yes
Hash 777f3bc24dd772639b5efcacdcaa863853fe50aa74a029ae53f9a8b0e8074e23
SimHash bbdd4a72c405

Groups

*

Rule Path
Allow /
Disallow /404
Disallow /404/
Disallow /401
Disallow /401/
Disallow /search*
Disallow /cart
Disallow /cart/
Disallow /checkout
Disallow /checkout/
Disallow /admin/
Disallow /account/
Disallow /api/
Disallow /order/
Disallow /*?*utm_source=
Disallow /*?*utm_medium=
Disallow /*?*utm_campaign=
Disallow /*?*utm_term=
Disallow /*?*utm_content=
Disallow /*?*gclid=
Disallow /*?*fbclid=
Disallow /*?*ref=
Allow /*.css$
Allow /*.js$
Allow /images/
Allow /assets/

Other Records

Field Value
sitemap https://roundtable.ai/sitemap.xml

Comments

  • Low-value/system pages
  • Optional private dirs (add only if they exist)
  • Block common tracking params
  • Ensure assets are crawlable