justx.ai
robots.txt

Robots Exclusion Standard data for justx.ai

Resource Scan

Scan Details

Site Domain justx.ai
Base Domain justx.ai
Scan Status Ok
Last Scan2025-07-21T00:25:28+00:00
Next Scan 2025-08-20T00:25:28+00:00

Last Scan

Scanned2025-07-21T00:25:28+00:00
URL https://justx.ai/robots.txt
Domain IPs 13.35.202.104, 13.35.202.110, 13.35.202.31, 13.35.202.93, 2600:9000:2078:1800:2:9e33:5ec0:93a1, 2600:9000:2078:3e00:2:9e33:5ec0:93a1, 2600:9000:2078:4400:2:9e33:5ec0:93a1, 2600:9000:2078:5c00:2:9e33:5ec0:93a1, 2600:9000:2078:7800:2:9e33:5ec0:93a1, 2600:9000:2078:8000:2:9e33:5ec0:93a1, 2600:9000:2078:9c00:2:9e33:5ec0:93a1, 2600:9000:2078:d600:2:9e33:5ec0:93a1
Response IP 13.35.202.93
Found Yes
Hash 02077503719c0c82715ca1ac4610bad43b9d45da4361a8ad9b858848fcfb6ef5
SimHash 69109232ce33

Groups

*

Rule Path
Allow /
Disallow /api/
Disallow /admin/

twitterbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://justx.ai/sitemap.xml

Comments

  • Allow Twitter bot specifically