HeliosDB-Lite User Adoption Guide

Introduction
Getting Started
Core Concepts
Implementation Guide
Best Practices
Troubleshooting
Support & Community

Introduction

HeliosDB-Lite is a PostgreSQL-compatible embedded database designed for developers who need a production-grade SQL database without the operational overhead of managing a separate database server.

Key Benefits

Zero Configuration: Works out of the box, no setup required
PostgreSQL Compatible: Use existing PostgreSQL tools and libraries
Embedded: Deploy with your application as a single binary
Vector Search: Built-in semantic search capabilities
Encryption: Transparent encryption at rest
Time-Travel: Query historical data with temporal queries
Branching: Git-like workflows for schema changes

Who Should Use HeliosDB-Lite?

✅ Ideal For:

Embedded applications (desktop, mobile, IoT)
Microservices with local storage needs
AI/ML applications requiring vector search
Edge computing and offline-first apps
Development and testing environments
Applications needing git-like database branching

⚠️ Consider Alternatives If You Need:

Multi-node clustering (see full HeliosDB platform)
Extremely high write throughput (>100K writes/sec)
Distributed transactions across nodes

Getting Started

Quick 5-Minute Start

Option 1: Try the REPL (No Installation)

# Using Docker (if installed)
docker run -it --rm heliosdb/lite:latest repl --memory

# Or after installing via cargo
heliosdb-lite repl --memory

Interactive session example:

heliosdb> CREATE TABLE products (
  id SERIAL PRIMARY KEY,
  name TEXT,
  price DECIMAL(10,2)
);

heliosdb> INSERT INTO products (name, price) VALUES ('Widget', 29.99);

heliosdb> SELECT * FROM products;

Option 2: Embed in Your Application (Rust)

Create Cargo.toml:

[dependencies]
heliosdb-lite = "2.4"

Create src/main.rs:

use heliosdb_lite::EmbeddedDatabase;

fn main() -> Result<(), Box<dyn std::error::Error>> {
    let db = EmbeddedDatabase::new("./myapp.helio")?;

    db.execute("CREATE TABLE IF NOT EXISTS users (
        id INT PRIMARY KEY,
        name TEXT,
        email TEXT
    )")?;

    db.execute("INSERT INTO users VALUES ($1, $2, $3)",
        &[1, "Alice", "alice@example.com"])?;

    let results = db.query("SELECT * FROM users", &[])?;
    println!("{:?}", results);

    Ok(())
}

Run: cargo run

Option 3: Server Mode (PostgreSQL Compatible)

# Start server
heliosdb-lite start --port 5432 --data ./mydb

# Connect with any PostgreSQL client
psql postgresql://localhost:5432/mydb

Core Concepts

1. Deployment Modes

HeliosDB-Lite supports 4 deployment modes:

Embedded (In-Process)

Data location: Application process memory + disk
Concurrency: Single process only
Best for: Desktop apps, mobile apps, single-server microservices
Setup time: <5 minutes

Server (Network)

Data location: Separate server process, accessed via TCP
Concurrency: Multiple clients
Best for: Web apps, multi-service architectures
Setup time: <10 minutes

In-Memory (Temporary)

Data location: RAM only, lost on shutdown
Concurrency: Single process
Best for: Tests, temporary analytics
Setup time: <1 minute

Hybrid (Recommended for Production)

Data location: Persistent disk + memory cache
Concurrency: Multiple clients via server
Performance: High (cached data)
Durability: Full (persisted data)
Best for: Production applications
Setup time: 15 minutes

2. SQL Operations

HeliosDB-Lite uses standard PostgreSQL SQL:

-- Table creation
CREATE TABLE orders (
    id SERIAL PRIMARY KEY,
    customer_id INT,
    total DECIMAL(10,2),
    created_at TIMESTAMP DEFAULT NOW()
);

-- Data insertion
INSERT INTO orders (customer_id, total)
VALUES (123, 99.99);

-- Parameterized queries (safe from SQL injection)
SELECT * FROM orders WHERE customer_id = $1;

-- Aggregations
SELECT COUNT(*) as order_count, SUM(total) as revenue
FROM orders
GROUP BY customer_id;

3. Advanced Features

Vector Search (Semantic Search)

Store and search documents by semantic similarity:

-- Create table with vector column
CREATE TABLE documents (
    id SERIAL PRIMARY KEY,
    title TEXT,
    content TEXT,
    embedding VECTOR(1536)  -- OpenAI embedding size
);

-- Create index for fast search
CREATE INDEX embedding_idx ON documents
USING hnsw (embedding vector_cosine_ops)
WITH (m = 16, ef_construction = 200);

-- Insert document with embedding
INSERT INTO documents (title, content, embedding)
VALUES ('HeliosDB Guide', 'Complete guide...', $1);

-- Semantic search (find similar documents)
SELECT id, title, embedding <=> $1 AS similarity
FROM documents
ORDER BY similarity
LIMIT 10;

Time-Travel Queries (Historical Data)

Query data as it existed at any point in time:

-- Current data
SELECT * FROM products WHERE id = 1;

-- Data as of yesterday
SELECT * FROM products AS OF TIMESTAMP '2025-01-13 12:00:00'
WHERE id = 1;

-- Compare current vs historical
SELECT
    current.price AS current_price,
    historical.price AS previous_price
FROM products current
JOIN products AS OF TIMESTAMP '2025-01-13 00:00:00' historical
    ON current.id = historical.id
WHERE current.price <> historical.price;

Database Branching (Git-Like Workflows)

Create isolated branches for testing schema changes:

-- Create a branch from main
CREATE BRANCH development FROM main;

-- Switch to branch
USE BRANCH development;

-- Make experimental changes
ALTER TABLE users ADD COLUMN preferences JSONB;
INSERT INTO users VALUES (999, 'Test User', '{}');

-- Test your changes
SELECT * FROM users WHERE id = 999;

-- If satisfied, merge back
USE BRANCH main;
MERGE BRANCH development INTO main;

-- Clean up
DROP BRANCH development;

Materialized Views (Pre-Computed Results)

Create views that are automatically refreshed:

-- Create materialized view (computed result)
CREATE MATERIALIZED VIEW sales_by_month AS
SELECT
    DATE_TRUNC('month', order_date) as month,
    SUM(amount) as total_sales,
    COUNT(*) as order_count
FROM orders
GROUP BY DATE_TRUNC('month', order_date);

-- Query returns instant results (pre-computed)
SELECT * FROM sales_by_month;

-- Configure auto-refresh
ALTER MATERIALIZED VIEW sales_by_month SET (
    auto_refresh = true,
    staleness_threshold_sec = 300  -- Refresh if older than 5 min
);

-- Manual refresh if needed
REFRESH MATERIALIZED VIEW sales_by_month;

Implementation Guide

Phase 1: Planning (5-10 minutes)

Identify your use case (see Getting Started)
Choose deployment mode (Embedded, Server, or Hybrid)
List required tables and columns
Identify any encryption requirements

Phase 2: Setup (10-30 minutes)

For Rust Applications:

Add dependency to Cargo.toml
Initialize database at application startup
Run schema creation on first start
Test with sample data

For Server Mode:

Initialize database: heliosdb-lite init ./mydb
Configure heliosdb.toml if needed
Start server: heliosdb-lite start --port 5432 --data ./mydb
Connect with PostgreSQL client

For Non-Rust Applications: Use server mode and connect via PostgreSQL wire protocol with your preferred driver.

Phase 3: Development (Application-specific)

Define your schema:

-- Example: E-commerce application schema
CREATE TABLE customers (
    id SERIAL PRIMARY KEY,
    email TEXT UNIQUE NOT NULL,
    name TEXT,
    created_at TIMESTAMP DEFAULT NOW()
);

CREATE TABLE products (
    id SERIAL PRIMARY KEY,
    name TEXT NOT NULL,
    description TEXT,
    price DECIMAL(10,2),
    category TEXT,
    embedding VECTOR(1536)  -- For semantic search
);

CREATE TABLE orders (
    id SERIAL PRIMARY KEY,
    customer_id INT REFERENCES customers(id),
    created_at TIMESTAMP DEFAULT NOW(),
    total DECIMAL(10,2)
);

CREATE TABLE order_items (
    order_id INT REFERENCES orders(id),
    product_id INT REFERENCES products(id),
    quantity INT,
    unit_price DECIMAL(10,2),
    PRIMARY KEY (order_id, product_id)
);

-- Create indexes for common queries
CREATE INDEX idx_customer_email ON customers(email);
CREATE INDEX idx_order_customer ON orders(customer_id);
CREATE INDEX idx_product_category ON products(category);

-- Create search index
CREATE INDEX idx_product_embedding ON products
USING hnsw (embedding vector_cosine_ops);

Phase 4: Deployment

Single-Server Deployment:

# Start in production mode
heliosdb-lite start \
    --port 5432 \
    --data ./production-data \
    --config heliosdb.toml

# Connection string for applications
postgresql://user:password@localhost:5432/mydb

Containerized Deployment:

FROM heliosdb/lite:latest

# Copy your configuration
COPY heliosdb.toml /app/heliosdb.toml

# Start server
CMD ["start", "--config", "/app/heliosdb.toml"]

Best Practices

1. Connection Management

In Embedded Mode:

// Initialize once, reuse connection
let db = Arc::new(EmbeddedDatabase::new("./app.helio")?);

// Share across threads
let db_clone = Arc::clone(&db);
thread::spawn(move || {
    let results = db_clone.query("SELECT * FROM users", &[])?;
});

In Server Mode:

// Use connection pooling
use sqlx::postgres::PgPoolOptions;

let pool = PgPoolOptions::new()
    .max_connections(10)
    .connect("postgresql://localhost:5432/mydb")
    .await?;

2. Data Safety

Always use parameterized queries:

// ✅ SAFE: Parameterized query
db.query("SELECT * FROM users WHERE id = $1", &[user_id])?;

// ❌ UNSAFE: String interpolation
db.query(&format!("SELECT * FROM users WHERE id = {}", user_id), &[])?;

3. Performance Optimization

Index frequently queried columns:

CREATE INDEX idx_user_email ON users(email);
CREATE INDEX idx_order_date ON orders(created_at);

Use EXPLAIN to analyze queries:

EXPLAIN SELECT * FROM orders WHERE customer_id = 123;

Batch operations:

// ✅ Good: Batch insert
db.execute("BEGIN TRANSACTION")?;
for item in items {
    db.execute("INSERT INTO products VALUES ($1, $2, $3)",
        &[item.id, item.name, item.price])?;
}
db.execute("COMMIT")?;

// ❌ Less efficient: Individual transactions
for item in items {
    db.execute("INSERT INTO products VALUES ($1, $2, $3)",
        &[item.id, item.name, item.price])?;  // Auto-commit each
}

4. Backup Strategy

Regular backups:

# Embedded mode: copy database file
cp ./myapp.helio ./myapp.helio.backup.$(date +%Y%m%d)

# Server mode: use pg_dump
pg_dump postgresql://localhost:5432/mydb > backup.sql

# Or use built-in export
heliosdb-lite export ./mydb > backup.sql

5. Monitoring

Check database health:

-- Check database size
SELECT pg_database_size(current_database()) as db_size;

-- List all tables
SELECT * FROM information_schema.tables
WHERE table_schema = 'public';

-- Check index usage
SELECT * FROM pg_stat_user_indexes;

-- Monitor slow queries
SET log_min_duration_statement = 1000;  -- Log queries > 1 second

Troubleshooting

Common Issues

”Database locked” error in embedded mode

Cause: Multiple processes accessing database simultaneously

Solution:

Use server mode for multi-process access
Ensure only one application instance uses embedded database

”Out of memory” error

Cause: Query result too large or insufficient cache

Solution:

# Increase cache size in heliosdb.toml
[storage]
cache_size = 1073741824  # 1 GB

# Or paginate results in application
SELECT * FROM large_table LIMIT 100 OFFSET 0;

Slow vector search queries

Cause: Missing index or poor vector quantization settings

Solution:

-- Ensure index exists
CREATE INDEX idx_embeddings ON documents
USING hnsw (embedding vector_cosine_ops)
WITH (m = 16, ef_construction = 200);

-- For better performance, enable Product Quantization
WITH (quantization = 'pq', pq_subquantizers = 8);

Connection refused in server mode

Cause: Server not running or wrong port

Solution:

# Verify server is running
ps aux | grep heliosdb-lite

# Check if port is in use
lsof -i :5432

# Start with verbose logging
heliosdb-lite start --port 5432 --data ./mydb --log-level debug

Support & Community

Documentation Resources

Getting Started - Quick start guide
SQL Reference - Complete SQL documentation
Vector Database Guide - Vector search deep dive
API Reference - Rust API documentation
Encryption Setup - Security configuration

Getting Help

Check Known Issues - See if your issue is documented
Search existing issues on GitHub
Create a new issue with:
- Minimal reproduction case
- Version: heliosdb-lite --version
- Rust version: rustc --version (if using embedded mode)
Join discussions on GitHub Discussions

Reporting Issues

Include the following when reporting issues:

HeliosDB-Lite version
Operating system
Steps to reproduce
Expected vs actual behavior
Relevant code or SQL

Next Steps

Try it out: Run heliosdb-lite repl --memory
Follow a tutorial: Choose your use case from examples
Build your first app: Start with embedded mode or server mode
Explore advanced features: Vector search, branching, time-travel
Join the community: Discuss on GitHub Discussions

Ready to dive deeper? Check out the getting started guide or explore examples.

HeliosDB-Lite User Adoption Guide

HeliosDB-Lite User Adoption Guide

Table of Contents

Introduction

Key Benefits

Who Should Use HeliosDB-Lite?

Getting Started

Quick 5-Minute Start

Option 1: Try the REPL (No Installation)

Option 2: Embed in Your Application (Rust)

Option 3: Server Mode (PostgreSQL Compatible)

Core Concepts

1. Deployment Modes

Embedded (In-Process)

Server (Network)

In-Memory (Temporary)

Hybrid (Recommended for Production)

2. SQL Operations

3. Advanced Features

Vector Search (Semantic Search)

Time-Travel Queries (Historical Data)

Database Branching (Git-Like Workflows)

Materialized Views (Pre-Computed Results)

Implementation Guide

Phase 1: Planning (5-10 minutes)

Phase 2: Setup (10-30 minutes)

Phase 3: Development (Application-specific)

Phase 4: Deployment

Best Practices

1. Connection Management

2. Data Safety

3. Performance Optimization

4. Backup Strategy

5. Monitoring

Troubleshooting

Common Issues

”Database locked” error in embedded mode

”Out of memory” error

Slow vector search queries

Connection refused in server mode

Support & Community

Documentation Resources

Getting Help

Reporting Issues

Next Steps