Logging and Evals

Logging System

RA-H automatically logs all database activity, giving you complete visibility into what's happening in your knowledge base.

What Gets Logged

Node operations - Every time a node is created or updated

Edge operations - Every relationship created or modified

Chat operations - All conversations with token usage and cost tracking

Viewing Logs

Access logs through Settings → Logs tab:

• Real-time activity feed - See the last 100 log entries
• Filter by table - View only nodes, edges, or chats
• Filter by action - See only creates or updates
• Detailed view - Click any entry to see full details

Auto-Pruning

RA-H automatically keeps the last 10,000 log entries, preventing the database from growing infinitely while preserving recent activity history.

Cost Tracking

Every AI conversation is tracked for token usage and cost.

What's Tracked

Token counts:

• Input tokens (your message + context)
• Output tokens (agent response)
• Reasoning tokens (for advanced models)
• Total tokens per conversation

Cost calculation:

• Automatic cost computation based on model pricing
• Stored in USD per conversation
• Aggregated across all conversations

Viewing Analytics

Access analytics through Settings → Analytics tab:

• Total tokens used - All-time usage across all agents
• Total cost - USD spent on AI operations
• Breakdown by agent - Usage per agent (Easy/Hard mode, workflows)
• Breakdown by thread - Cost per conversation
• Average cost per chat - Typical conversation costs

Typical Costs

Based on current model pricing:

• Easy mode chat: $0.01-0.03
• Hard mode chat: $0.03-0.10
• Integrate workflow: ~$0.18
• Deep analysis: ~$0.33

Privacy

All logs are stored locally in your SQLite database. No usage data is sent to external servers (beyond the AI API calls required for functionality).