AI Console

← Back to Documentation

Overview

The JARVIS AI Console provides a conversational interface to interact with the artificial intelligence assistant running on your FusionDesk instance. It combines local capabilities with optional cloud AI providers for enhanced reasoning and functionality.

Local Capabilities

Even without external API keys, JARVIS can perform many useful tasks:

  • Opening applications (browser, terminal, file manager)
  • Running safe Linux commands
  • Checking system information and status
  • Managing files and directories
  • Controlling basic desktop functions
  • Providing voice feedback and responses

Enhanced AI Capabilities

When you configure API keys for supported providers, JARVIS gains access to:

  • Advanced reasoning and problem-solving
  • Code generation and debugging assistance
  • Complex task planning and execution
  • Natural language understanding and generation
  • Multimodal capabilities (with supported providers)

Supported AI Providers

FusionDesk supports integration with these leading AI platforms:

OpenAIGPT-4, GPT-3.5 Turbo
GeminiGoogle's latest models
OpenRouterAccess to many models
NVIDIANemotron, Llama models

Getting Started

Basic Usage

To interact with JARVIS:

  1. Type your question or command in the input field at the bottom
  2. Press Enter or click the send button
  3. For voice input, click the microphone icon (requires microphone permissions)
  4. JARVIS will process your request and respond in the chat window
  5. Use Shift+Enter to create new lines in your message

Voice Features

JARVIS supports voice input and output:

  • Click the microphone icon to start voice input
  • Speak your command or question clearly
  • JARVIS will transcribe your speech and process it
  • Responses can be played back as audio using the play button
  • Voice features work best in Chrome, Edge, or Safari

Example Commands

System & Control

Try these commands:

  • "Open the browser"
  • "Show me system information"
  • "What's my IP address?"
  • "List running Docker containers"
  • "Check memory usage"
  • "Open terminal"

Productivity & Development

With AI providers configured:

  • "Write a Python script to backup files"
  • "Explain how RAID works"
  • "Help me debug this JavaScript error"
  • "Create a Dockerfile for a Node.js app"
  • "What are the best practices for server security?"

Troubleshooting

No Response from JARVIS

If JARVIS isn't responding:

  • Verify your FusionDesk instance is running and accessible
  • Check that the JARVIS service is active on your instance
  • Ensure there are no network connectivity issues
  • Try accessing the JARVIS web interface directly at http://[your-instance]:5000

Voice Not Working

For voice input/output issues:

  • Check that you've granted microphone permissions to the website
  • Ensure your browser supports the Web Speech API
  • Verify your microphone is working in other applications
  • Try refreshing the page and granting permissions again
  • For audio output, check your system volume and audio settings

API Key Issues

If AI-enhanced features aren't working:

  • Verify your API keys are valid and haven't expired
  • Check that you have sufficient quota/credits with the provider
  • Confirm you've saved the keys in the Settings section
  • Ensure your FusionDesk instance can reach the provider's API endpoints
  • Check the JARVIS logs on your instance for authentication errors