Fix Redis connection issues with proper SSL configuration and enhanced error handling

README.md

@@ -31,7 +31,7 @@ Your personal AI-powered life coaching assistant.
 
 ## Requirements
 
-All requirements are specified in `requirements.txt`. The app automatically handles:
+All requirements are specified in requirements.txt. The app automatically handles:
 - Streamlit UI
 - FastAPI backend (for future expansion)
 - Redis connection for persistent memory
@@ -39,30 +39,30 @@ All requirements are specified in `requirements.txt`. The app automatically hand
 
 ## Environment Variables
 
-Configure these in your Hugging Face Space secrets or local `.env` file:
+Configure these in your Hugging Face Space secrets or local .env file:
 
-- `OLLAMA_HOST`: Your Ollama server URL (default: ngrok URL)
-- `LOCAL_MODEL_NAME`: Default model name (default: mistral)
-- `HF_TOKEN`: Hugging Face API token (for Hugging Face models)
-- `HF_API_ENDPOINT_URL`: Hugging Face inference API endpoint
-- `USE_FALLBACK`: Whether to use fallback providers (true/false)
-- `REDIS_HOST`: Redis server hostname (default: localhost)
-- `REDIS_PORT`: Redis server port (default: 6379)
-- `REDIS_USERNAME`: Redis username (optional)
-- `REDIS_PASSWORD`: Redis password (optional)
+- OLLAMA_HOST: Your Ollama server URL (default: ngrok URL)
+- LOCAL_MODEL_NAME: Default model name (default: mistral)
+- HF_TOKEN: Hugging Face API token (for Hugging Face models)
+- HF_API_ENDPOINT_URL: Hugging Face inference API endpoint
+- USE_FALLBACK: Whether to use fallback providers (true/false)
+- REDIS_HOST: Redis server hostname (default: localhost)
+- REDIS_PORT: Redis server port (default: 6379)
+- REDIS_USERNAME: Redis username (optional)
+- REDIS_PASSWORD: Redis password (optional)
 
 ## Provider Details
 
 ### Ollama (Primary Local Provider)
 
-**Setup:**
+Setup:
 1. Install Ollama: https://ollama.com/download
-2. Pull a model: `ollama pull mistral`
-3. Start server: `ollama serve`
-4. Configure ngrok: `ngrok http 11434`
-5. Set `OLLAMA_HOST` to your ngrok URL
+2. Pull a model: ollama pull mistral
+3. Start server: ollama serve
+4. Configure ngrok: ngrok http 11434
+5. Set OLLAMA_HOST to your ngrok URL
 
-**Advantages:**
+Advantages:
 - No cost for inference
 - Full control over models
 - Fast response times
@@ -70,75 +70,89 @@ Configure these in your Hugging Face Space secrets or local `.env` file:
 
 ### Hugging Face Inference API (Fallback)
 
-**Current Endpoint:** `https://zxzbfrlg3ssrk7d9.us-east-1.aws.endpoints.huggingface.cloud`
+Current Endpoint: https://zxzbfrlg3ssrk7d9.us-east-1.aws.endpoints.huggingface.cloud
 
-**Important Scaling Behavior:**
-- ⚠️ **Scale-to-Zero**: Endpoint automatically scales to zero after 15 minutes of inactivity
-- ⏱️ **Cold Start**: Takes approximately 4 minutes to initialize when first requested
-- 🔄 **Automatic Wake-up**: Sending any request will automatically start the endpoint
-- 💰 **Cost**: \$0.536/hour while running (not billed when scaled to zero)
-- 📍 **Location**: AWS us-east-1 (Intel Sapphire Rapids, 16vCPUs, 32GB RAM)
+Important Scaling Behavior:
+- ⚠️ Scale-to-Zero: Endpoint automatically scales to zero after 15 minutes of inactivity
+- ⏱️ Cold Start: Takes approximately 4 minutes to initialize when first requested
+- 🔄 Automatic Wake-up: Sending any request will automatically start the endpoint
+- 💰 Cost: $0.536/hour while running (not billed when scaled to zero)
+- 📍 Location: AWS us-east-1 (Intel Sapphire Rapids, 16vCPUs, 32GB RAM)
 
-**Handling 503 Errors:**
+Handling 503 Errors:
 When using the Hugging Face fallback, you may encounter 503 errors initially. This indicates the endpoint is initializing. Simply retry your request after 30-60 seconds, or wait for the initialization to complete (typically 4 minutes).
 
-**Model:** OpenAI GPT OSS 20B (Uncensored variant)
+Model: OpenAI GPT OSS 20B (Uncensored variant)
 
 ### OpenAI (Alternative Fallback)
 
-Configure with `OPENAI_API_KEY` environment variable.
+Configure with OPENAI_API_KEY environment variable.
 
 ## Switching Between Providers
 
 ### For Local Development (Windows/Ollama):
 
-1. **Install Ollama:**
-   ```bash
+1. Install Ollama: 
+   bash
    # Download from https://ollama.com/download/OllamaSetup.exe
-Pull and run models:
+   
+   Pull and run models:
+   ollama pull mistral
+   ollama pull llama3
+   ollama serve
+   
+   Start ngrok tunnel:
+   ngrok http 11434
+   
+   Update environment variables:
+   OLLAMA_HOST=https://your-ngrok-url.ngrok-free.app
+   LOCAL_MODEL_NAME=mistral
+   USE_FALLBACK=false
 
-ollama pull mistral
-ollama pull llama3
-ollama serve
-Start ngrok tunnel:
-
-ngrok http 11434
-Update environment variables:
-
-OLLAMA_HOST=https://your-ngrok-url.ngrok-free.app
-LOCAL_MODEL_NAME=mistral
-USE_FALLBACK=false
 For Production Deployment:
-The application automatically handles provider fallback:
 
+The application automatically handles provider fallback:
 Primary: Ollama (via ngrok)
 Secondary: Hugging Face Inference API
 Tertiary: OpenAI (if configured)
+
 Architecture
+
 This application consists of:
+- Streamlit frontend (app.py)
+- Core LLM abstraction (core/llm.py)
+- Memory management (core/memory.py)
+- Configuration management (utils/config.py)
+- API endpoints (in api/ directory for future expansion)
 
-Streamlit frontend (app.py)
-Core LLM abstraction (core/llm.py)
-Memory management (core/memory.py)
-Configuration management (utils/config.py)
-API endpoints (in api/ directory for future expansion)
 Built with Python, Streamlit, FastAPI, and Redis.
 
-Troubleshooting Common Issues:
+## Troubleshooting Common Issues
+
 503 Errors with Hugging Face Fallback:
-Wait 4 minutes for cold start initialization
-Retry request after endpoint warms up
+- Wait 4 minutes for cold start initialization
+- Retry request after endpoint warms up
+
 Ollama Connection Issues:
-Verify ollama serve is running locally
-Check ngrok tunnel status
-Confirm ngrok URL matches OLLAMA_HOST
-Test with test_ollama_connection.py
+- Verify ollama serve is running locally
+- Check ngrok tunnel status
+- Confirm ngrok URL matches OLLAMA_HOST
+- Test with test_ollama_connection.py
+
 Redis Connection Problems:
-Set USE_FALLBACK=true to disable Redis requirement
-Or configure proper Redis credentials
+- Set USE_FALLBACK=true to disable Redis requirement
+- Or configure proper Redis credentials:
+  REDIS_HOST=redis-10296.c245.us-east-1-3.ec2.redns.redis-cloud.com
+  REDIS_PORT=10296
+  REDIS_USERNAME=default
+  REDIS_PASSWORD=your_password_here
+  REDIS_DISABLE_SSL=false
+
 Model Not Found:
-Pull required model: ollama pull <model-name>
-Check available models: ollama list
+- Pull required model: ollama pull <model-name>
+- Check available models: ollama list
+
 Diagnostic Scripts:
-Run python test_ollama_connection.py to verify Ollama connectivity.
-Run python diagnose_ollama.py for detailed connection diagnostics.
+- Run python test_ollama_connection.py to verify Ollama connectivity.
+- Run python diagnose_ollama.py for detailed connection diagnostics.
+- Run python test_redis_connection.py to verify Redis connectivity.

core/redis_client.py

@@ -9,20 +9,19 @@ logger = logging.getLogger(__name__)
 
 class RedisClient:
     """Enhanced Redis client with proper connection handling"""
-    
     _instance = None
     _redis_client = None
-    
+
     def __new__(cls):
         if cls._instance is None:
             cls._instance = super(RedisClient, cls).__new__(cls)
         return cls._instance
-    
+
     def __init__(self):
         if not hasattr(self, '_initialized'):
             self._initialized = True
             self._connect()
-    
+
     def _connect(self):
         """Establish Redis connection with proper error handling for Redis Cloud"""
         logger.info(f"Attempting Redis connection with:")
@@ -31,7 +30,7 @@ class RedisClient:
         logger.info(f"  Username: {'SET' if config.redis_username else 'NOT SET'}")
         logger.info(f"  Password: {'SET' if config.redis_password else 'NOT SET'}")
         logger.info(f"  SSL Disabled: {config.redis_disable_ssl}")
-        
+
         if not config.redis_host or config.redis_host == "localhost":
             logger.info("Redis not configured, skipping connection")
             return None
@@ -49,12 +48,11 @@ class RedisClient:
                     username=config.redis_username if config.redis_username else "default",
                     password=config.redis_password,
                     decode_responses=True,
-                    socket_connect_timeout=10,
-                    socket_timeout=10,
+                    socket_connect_timeout=15,
+                    socket_timeout=15,
                     health_check_interval=30,
                     retry_on_timeout=True
                 )
-                
                 self._redis_client.ping()
                 logger.info("Successfully connected to Redis without SSL")
                 return
@@ -72,31 +70,29 @@ class RedisClient:
                 username=config.redis_username if config.redis_username else "default",
                 password=config.redis_password,
                 decode_responses=True,
-                socket_connect_timeout=10,
-                socket_timeout=10,
+                socket_connect_timeout=15,
+                socket_timeout=15,
                 ssl=True,
-                ssl_cert_reqs=None,  # Important for Redis Cloud
+                ssl_cert_reqs='required',  # Proper SSL certificate validation
                 health_check_interval=30,
                 retry_on_timeout=True
             )
-            
             self._redis_client.ping()
             logger.info("Successfully connected to Redis Cloud with SSL")
             return
-            
         except Exception as e:
             logger.error(f"Redis Cloud SSL connection failed: {e}")
             self._redis_client = None
-    
+
     def _parse_host_port(self, host_string: str, default_port: int) -> tuple:
         """Parse host and port from host string"""
         if not host_string:
             return "localhost", default_port
-            
+
         # Remove any whitespace and control characters
         host_string = host_string.strip()
         host_string = re.sub(r'[\r\n\t\0]+', '', host_string)
-        
+
         # Handle case where port is included in REDIS_HOST (e.g., "host:port")
         if ':' in host_string and not host_string.startswith('['):  # Not IPv6
             # Check if the part after : is a valid port number
@@ -113,13 +109,13 @@ class RedisClient:
             except ValueError:
                 # Port is not a valid integer, use default
                 return host_string, default_port
-        
+
         return host_string, default_port
-    
+
     def get_client(self) -> Optional[redis.Redis]:
         """Get Redis client instance"""
         return self._redis_client
-    
+
     def is_healthy(self) -> bool:
         """Check if Redis connection is healthy"""
         if not self._redis_client:
@@ -129,7 +125,7 @@ class RedisClient:
             return True
         except:
             return False
-    
+
     def reconnect(self):
         """Reconnect to Redis"""
         self._connect()

test_redis_connection.py

@@ -0,0 +1,57 @@
+import sys
+import os
+from pathlib import Path
+
+# Add project root to path
+project_root = Path(__file__).parent
+sys.path.append(str(project_root))
+
+from core.redis_client import redis_client
+from utils.config import config
+
+def test_redis_connection():
+    """Test Redis connection with current configuration"""
+    print("Testing Redis connection...")
+    print(f"REDIS_HOST: {config.redis_host}")
+    print(f"REDIS_PORT: {config.redis_port}")
+    print(f"REDIS_USERNAME: {config.redis_username}")
+    print(f"REDIS_DISABLE_SSL: {config.redis_disable_ssl}")
+    
+    # Initialize Redis client
+    client = redis_client.get_client()
+    
+    if client is None:
+        print("❌ Redis client is None - connection failed")
+        return False
+    
+    try:
+        # Test ping
+        result = client.ping()
+        print(f"✅ Ping result: {result}")
+        
+        # Test basic set/get
+        test_key = "redis_test_key"
+        test_value = "redis_test_value"
+        
+        client.set(test_key, test_value)
+        retrieved_value = client.get(test_key)
+        
+        if retrieved_value == test_value:
+            print("✅ Set/Get test successful")
+            # Clean up
+            client.delete(test_key)
+        else:
+            print("❌ Set/Get test failed")
+            
+        return True
+    except Exception as e:
+        print(f"❌ Redis operation failed: {e}")
+        return False
+
+if __name__ == "__main__":
+    success = test_redis_connection()
+    if success:
+        print("\n🎉 Redis connection test passed!")
+    else:
+        print("\n💥 Redis connection test failed!")
+        sys.exit(1)