Deft Technology 🛠️

What is a Local AI Research Gateway? Building a local research stack gives you total privacy by keeping your data and LLM execution entirely on your hardware. By combining Ollama with Open WebUI and SearXNG, you can create a localized version of modern chat interfaces capable of real-time web search. Key Components: Ollama: The backend engine handling model execution locally. Open WebUI: The interface for chat and agent orchestration. SearXNG: A self-hosted metasearch engine that feeds real-time web data directly to the LLM. How to get started: Host Ollama: Run Ollama natively on your Ubuntu host to maximize GPU access for your local models (like gemma2:2b). Deploy via Docker: Use a docker-compose.yml to spin up Open WebUI and SearXNG containers. Bridge the Connection: In Open WebUI, navigate to Admin Panel > Settings > Web Search and set the Query URL to http://host.docker.internal:8080/search?q=<query>. Configure Search: Set the “Search Result Count” to 3 to ensure memory usage stays within the limits of constrained hardware. ...

The Challenge: The 4GB VRAM Wall Running modern LLMs like Phi-4 or Qwen3 on local hardware is becoming a necessity as cloud AI costs continue to add up for power users. However, OpenClaw 2026 now requires a large context window (minimum 12k-16k) to handle its agentic workflows and tool-calling capabilities. On an entry-level NVIDIA T500 (4GB), these large windows usually force the system to spill over into System RAM (CPU mode). When this happens, generation speed drops from sluggish to 5+ minutes per response, making the bot unresponsive. ...

Why Run AI Locally? Ollama allows you to run Large Language Models (LLMs) directly on your desktop. While cloud solutions like ChatGPT or Gemini offer massive horsepower, they require you to send your data to external servers. Running a local LLM provides: Data Sovereignty: Your prompts and data never leave your machine. Zero Cost: No monthly subscriptions or API usage fees. Offline Access: Work without an internet connection. Security: Ideal for analyzing sensitive documents or private codebases. ...

Overview [Cloudflare] (https://www.cloudflare.com/zero-trust/products/access/) offers a powerful solution for connecting your devices across different networks. This free service allows you to securely link your home office setup, remote cloud images, and laptop through Cloudflare’s global network without exposing your infrastructure to the public internet. What is Cloudflare Tunnel? Cloudflare Tunnel is a service that creates secure, outbound-only connections from your devices to Cloudflare’s edge network. Unlike traditional VPNs, you don’t need to open ports on your firewall or manage complex routing—the tunnel handles all the connectivity for you. ...

This page pulls data directly from the Strava API. Every few hours, a GitHub Action wakes up, grabs any updates, and saves them to a data file. Hugo then does any converting and using Leaflet.js plots my last starting point on a map. ...

What is Cloudflare? Cloudflare is an authoritative DNS service that offers fast response times (averaging ~11ms) and redundancy for free bundled with various basic security protections for your site and being API first is good for automation. The Free Plan: The Free plan is $0/month and includes everything a hobbyist or tester needs: Global Anycast Network: Your DNS records are replicated across 330+ cities for instant lookups. Unmetered DDoS Protection: Shields your domain from attacks at the DNS level. DNSSEC: Adds a cryptographic layer to prevent DNS spoofing and “man-in-the-middle” attacks. Proxied Records (The “Orange Cloud”): Masks your real server IP and provides free SSL and CDN caching automatically. Cloudflare Pages Integration: Seamlessly connects your Hugo site to your domain without manual CNAME headaches. Understanding Domain Registration Costs For any website, it is usually cheaper to move your domain and is the only mandatory recurring cost or the Domain Registration Fee of about $8.00 for a typical .com per year. ...

What is Render? Render https://www.render.com is a good choice for hosting static sites like this one. The Free Hobby Plan: The Hobby plan is free ($0/month) and includes several useful features: Custom domains: Use your own brand. Global CDN: Fast delivery worldwide. Automatic SSL: Secure by default. Continuous deployment: Updates automatically on each GitHub push. How to get started: Create a GitHub repository and push your Hugo project. Create a new Static Site on Render and connect the repository. Set the Build Command to hugo. Set the Publish Directory to public. Add a custom domain if desired. ...

What is Hugo? Hugo is a fast static site generator. Unlike WordPress, which builds pages every time a visitor clicks a link, Hugo builds your entire website once into simple HTML files. This makes your site incredibly fast and more difficult to hack. Why it’s a good choice: $0 Hosting: Because the files are static, you can host them for free on platforms like Render, GitHub Pages, or Netlify. Extreme Speed: Hugo can build 5,000 pages in less than 6 seconds. No Databases: You don’t need to manage MySQL or worry about database connection errors. Security: There is no “backend” for hackers to log into. Your site is just a collection of pre-made files. How to use Gemini to set this up: If you are stuck or want to customize your site further, you can use specific “DevOps” style prompts to get perfect code snippets. ...