OpenIntelligence
Silicon-Native Vector Search
Free · In‑App Purchases
Apple Intelligence (AFM 3) for files. Search PDFs and text offline with Silicon RAG, Siri App Actions, iCloud sync, 100x faster Rust imports, and 4x faster GPU search.
OpenIntelligence turns your files into private, searchable knowledge bases with citation-backed Q&A - Built specifically for Apple Intelligence-capable devices (iPhone, iPad, and Mac/Apple Silicon).
Import documents, audio, video, images, or code to a library. The app extracts text, transcribes speech, indexes vectors, and answers natural-language questions with inline citations that link directly to source pages and highlights.
Powered by the AFM 3 Architecture:
- Dynamic 20B Core Advanced Routing: The 20B Apple Foundation Model serves as the primary execution engine, prioritizing local routing over Private Cloud Compute to maximize privacy and eliminate latency.
- ADM 3 Visual Generation: The Apple ADM 3 architecture is plumbed directly into the core generation pipeline via the Image Playground API for instant visual concept rendering.
- Screen Awareness AppIntents: Seamlessly ingest on-screen files and URLs directly into your RAG libraries via Shortcuts, entirely in the background without opening the app.
- Telemetry HUD & Thinking States: The ultra-thin glass HUD displays active model routes, token allocation, RAM, TOPS processing power, and real-time reasoning states.
- Core AI Engine & Embeddings: Native FoundationModels APIs and a local CoreAISentenceEmbeddingProvider deliver hardware-accelerated embeddings on Apple silicon.
- RAG Evaluations Suite: Built-in validation tracks Recall@5 and Citation Precision, exposing an Apple Evaluations Bridge for CLI testing.
Retrieval & Reasoning:
- 1,000x Faster Retrieval: The O(N) Set-based deduplication eliminates CPU bottlenecks to make evidence aggregation 1,000x faster.
- Buttery-Smooth: A dynamic UUID cache accelerates row rendering performance by 240x.
- Hybrid Search & GPU Acceleration: Fuses BM25 keyword matching with semantic vector similarity. A Metal compute shader accelerates batch cosine-similarity retrieval by 4x natively on the GPU and Neural Engine.
- Dynamic Verification Gates: Adapts dynamically based on Quality Mode to inspect retrieved passages, filter ungrounded assertions, and halt speculative answers. If a fact is missing, the engine abstains.
- Three Query Modes: Standard (fast factual lookups), Deep Think (multi-step reasoning), and Maximum (exhaustive Neural Engine synthesis). Safely prevents auto-escalating to Deep Think loops when using constrained models.
- Bulletproof Safety: Preserves drafts during API retries, limits token budgets against Apple Intelligence constraints, and runs cascading deletes on discarded documents to prevent corruption.
50+ Supported File Formats:
- Documents: PDF, DOCX, XLSX, PPTX, Pages, Numbers, Keynote, Markdown, CSV, RTF, TXT, HTML, XML. Embedded PDF figures and complex tables are preserved as searchable chunks.
- Code: Swift, Python, JS, TS, Java, C, C++, C#, Go, Rust, Ruby, HTML, CSS, SQL, Shell, YAML, JSON, and more.
- Audio: M4A, MP3, WAV, AIFF - on-device transcription up to 2 hours per file.
- Video: MP4, MOV - audio extraction with local transcription.
- Images: JPEG, PNG, HEIC, TIFF, GIF, BMP, WebP - Vision OCR text extraction.
Libraries & Sync:
- Isolated Libraries: Separate projects, clients, or subjects into distinct containers. Each library maintains its own vector index.
- Per-Library iCloud Sync: Choose Local Only or iCloud Drive per library. Synced iCloud libraries replicate processed state across your Apple devices, while local stays on the original device.
- Conflict-Free Sync: Deletion tombstones, merge resolution, and concurrent background task processing ensure consistency across devices.
Absolute Privacy: Your documents never leave your device unless escalated to Apple's zero-retention Private Cloud Compute enclaves. No third-party servers.
As a solo developer, any support on the Pro or Lifetime tiers genuinely makes me want to keep building and refining this.
For the current supporters - THANK YOU!! It's been a wild journey.
Privacy Policy: https://gunzino.me/openintelligence/privacy
Version 4.5 introduces native Rust-backed text processing, memory-safe document streaming, optimized GPU calculations, and Apple Intelligence integrations.
1. Rust-Backed Tokenizer and Citation Precision:
- Rust-Backed Tokenizer Engine: Moved text tokenization from Swift string-splitting loops to a pre-compiled native Rust library (swift-tokenizers) wrapped in a local package, accelerating document tokenization and index compilation by up to 100x.
- Precision Character Offsets: Utilizes native Rust-calculated byte-level character offsets to provide high-precision source citations back to original text passages.
- Isolated Resource Bundling: Moved tokenizer resource directories entirely to local package targets to prevent Xcode synchronized group resource duplicate copy warnings and flattening conflicts.
2. Memory-Safe Ingestion and Processing:
- Bounded Stream Processing: Re-engineered document parsing from whole-file loading to a memory-safe streaming pipeline. This prevents RAM spikes and mitigates Out-of-Memory (OOM) risks on large PDF documents, keeping RAM usage below 32MB.
- Zero-Copy Vision Extraction: Bypassed traditional PNG encoding overhead during document ingestion by routing GPU-rendered pages directly into the Vision OCR engine, accelerating text extraction by over 30%.
- Page Offset Tracking: Corrected page-offset mapping during extraction to align database references with printed page numbers for accurate citation lookup.
- Incremental Search Indexing: Upgraded the SQLite FTS5 index to append data on each streaming iteration, resolving index truncation bugs and retaining full-text search records across streaming batches.
- Ingestion Queue Protection: Added a 15-minute file modification age check and mutated storage relative path mappings to prevent synchronization daemons from sweeping active files.
- Live Ingestion Telemetry: Refined the Dynamic Island and Apple Watch Smart Stack widget layouts to display progress rings and processing percentages during background document imports.
3. GPU-Accelerated Similarity and Core AI:
- Metal 4 Similarity Engine: Accelerated vector database matching by running SIMD4 and threadgroup-level calculations directly on the Metal GPU engine, speeding up query matching by up to 4x.
- Dynamic Core AI Routing: Defaults sentence embedding tasks to Apple's native Core AI framework on iOS 27+ / macOS 27+ devices, while maintaining backward-compatible CoreML fallbacks for iOS/macOS 26.
- Private Cloud Compute Fallbacks: Added intelligent entitlement verification for Private Cloud Compute queries on iOS 27. If secure cloud permissions are pending or unavailable, reasoning-heavy queries gracefully and transparently fall back to local on-device Foundation Models without crashing.
- Single-Instance Caching: Caches the model provider instance to prevent double allocation during startup, saving up to 100MB of system RAM.
- Model Pre-Warming: Integrated background pre-warm APIs to pre-load Apple Intelligence foundation models in 0.01 seconds, ensuring instant first-query responsiveness.
4. Billing System and Diagnostics:
- StoreKit 2 Re-alignment: Re-engineered StoreKit product queries and entitlement loops. Removed deprecated document-pack consumables and stabilized entitlement reconciliation across subscription tiers (Monthly, Annual, and Lifetime Cohort).
- Telemetry Diagnostics: Added a dedicated diagnostics panel inside the settings pane to show compile-time and runtime model readiness status.
- Configuration Resilience: Refined the AI Subsystem settings panel to allow saving provider configurations even when the target hardware is temporarily warming up or unavailable, ensuring smooth runtime fallback routing.
The developer, Gunnar Hostetler, indicated that the app’s privacy practices may include handling of data as described below. For more information, see the developer’s privacy policy .
Data Not Collected
The developer does not collect any data from this app.
Accessibility
The developer has not yet indicated which accessibility features this app supports. Learn More
Information
- Seller
- Gunnar Hostetler
- Size
- 171.6 MB
- Category
- Developer Tools
- Compatibility
Requires iOS 26.0 or later.
- iPhone
Requires iOS 26.0 or later. - iPad
Requires iPadOS 26.0 or later. - Mac
Requires macOS 26.0 or later.
- iPhone
- Languages
- English
- Age Rating
16+
- 16+
- In-App Purchases
Yes
- Lifetime Cohort $59.99
- Pro Monthly $5.99
- Pro Annual $29.99
- Copyright
- © 2026 Gunnar Hostetler
