Skip to content

cbintel Documentation

Intelligence gathering and knowledge synthesis toolkit.

Developer Documentation

Comprehensive guides for understanding and extending cbintel.

Section Description
Architecture Overview System layers and component relationships
Network Layer OpenWRT cluster, VPN banks, Tor gateway
Primitives AI, HTTP, browser, archives, vectors
Jobs System Job types, lifecycle, workers
Workspaces Artifact organization
Graph Execution DAG execution and operations
Type System Type hierarchy and compatibility
Chat Pipeline Natural language to graphs
Roadmap Future development plans

Guides

Document Description
CRAWWL Analysis Web crawling architecture and pipeline

Reference

Document Description
Architecture System design and component relationships
VPN Cluster API Geographic VPN bank management
WireGuard Tunnel Multi-worker exit node deployment
OpenVPN Tunnel OpenVPN configuration via ProtonVPN

Components

Package Purpose
cbintel.ai AI client wrappers (Anthropic, Ollama, CBAI)
cbintel.net Network operations (HTTP, search, URL cleaning)
cbintel.io File/process I/O (HTML, markdown, storage)
cbintel.crawl AI-powered web crawling pipeline
cbintel.lazarus Historical web archives (CDX, gau)
cbintel.vectl Vector embeddings and similarity search
cbintel.screenshots Browser automation (Playwright)
cbintel.cluster VPN cluster management API
cbintel.geo Geographic VPN routing for jobs
cbintel.jobs Async job queue with workers

Services

Domain Port Description
intel.nominate.ai 9003 Intelligence API (crawl, lazarus, vectl, screenshots)
network.nominate.ai 32203 Network API (VPN cluster management)

Both services run under a single cbintel.service systemd unit.

Source Projects

Documentation consolidated from extern/ projects:

Project Description
Ferret Autonomous web interaction with visual learning
Lazarus Web archive processing and semantic search
Guzl Playwright browser CLI for screenshots/DOM
Vectl High-performance vector storage with clustering
Seedbed AI-driven knowledge synthesis platform
Leaks DNS & network leak detection tool
Llarp Distributed VPN load balancer (16 workers)