Technical Architecture
Four layers of
emergent intelligence
Periphery does not impose structure. It observes data across five embedding spaces, clusters emergent patterns with HDBSCAN, and validates every structure through adversarial coherence scoring. What reaches the analyst has survived the Critic.
Ingest Mesh
The collection layer. RSS feeds, REST APIs, file uploads, and custom scrapers funnel through a politeness-aware ingestion system. Rate limiting is per-source. Deduplication happens at the content hash level before any processing begins.
Crystallizer
The core analytical engine. Documents are projected into five embedding spaces simultaneously. HDBSCAN clustering identifies emergent structure without requiring predefined categories. Clusters form, merge, split, and dissolve as new data arrives.
Continuous Critic
The adversarial validation layer. Every emergent structure is challenged. The Critic scores coherence, identifies contradictions, and assigns legibility tiers. Nothing reaches the analyst without passing adversarial review.
Query Interface
The analyst's surface. Natural language queries are decomposed into analytical operations. Claude synthesizes responses with full confidence rendering — every claim is traceable to source documents with explicit uncertainty markers.
Embedding Architecture
Five spaces, one structure
Every document is projected into five orthogonal embedding spaces simultaneously. Clustering operates across the combined space, capturing patterns invisible to any single dimension.
Dense vector representations capturing meaning and context across documents.
Named entity co-occurrence and resolution across multilingual sources.
Graph-derived embeddings encoding relationships between actors, organizations, and events.
Time-series encoding that captures event cadence, periodicity, and sequence.
Location-aware embeddings for proximity analysis and regional clustering.
Adversarial Validation
The Continuous Critic
Epistemological honesty is not optional. The Continuous Critic scores every emergent structure for coherence, flags contradictions, and assigns a legibility tier. The system knows what it doesn't know.
Document Lifecycle
The state machine
Every document progresses through a deterministic state machine. Each transition is observable, auditable, and reversible.