Foundation state of play — the web-of-webs and the open problems
Why this log exists
Section titled “Why this log exists”After ~3 weeks away from the project, the abstract problem we’re solving in Foundation phase is hard to hold front-of-mind. There are now 27 dated log entries in zz-log/, 7 research challenges, and a multi-section roadmap with several forced-but-unmade decisions. The two large 04-10 syntheses covered most of the substance, but reading them cold doesn’t reboot the frame — only the contents.
This log attempts the frame. One metaphor, four kinds of structured graph, six open questions mapped onto the picture, and one canonical reading order. It deliberately makes no new claims and commits no decisions. Every assertion below is backed by a link to an existing log, challenge, concept page, or roadmap item.
The web-of-webs framing
Section titled “The web-of-webs framing”The general problem is structured webs connecting to structured webs.
Each ontology Crosswalker handles — NIST 800-53, CIS Controls, MITRE ATT&CK, SCF — is itself a structured web: typed nodes (controls, techniques, sub-techniques), typed edges (parent/child, references, mitigates), and edge metadata (confidence, scope, applicability). When we import one, we’re reifying that web into the filesystem as folders, notes, frontmatter, and links.
Crosswalker’s job is what happens between those webs. There are at least four kinds of inter-web connection in play, plus one optional intermediary:
The four edge types and the optional pivot (a.k.a. spine, hub, interlingua, canonical intermediate) are the things Foundation is figuring out.
The webs in play
Section titled “The webs in play”| Web | What it is | Linked to |
|---|---|---|
| Source-ontology web | An imported framework — folders + notes + typed links carrying the structure of NIST/CIS/MITRE/etc. into the vault | Ontology lifecycle · Framework crosswalks · Why files |
| Evidence-vault web | The user’s own notes — policies, audit reports, configuration evidence, interview notes | Evidence mapping for GRC teams · Link metadata system (historical) |
| Optional pivot web (a.k.a. spine, hub, interlingua, canonical intermediate) | A canonical intermediate ontology between source webs — synthetic (computed via FCA), inherited (SCF, OSCAL catalog), or handcrafted | Challenge 06 · Schema matching: pivot approach |
| Lifecycle layer — two distinct levels: (a) versions of an ontology over time, connected by structural-change atoms (add, remove, rename, split, merge, deprecate). (b) the meta-web: schemas Crosswalker itself invents for ontology lifecycle management (StewardshipProfile, junction-note schema, FrameworkConfig, etc.) also have lifecycles — Crosswalker eats its own dog food. | Ontology evolution · Atomic operations research · StewardshipProfile (formerly EvolutionPattern) draft · 05-01 §2.5 meta-schema commitment |
Every Foundation question is a question about one of these webs or the connections between them.
The connections in play
Section titled “The connections in play”| Edge type | Connects | Status | Goes to |
|---|---|---|---|
| Crosswalk edges | source-ontology web ↔ source-ontology web | Vocabulary direction set (STRM + SSSOM); form factor (junction notes? frontmatter? sidecar files?) still pending | Foundation synthesis §“Edge semantics” |
| Evidence-link edges | evidence-vault web → source-ontology web | Architecture committed: junction notes (one file per edge), 13-field flat-YAML schema, OSCAL by-component round-trip, git audit trail | Evidence-link edge model synthesis · Challenge 07 |
| Hierarchy edges | within a single ontology web | Folder structure carries this — solved by the generation engine | Ontology lifecycle: Import |
| Lifecycle edges | between versions of the same source-ontology web | 9 atomic operations + 4 composites, provably complete per graph edit distance literature | Atomic operations research · Primitives depth |
SSSOM dual-confidence borrowing applies to both crosswalk and evidence-link edges. BFO continuant/occurrent typing — if adopted — applies at the node level, not the edge level.
Open Foundation problems, mapped to the web-of-webs
Section titled “Open Foundation problems, mapped to the web-of-webs”Six forced-but-unmade decisions. Each is fundamentally a question about one of the webs above or the edges between them.
| Question (web-of-webs framing) | Status | Where it lives |
|---|---|---|
| Do we add an intermediary web (pivot / spine / hub / interlingua) between source-ontology webs? Or keep direct pairwise edges and accept O(n²) maintenance? | Open research — biggest open question | Challenge 06 · Foundation synthesis §“synthetic spine” · Roadmap: Foundation |
| What labels go on web → web edges? And what metadata envelope wraps each label? | Ready to commit — STRM + SSSOM | Foundation synthesis §“edge semantics” · Roadmap: Foundation |
| What does an evidence-vault → ontology edge physically look like? What schema? What status vocabulary? What audit trail? | Ready to commit — junction notes, 13-field schema, 3D status, git history | Evidence-link synthesis · Challenge 07 · Roadmap: Foundation |
| How do we describe a web’s lifecycle? Per-framework stewardship defaults? Per-version transformation recipes? Both stacked? | Needs a position; research direction set | StewardshipProfile (formerly EvolutionPattern) draft · Primitives depth · User-first maintenance · Roadmap: Foundation |
Do nodes carry a formal ontological type? Adopt BFO continuant/occurrent as node.type? Skip BFO entirely? | Design call | Foundation synthesis §“EvolutionPattern needs formal grounding” |
| How do we query the entire web-of-webs at scale? When does Tier 2 sql.js kick in? What’s the SQL schema? What does Bases force? | Needs perf testing + schema design | Progressive tier architecture pillar · Foundation synthesis §“files-canonical ceiling” · Architecture at scale: Challenge 02 |
Things that are not on this list because they’re already settled at Foundation level: file-first storage (why-obsidian-why-files), config-as-code (vision alignment §2), layered architecture (layered architecture vision), the 9 atomic operations (atomic operations research).
Where we left off (3-week refresh)
Section titled “Where we left off (3-week refresh)”Last real activity: 2026-04-10. Twelve commits landed across two parallel synthesis sessions (foundation AM, evidence-link PM). Eight .workspace/ research drafts (~225 KB total) fed those syntheses; two of them remain undistilled into KB form.
The system is now in a decide-next state. Suggested phasing:
- Phase A — Lock in what’s ready (pure paperwork, unblocks docs):
- Commit STRM + SSSOM crosswalk vocabulary → new dated log + roadmap update
- Commit evidence-link junction-note architecture → new dated log + roadmap update
- Commit BFO scope decision (probably continuant/occurrent only) → new dated log
- Phase B — Run the gating research:
- Hand Challenge 06 to a fresh agent (synthetic-spine adopt/reject)
- Resolve StewardshipProfile (formerly EvolutionPattern) keep/replace/stack with formal grounding (Stojanovic / Flouris)
- Phase C — Downstream design (only after A+B):
- Tier 2 sql.js perf testing + SQL schema mapping
- Bases direction research re-measure against junction note volumes
Phase A items don’t change behavior — they convert “the syntheses said this” into “we committed to this.” Phase B is the actual remaining Foundation research. Phase C unblocks development.
Reading order for fresh agents
Section titled “Reading order for fresh agents”If you (or a fresh agent) need to spin up on Foundation work from cold:
- This log — orientation
- Terminology — vocabulary
- Ontology lifecycle — the 5-phase cycle (Acquire → Import → Enrich → Maintain → Share)
- Foundation research synthesis (04-10) — the morning synthesis covering 4 parallel research sessions
- Evidence-link edge model synthesis (04-10) — the afternoon synthesis resolving Challenge 07
- Roadmap: Foundation section — the live decision checklist
- Challenge 06 and Challenge 07 — the two open research briefs
- The Apr 8–9 cluster for the primitives / atomic-operations background
- The Apr 3 cluster for the original architectural commitments
That’s about 4 hours of careful reading; this log alone should take 10 minutes and refresh enough mental scaffolding to make the rest of the path navigable.
Related
Section titled “Related”The two 04-10 syntheses (must-read):
- Foundation research synthesis (04-10) — distills 4 parallel research sessions; commits STRM + SSSOM, surfaces 6 forced decisions
- Evidence-link edge model synthesis (04-10) — distills 2 research sessions; commits junction-note architecture for evidence links
- SEACOW + folder-tag-sync prior-art (04-10) — what to reuse from existing tools
Apr 8–9 cluster (primitives, atomic operations, user-first UX):
- Atomic operations research (04-09) — 9 atomic ops + 4 composites, completeness via GED literature
- Primitives depth and pluggable layers (04-09) — detection / decisioning / handling separation
- User-first ontology maintenance (04-09) — entity-aligned UX, Path C
- Ontology evolution first principles (04-08) — 13 structural change primitives exercise
Apr 3 cluster (architectural foundations, highlights):
- Vision alignment decisions (04-03) — 10 foundational decisions, the philosophical bedrock
- Layered architecture vision (04-03) — spec → library → integrations
- StewardshipProfile (then known as EvolutionPattern) taxonomy draft (04-03) — 8-field taxonomy applied to 7 frameworks; renamed in 05-01 §3.2
- Why Obsidian, why files (04-03) — file-first commitment
- Deep research synthesis (04-03) — first parallel-research synthesis
- Architectural direction exploration (04-03) — what Crosswalker IS
Research challenges (fresh-agent briefs):
- Challenge 01: Primitives atomicity
- Challenge 02: Architecture at scale — Tier 2 SQL ceiling
- Challenge 03: Competitive landscape
- Challenge 04: First principles audit
- Challenge 05: Transformation problem
- Challenge 06: Pairwise vs synthetic spine — open
- Challenge 07: Link metadata edge model — resolved by 04-10 evidence-link synthesis
Concept pages (terminology and conceptual depth):
- Terminology — definitions for ontology, crosswalk, evidence link, edge metadata, StewardshipProfile (formerly EvolutionPattern), etc.
- Ontology lifecycle — Acquire → Import → Enrich → Maintain → Share
- Ontology evolution — versioning, drift, SCD types
- Schema matching — pairwise vs pivot approaches
- Framework crosswalks — typed inter-framework links
- Framework versioning — version models
- File-based graph databases — files-canonical reasoning
- Metadata ecosystem — Bases vs Dataview vs Datacore
- Operational landscape — runtime tier picture
- What makes Crosswalker unique
Roadmap and challenge index:
- Roadmap — root
- Roadmap: Foundation section — where every open question above is tracked
- Research challenges index — all 7
Undistilled .workspace/ drafts (gitignored, repo root):
These two 04-10 research drafts haven’t been distilled into KB logs yet — flagged for a future cleanup pass:
Claude-Ontology primitives for knowledge work architecture.md(~92 KB) — largest of the 04-10 batchClaude-Ontology primitives for resilient knowledge work.md(~35 KB)
Six other .workspace/ drafts from the 04-10 batch have already been distilled into the two syntheses above but remain in .workspace/ until the cleanup pass.