Oxiland 0.x roadmap¶
Status: active
Applies to: Oxiland 0.1 through 0.13
Companion plans: architecture,
compatibility, verification, and
execution. Durable backend expansion is specified separately in
the storage backend plan.
The 0.x series is compatibility-driven. Minor versions may change Rust APIs, but every breaking change requires migration notes, and RDF/SPARQL behavior must never change silently. Dates are intentionally omitted: a milestone ships only when its evidence gates are satisfied.
Release train¶
| Version | Outcome | Depends on | State |
|---|---|---|---|
| 0.1 | Trusted core model | — | complete |
| 0.2 | Redland-shaped RDF I/O | 0.1 | complete |
| 0.3 | Complete query/result workflows | 0.2 | complete |
| 0.4 | Durable storage and transactions | 0.3 | complete |
| 0.5 | Streams, utilities, and observability | 0.4 | complete |
| 0.6 | Accounted safe Rust parity | 0.5 | complete |
| 0.7 | Pythonic package on PyPI | 0.4 (sequenced after 0.6) | complete |
| 0.8 | Auditable C ABI preview | 0.6 | complete |
| 0.9 | Downstream C compatibility | 0.8 | complete |
| 0.10 | Freeze 1.0 contracts and build qualification scaffolding | 0.9 | complete |
| 0.11 | Demonstrated full Redland parity from native, revision-bound evidence | 0.10 | complete |
| 0.12 | Performance optimization (ADR-028 competitive parity) | 0.11 | complete |
| 0.13 | Suite-wide faster-than-Redland (ADR-029; three runs × three hosts) | 0.12 | complete |
States are planned, in progress, blocked, or complete. A state changes
only after the evidence links are added to the root
parity ledger.
0.7 may begin design against the 0.4 storage contract, but it is sequenced after 0.6 so the Python surface maps a reviewed safe Rust API rather than a moving facade. 0.8 (C ABI) remains gated on 0.6 independently of Python.
Storage backend expansion is a cross-cutting 0.8–0.10 track. 0.8 extracts and proves a backend-neutral durable adapter before the C ABI freezes backend selection; 0.9 implements and validates optional adapters; 0.10 stabilizes the supported matrix and its migration guarantees. Fjall remains the default and format-v1 compatibility baseline throughout this work.
Rules for every milestone¶
Each release must:
- retain a compiling example of its primary workflow;
- update the API inventory and parity ledger;
- document additions, breaking changes, and known deviations;
- pass the release gates defined in the verification plan;
- record architecture or compatibility decisions that affect later phases;
- avoid placeholder APIs that imply support but return generic errors.
0.1 — Core model¶
Outcome: establish the safe Rust vocabulary and a dependable in-memory graph.
State: complete
Evidence: parity ledger,
0.1 compatibility report,
inventory
Deliverables:
World, RDF terms, statements, models, contexts, and pattern matching.- In-memory Oxigraph storage.
- Basic SPARQL query execution.
- Public error model and feature flags.
- Initial parity inventory and documentation.
- Experimental Fjall-backed persistence via
Model::open, without a stable on-disk compatibility or transaction promise. - Named-graph-aware removal and containment operations.
- Streaming
Model::findviaStatementMatches(ADR-005). - Rustdoc examples showing construction, CRUD, contexts, and SPARQL.
Evidence gates:
- Core CRUD, duplicates, invalid input, and named-graph behavior have tests.
- Public APIs build without Clippy warnings.
- Rust 1.87 and stable Rust are tested.
- Every exposed item has Rustdoc documentation.
- 0.1 inventory rows cite implementation and test locations.
- Direct Oxigraph term re-exports (ADR-004) and streaming find (ADR-005) are accepted.
Not in this milestone: polished parser/serializer facades, stable durable-store guarantees, transactions, backup/migration workflows, or a C ABI. The experimental Fjall path is intentionally promoted to a supported storage contract only in 0.4.
0.2 — RDF input and output¶
Outcome: match Redland parser and serializer workflows through safe, stream-oriented APIs.
State: complete Execution specification: milestone 0.2 Evidence: parity ledger, 0.2 compatibility report, inventory
Deliverables:
- Safe
ParserandSerializerfacades. - Reader, writer, string, file, and base-IRI entry points.
- Syntax discovery by name, MIME type, and file extension.
- Namespace configuration and serializer features.
- Turtle, N-Triples, N-Quads, TriG, and RDF/XML where supported by Oxigraph.
- Explicit parser source, graph-target, and blank-node-scope semantics.
- Bounded streaming paths that do not require loading an entire document.
Evidence gates:
- Parser output/atomicity and format-discovery decisions are accepted.
- Round-trip tests exist for every supported syntax.
- Parser errors preserve useful source locations.
- Supported and unsupported Redland syntax names are documented.
- Base IRI, relative IRI, language tag, datatype, and malformed-input cases pass.
- Applicable W3C syntax conformance manifests run in Oxiland CI.
- At least one large-input test demonstrates bounded parser memory behavior.
Depends on: stable model insertion/context semantics from 0.1.
0.3 — Query and results¶
Outcome: provide complete Redland-style SPARQL workflows without forcing result materialization.
State: complete Execution specification: milestone 0.3 Evidence: parity ledger, 0.3 compatibility report, inventory
Deliverables:
- Parsed queries, base IRIs, limit, offset, and query features.
- Boolean, bindings, graph, and syntax result forms.
- Streaming solution and graph-result iterators.
- SPARQL Update and dataset selection.
- Result serialization in Redland-supported formats where practical.
- Variable lookup by name and position with explicit unbound semantics.
- Query cancellation/timeout policy, even if the initial policy is unsupported.
Evidence gates:
- Each query result kind has positive, empty, and failure-path tests.
- Query and update facade behavior is covered by inventory-linked tests and the
SPARQL smoke harness (
classification: oxiland-facade). Native Rasqal differential oracles remain deferred (see 0.3 report). - Iterator lifetimes do not require materializing full result sets.
- Ordering is asserted only where SPARQL guarantees it.
- Dataset/default-graph behavior has facade tests; native differential fixtures expand when Rasqal oracles land.
- Query error categories preserve parse versus evaluation failures.
Depends on: 0.2 dataset loading and result serialization.
0.4 — Storage and transactions¶
Outcome: cover durable models and Redland storage semantics with explicit backend capabilities.
State: complete Execution specification: milestone 0.4 Evidence: parity ledger, 0.4 compatibility report, inventory
Deliverables:
- Stable memory and fjall storage constructors.
- Storage options with typed configuration.
- Transactions, sync, bulk loading, and graph clearing.
- Storage capability reporting.
- Import/export paths for legacy Redland stores where feasible.
- Locking, read-only, backup, and unsupported-option behavior.
- A per-legacy-backend decision record.
Evidence gates:
- Crash-safe persistence and reopen tests pass.
- Transaction commit and rollback tests pass.
- Unsupported legacy backends return explicit capability errors.
- Storage compatibility decisions are recorded in the parity ledger.
- Concurrent reader/writer behavior is tested and documented.
- A persistent store created by each supported prior Oxiland minor version can be opened or migrated.
- fjall remains the durable backend and the default build stays free of native C++ deps.
Depends on: stable model, I/O, and update behavior from 0.1–0.3.
0.5 — Streams, utilities, and observability¶
Outcome: complete the non-query high-level Rust surface needed for Redland workflow parity.
State: complete
Execution specification: milestone 0.5
Design: 0.5-streams-utilities.md
Release evidence:
0.5 compatibility report,
inventory
Deliverables:
- Lazy statement streams and generic iterators.
- URI helpers, digests, filename/URI heuristics, and Unicode helpers.
- Logging facade with optional
tracingintegration. - Namespace concepts and well-known RDF vocabulary constants.
- Standard-library replacements for Redland hashes and lists.
- Deterministic callback and iterator error behavior.
- Migration examples for APIs intentionally replaced by Rust primitives.
Evidence gates:
- Stream APIs are lazy and covered by early-termination tests.
- Utility output is differentially tested against Redland.
- No compatibility utility panics on malformed external input.
- Logging levels/facilities and callback ordering are fixture-tested.
- Every hash/list/manual-memory symbol has a documented Rust mapping or non-applicable rationale.
Depends on: the stable error and lifetime models exercised by 0.1–0.4.
0.6 — Safe Rust API parity¶
Outcome: account for the full public Redland API in a reviewed safe Rust surface.
State: complete
Evidence: parity ledger,
0.6 compatibility report,
inventory,
milestone plan
Deliverables:
- Finish the generated Redland function inventory (header-derived).
- Map every symbol to a Rust API, compatibility shim, or documented non-applicable ownership operation.
- Add
rdfproc-equivalent command workflows. - Stabilize feature and error semantics.
- Publish a Redland-to-Oxiland migration guide.
- Freeze naming and module conventions intended for 1.0.
Evidence gates:
- The inventory has no unclassified public symbols.
- All applicable safe-Rust mappings have tests.
- The parity ledger reports 100% safe-API accounting, not C ABI parity.
- An external API review finds no unresolved soundness or ownership issues.
cargo semver-checksor an equivalent public-API snapshot is established.- Every accepted deviation names impact, workaround, owner, and review date.
Depends on: all high-level safe API milestones.
0.7 — Python package¶
Outcome: ship a maintained PyPI package with Pythonic interfaces over the safe Rust facade—not a mechanical 1:1 port of every Rust type and builder.
State: complete
Evidence: parity ledger,
0.7 compatibility report,
milestone plan,
design, ADR-017
Deliverables:
- A separate installable package (working name
oxiland, published to PyPI) built against the Rust crate (for example PyO3 / maturin), not againstoxiland-capi. - Idiomatic Python surface for models, terms, I/O, SPARQL query/update, and results: keyword arguments, properties, context managers where acquisition and release apply, and iterators that follow the iterator protocol.
- A documented exception hierarchy aligned with Oxiland error categories (not raw stringly Rust error text as the only API).
- Type hints and packaging that support static checkers (PEP 561 / stub or inline annotations).
pathlib.Path/ path-like acceptance for file entry points; buffer/bytes and text paths that match Python I/O norms.- Streaming result and parse consumers that do not force full materialization when the Rust facade streams.
- Python examples and a standalone documentation track that teach installation, models, I/O, SPARQL, operations, and the API on Python's own terms.
- An explicit design note for what is not mirrored 1:1 from Rust (builders flattened to functions/kwargs, ownership differences, naming).
- Optional interop story evaluated and recorded (for example converting to/from common Python RDF types); first release may ship without rdflib integration if the ADR rejects it for scope.
Evidence gates:
- Wheel (or equivalent) builds and installs cleanly in CI on the published platform matrix.
- Pytest covers model CRUD, parse/serialize, ASK/SELECT/Update, and failure paths through the Python API.
- Public Python APIs have type information checked in CI.
- Docs and examples run as part of the Python package verification.
- The package does not claim CPython ABI stability tied to
oxiland-capi, and does not present itself as a drop-in for legacy Redland Python bindings unless a later decision adds that claim with fixtures. - A design/ADR records the Pythonic-vs-thin-binding boundary before the first public beta.
Not in this milestone: wrapping every Oxigraph or Redland Python API; a pure
ctypes/cffi binding of the C ABI; guaranteeing behavioral identity with
rdflib; or freezing the Python API for 1.0 before 0.10 soak.
Depends on: durable models and query/update from 0.3–0.4, and reviewed safe Rust mappings from 0.6 before a non-experimental PyPI release.
0.8 — C ABI preview¶
Outcome: run representative existing C consumers against an auditable Oxiland compatibility library.
State: complete
Evidence: parity ledger,
0.8 compatibility report,
inventory,
milestone plan,
design, ADR-022, ADR-023
Deliverables:
- A separate
oxiland-capiworkspace crate. - A sealed durable-store adapter boundary with Fjall running through it; no backend-native type crosses the safe facade or C ABI.
- Typed backend selection and availability/capability discovery that can name a known but disabled optional adapter without treating it as an unknown store.
- Generated
librdf.h-compatible declarations. - Opaque handles, allocation rules, callbacks, and error translation.
cdylibandstaticlibartifacts.- Symbol versioning and platform naming strategy.
- Panic containment and a documented thread-safety matrix.
- Installable headers and
pkg-configmetadata.
Evidence gates:
- A representative unmodified Redland C program compiles and runs.
- Sanitizers find no leaks, use-after-free, or callback lifetime defects.
- Exported-symbol checks run in CI on supported platforms.
- ABI limitations are documented prominently.
- Every exported pointer type has allocation, aliasing, and destruction tests.
- Null, invalid UTF-8, callback re-entry, and double-free defenses are tested.
- No
unsafeblock lacks a local safety argument. - The existing Fjall format-v1 and storage transaction suites pass through the common backend conformance harness.
- The default build remains free of native C/C++ storage dependencies.
Depends on: 0.6 safe API accounting and stable ownership semantics.
0.9 — C compatibility and ecosystem validation¶
Outcome: prove broad source and behavioral compatibility using real consumers.
State: complete
Deliverables:
- Complete applicable C symbol implementations.
- First-party optional storage adapters for redb, RocksDB, SQLite, and LMDB, each behind an explicit Cargo feature and selected through the common API.
- Evidence-backed promote/defer/reject decisions for sled, LevelDB, MDBX, and SurrealKV; no evaluation backend is advertised as supported before it passes the common crash, reopen, transaction, and platform gates.
- Consistent backend selection and capability discovery in Rust, the CLI, Python, and C, plus standards-RDF and evaluated direct-copy migration paths.
- Differential harnesses that execute the same cases against both libraries.
- Builds of selected Redland language bindings and downstream applications.
- Performance and memory baselines.
- A published supported-platform and downstream-consumer matrix.
- Packaging smoke tests using installed rather than workspace artifacts.
Evidence gates:
- The C symbol inventory has no unexplained gaps.
- Selected downstream consumers pass their test suites unchanged.
- Known behavioral deviations are either fixed or accepted in published compatibility notes.
- No severity-high correctness or memory-safety defect remains open.
- Source and ABI claims are separately measured on each supported platform.
- Performance regressions above agreed budgets have decisions, not silent waivers.
- Every promoted storage adapter passes the shared conformance suite and its documented feature/platform build matrix.
- Opening a store with the wrong backend fails before any files are initialized or mutated.
Depends on: a sanitizer-clean 0.8 ABI preview.
0.10 — Qualification scaffold¶
Outcome: freeze the intended 1.0 contracts, complete the candidate function surface, and build the first parity/performance qualification bundle.
State: complete
Execution specification: milestone 0.10
Qualification report: 0.10 report
Deliverables:
- API and ABI stabilization (Rust, Python package, and C where promised).
- Freeze the supported storage backend identities, feature names,
StorageCapabilities, and per-backend layout-reader policy intended for 1.0. - Accept or reject a safe public custom-backend trait after the sealed adapter has been exercised by the first-party matrix.
- Cross-platform packaging and installation documentation.
- Upgrade guide for Redland users.
- Security, fuzzing, interoperability, and performance hardening.
- A reproducible, apples-to-apples Oxiland-versus-Redland benchmark suite for every supported target/build profile.
- Support, deprecation, MSRV, and vulnerability-response policies.
- Reproducible source archives and checksummed release artifacts.
Evidence gates:
- The candidate public function inventory is classified, the corresponding C exports exist, and local lifecycle/factory tests pass.
- The target/profile matrix, storage contract, behavior-evidence schema, and comparison workloads are frozen for the corrective qualification phase.
- The checked-in 0.10 bundle passes
scripts/check-0.10-release.py. This proves the 0.10 scaffold is internally consistent; it does not establish native cross-platform differential behavior, source compatibility, or binary ABI interchange. - The frozen performance suite and synthetic candidate fixtures exercise the comparison validator. Native per-target wins are not a 0.10 claim and must be re-established on the exact parity-qualified artifacts before 1.0.
- Rust public-API snapshots and C ABI snapshots are enforced in CI.
- Python package versioning and wheel matrix are documented and green.
- CI conformance and local differential smokes are green; native cross-platform differentials remain the 0.11 proof obligation.
- Documentation includes complete examples for supported Redland workflows.
- Release candidates receive real downstream testing.
- No release-blocking item remains in the risk register.
- A clean environment can install, link, execute, and uninstall every artifact.
- At least one release-candidate soak period completes without an ABI reset.
- Every supported durable layout has a tested reader/export path, and removing an adapter cannot strand the only readable copy of user data.
The 0.10 qualification artifacts are retained for audit history. Their
verified labels are candidates for 0.11 reverification and do not satisfy the
full-parity claim by themselves.
0.11 — Demonstrated full Redland parity¶
Outcome: prove full parity with pinned Redland librdf 1.0.17 using native,
two-sided, revision-bound evidence on every supported target and profile.
State: complete
Execution specification: milestone 0.11
Progress report: 0.11 report
Deliverables:
- A complete public denominator covering functions, exported data, headers, public types/layouts/constants/macros, callbacks, factories, ownership, errors, CLI workflows, and observable behavior.
- A data-driven harness that executes each obligation through native Redland and Oxiland release artifacts and compares raw observations.
- Safe Rust workflow mappings derived from passing behavioral evidence.
- Unchanged-source C builds and actual binary interchange: programs linked against Redland run against Oxiland without recompilation or relinking.
- Per-target/profile bundles produced by real executions on those hosts and bound to the exact clean source revision, fixtures, harnesses, and artifacts.
- A fail-closed checker that derives status from raw results and rejects stale, copied, synthesized, incomplete, or wrong-profile evidence.
- Candidate-bound sanitizer, fuzz, W3C, storage/crash, downstream, packaging, performance, and soak evidence.
Evidence gates:
- Every in-scope inventory item maps to positive, boundary, failure, ownership, and callback obligations as applicable, and every obligation passes through both native implementations.
- Every required target/profile was actually executed; profile results may not be cloned from a shared symbol list or inferred from another host.
- C source compatibility passes under warnings-as-errors for the frozen corpus and selected unchanged downstream consumers.
- Redland-built binaries load and pass against Oxiland without rebuild or relink; library identity, symbol versions, calling conventions, layouts, constants, allocator boundaries, and callbacks are verified.
- There are zero skips, mismatches, accepted deviations, quarantines, capability-error substitutes, migration-only workarounds, stale revisions, and missing raw artifacts inside the denominator.
- The exact parity-qualified artifacts pass safety, standards, persistence, packaging, performance, independent-reproduction, and soak gates.
- User-facing documentation matches the verified matrix and no longer labels the C surface a preview once source and binary gates pass.
0.12 — Performance optimization¶
Outcome: close the ADR-028 competitive-parity gate on the frozen matrix (Oxiland within about 10% of Redland on every required case), fill resource budgets, retain 0.11 parity on the optimized artifacts, and publish scoped ratios. A suite-wide faster-than-Redland claim is closed separately under milestone 0.13 (ADR-029).
State: complete
Execution specification: milestone 0.12
Progress report: 0.12 report
Deliverables:
- A frozen 0.12 performance suite revision with measured RSS and disk budgets.
- Attribution for every required loss or tie against Redland on each host.
- Optimizations for C-call/handle overhead, model scan/stream paths, and any remaining mutation, parse, serialize, or query gaps below the gate.
- Windows competitiveness at the same statistical threshold as Unix.
- Fail-closed native performance qualification tooling bound to the candidate revision and artifacts.
- User and evaluator documentation that publishes per-case ratios with confidence intervals—not a geometric-mean marketing claim.
- Reconfirmed 0.11 parity, packaging, and soak evidence on the same candidate.
Evidence gates:
- Every required throughput case has Oxiland/Redland median ratio ≥
0.90with a 95% bootstrap CI excluding the competitive-parity failure band on every required target/profile (ADR-028). - Every required latency case has Oxiland/Redland median ratio ≤
1.20with the same CI rule. - Peak memory and disk amplification stay within the frozen budgets.
- No required case is deleted, marked optional, or waived after a failure.
- Samples are native (
synthetic: false), revision-bound, built with Cargo--release(production compile) and independently reproducible; synthetic, debug/dev, or fabricated paired ratios are rejected. scripts/check-0.11-release.py(parity retention) and the 0.12 performance release checker are green on the same candidate.- Risk R-022 has no open trigger on the release candidate.
0.11’s native samples remain the diagnostic baseline. Host-scoped strict wins after library-path isolation are documented separately; suite-wide authorization is the 0.13 ADR-029 nine-cell bundle.
0.13 — Suite-wide faster-than-Redland¶
Outcome: close ADR-029 by proving three independent corrected-runner passes on Linux, macOS, and Windows against the frozen strict suite.
State: complete
Execution specification: milestone 0.13
Progress report: 0.13 report
Deliverables:
- Frozen
0.13-suite.json/0.13-matrix.jsonwith strict thresholds and checksummedperf_bench_0_13.c. - Fail-closed collector (
run-0.13-performance.py --run-index) and checker (check-0.13-release.py). - GitHub Actions qualification matrix
(
.github/workflows/qualify-0.13.yml). - Committed nine-cell evidence under
compatibility/qualification/performance/0.13/.
Evidence gates:
- Every required throughput case has Oxiland/Redland median ratio ≥
1.05with 95% bootstrap CI lower bound> 1.0on every required target. - Every required latency case has Oxiland/Redland median ratio ≤
0.95with CI upper bound< 1.0. - Three independent
execution_ids per target; production-compile provenance; RSS budgets within1.25. scripts/check-0.13-release.pygreen on the staged nine-cell bundle.
1.0 readiness¶
Version 1.0 is eligible only after 0.11 has passed the demonstrated full
Redland parity gate, 0.12 has closed the ADR-028 competitive-parity
performance gate on the exact parity-qualified (and performance-optimized)
artifacts, and the suite-wide faster-than-Redland claim (ADR-029) is closed
(nine corrected-runner cells via .github/workflows/qualify-0.13.yml /
scripts/check-0.13-release.py—complete on tip) or explicitly deferred with
documented scope. The safe Rust mappings and the promised C source, binary
ABI, and behavioral surfaces must meet their published definitions with no
in-scope exclusion or deviation. The Python package (if still in the 1.0
promise) must also meet its published PyPI contract. Independent
Raptor/Rasqal APIs not exposed through librdf, third-party plug-ins outside
the pinned baseline, and targets outside the published support matrix are not
part of the denominator; anything inside that denominator is mandatory.
The release decision consumes the evidence defined above; elapsed time, inventory percentages alone, or a green unit-test suite are insufficient.