Skip to content

Oxiland 0.x roadmap

Status: active
Applies to: Oxiland 0.1 through 0.13 Companion plans: architecture, compatibility, verification, and execution. Durable backend expansion is specified separately in the storage backend plan.

The 0.x series is compatibility-driven. Minor versions may change Rust APIs, but every breaking change requires migration notes, and RDF/SPARQL behavior must never change silently. Dates are intentionally omitted: a milestone ships only when its evidence gates are satisfied.

Release train

Version Outcome Depends on State
0.1 Trusted core model complete
0.2 Redland-shaped RDF I/O 0.1 complete
0.3 Complete query/result workflows 0.2 complete
0.4 Durable storage and transactions 0.3 complete
0.5 Streams, utilities, and observability 0.4 complete
0.6 Accounted safe Rust parity 0.5 complete
0.7 Pythonic package on PyPI 0.4 (sequenced after 0.6) complete
0.8 Auditable C ABI preview 0.6 complete
0.9 Downstream C compatibility 0.8 complete
0.10 Freeze 1.0 contracts and build qualification scaffolding 0.9 complete
0.11 Demonstrated full Redland parity from native, revision-bound evidence 0.10 complete
0.12 Performance optimization (ADR-028 competitive parity) 0.11 complete
0.13 Suite-wide faster-than-Redland (ADR-029; three runs × three hosts) 0.12 complete

States are planned, in progress, blocked, or complete. A state changes only after the evidence links are added to the root parity ledger.

0.7 may begin design against the 0.4 storage contract, but it is sequenced after 0.6 so the Python surface maps a reviewed safe Rust API rather than a moving facade. 0.8 (C ABI) remains gated on 0.6 independently of Python.

Storage backend expansion is a cross-cutting 0.8–0.10 track. 0.8 extracts and proves a backend-neutral durable adapter before the C ABI freezes backend selection; 0.9 implements and validates optional adapters; 0.10 stabilizes the supported matrix and its migration guarantees. Fjall remains the default and format-v1 compatibility baseline throughout this work.

Rules for every milestone

Each release must:

  • retain a compiling example of its primary workflow;
  • update the API inventory and parity ledger;
  • document additions, breaking changes, and known deviations;
  • pass the release gates defined in the verification plan;
  • record architecture or compatibility decisions that affect later phases;
  • avoid placeholder APIs that imply support but return generic errors.

0.1 — Core model

Outcome: establish the safe Rust vocabulary and a dependable in-memory graph.

State: complete
Evidence: parity ledger, 0.1 compatibility report, inventory

Deliverables:

  • World, RDF terms, statements, models, contexts, and pattern matching.
  • In-memory Oxigraph storage.
  • Basic SPARQL query execution.
  • Public error model and feature flags.
  • Initial parity inventory and documentation.
  • Experimental Fjall-backed persistence via Model::open, without a stable on-disk compatibility or transaction promise.
  • Named-graph-aware removal and containment operations.
  • Streaming Model::find via StatementMatches (ADR-005).
  • Rustdoc examples showing construction, CRUD, contexts, and SPARQL.

Evidence gates:

  • Core CRUD, duplicates, invalid input, and named-graph behavior have tests.
  • Public APIs build without Clippy warnings.
  • Rust 1.87 and stable Rust are tested.
  • Every exposed item has Rustdoc documentation.
  • 0.1 inventory rows cite implementation and test locations.
  • Direct Oxigraph term re-exports (ADR-004) and streaming find (ADR-005) are accepted.

Not in this milestone: polished parser/serializer facades, stable durable-store guarantees, transactions, backup/migration workflows, or a C ABI. The experimental Fjall path is intentionally promoted to a supported storage contract only in 0.4.

0.2 — RDF input and output

Outcome: match Redland parser and serializer workflows through safe, stream-oriented APIs.

State: complete Execution specification: milestone 0.2 Evidence: parity ledger, 0.2 compatibility report, inventory

Deliverables:

  • Safe Parser and Serializer facades.
  • Reader, writer, string, file, and base-IRI entry points.
  • Syntax discovery by name, MIME type, and file extension.
  • Namespace configuration and serializer features.
  • Turtle, N-Triples, N-Quads, TriG, and RDF/XML where supported by Oxigraph.
  • Explicit parser source, graph-target, and blank-node-scope semantics.
  • Bounded streaming paths that do not require loading an entire document.

Evidence gates:

  • Parser output/atomicity and format-discovery decisions are accepted.
  • Round-trip tests exist for every supported syntax.
  • Parser errors preserve useful source locations.
  • Supported and unsupported Redland syntax names are documented.
  • Base IRI, relative IRI, language tag, datatype, and malformed-input cases pass.
  • Applicable W3C syntax conformance manifests run in Oxiland CI.
  • At least one large-input test demonstrates bounded parser memory behavior.

Depends on: stable model insertion/context semantics from 0.1.

0.3 — Query and results

Outcome: provide complete Redland-style SPARQL workflows without forcing result materialization.

State: complete Execution specification: milestone 0.3 Evidence: parity ledger, 0.3 compatibility report, inventory

Deliverables:

  • Parsed queries, base IRIs, limit, offset, and query features.
  • Boolean, bindings, graph, and syntax result forms.
  • Streaming solution and graph-result iterators.
  • SPARQL Update and dataset selection.
  • Result serialization in Redland-supported formats where practical.
  • Variable lookup by name and position with explicit unbound semantics.
  • Query cancellation/timeout policy, even if the initial policy is unsupported.

Evidence gates:

  • Each query result kind has positive, empty, and failure-path tests.
  • Query and update facade behavior is covered by inventory-linked tests and the SPARQL smoke harness (classification: oxiland-facade). Native Rasqal differential oracles remain deferred (see 0.3 report).
  • Iterator lifetimes do not require materializing full result sets.
  • Ordering is asserted only where SPARQL guarantees it.
  • Dataset/default-graph behavior has facade tests; native differential fixtures expand when Rasqal oracles land.
  • Query error categories preserve parse versus evaluation failures.

Depends on: 0.2 dataset loading and result serialization.

0.4 — Storage and transactions

Outcome: cover durable models and Redland storage semantics with explicit backend capabilities.

State: complete Execution specification: milestone 0.4 Evidence: parity ledger, 0.4 compatibility report, inventory

Deliverables:

  • Stable memory and fjall storage constructors.
  • Storage options with typed configuration.
  • Transactions, sync, bulk loading, and graph clearing.
  • Storage capability reporting.
  • Import/export paths for legacy Redland stores where feasible.
  • Locking, read-only, backup, and unsupported-option behavior.
  • A per-legacy-backend decision record.

Evidence gates:

  • Crash-safe persistence and reopen tests pass.
  • Transaction commit and rollback tests pass.
  • Unsupported legacy backends return explicit capability errors.
  • Storage compatibility decisions are recorded in the parity ledger.
  • Concurrent reader/writer behavior is tested and documented.
  • A persistent store created by each supported prior Oxiland minor version can be opened or migrated.
  • fjall remains the durable backend and the default build stays free of native C++ deps.

Depends on: stable model, I/O, and update behavior from 0.1–0.3.

0.5 — Streams, utilities, and observability

Outcome: complete the non-query high-level Rust surface needed for Redland workflow parity.

State: complete
Execution specification: milestone 0.5
Design: 0.5-streams-utilities.md
Release evidence: 0.5 compatibility report, inventory

Deliverables:

  • Lazy statement streams and generic iterators.
  • URI helpers, digests, filename/URI heuristics, and Unicode helpers.
  • Logging facade with optional tracing integration.
  • Namespace concepts and well-known RDF vocabulary constants.
  • Standard-library replacements for Redland hashes and lists.
  • Deterministic callback and iterator error behavior.
  • Migration examples for APIs intentionally replaced by Rust primitives.

Evidence gates:

  • Stream APIs are lazy and covered by early-termination tests.
  • Utility output is differentially tested against Redland.
  • No compatibility utility panics on malformed external input.
  • Logging levels/facilities and callback ordering are fixture-tested.
  • Every hash/list/manual-memory symbol has a documented Rust mapping or non-applicable rationale.

Depends on: the stable error and lifetime models exercised by 0.1–0.4.

0.6 — Safe Rust API parity

Outcome: account for the full public Redland API in a reviewed safe Rust surface.

State: complete
Evidence: parity ledger, 0.6 compatibility report, inventory, milestone plan

Deliverables:

  • Finish the generated Redland function inventory (header-derived).
  • Map every symbol to a Rust API, compatibility shim, or documented non-applicable ownership operation.
  • Add rdfproc-equivalent command workflows.
  • Stabilize feature and error semantics.
  • Publish a Redland-to-Oxiland migration guide.
  • Freeze naming and module conventions intended for 1.0.

Evidence gates:

  • The inventory has no unclassified public symbols.
  • All applicable safe-Rust mappings have tests.
  • The parity ledger reports 100% safe-API accounting, not C ABI parity.
  • An external API review finds no unresolved soundness or ownership issues.
  • cargo semver-checks or an equivalent public-API snapshot is established.
  • Every accepted deviation names impact, workaround, owner, and review date.

Depends on: all high-level safe API milestones.

0.7 — Python package

Outcome: ship a maintained PyPI package with Pythonic interfaces over the safe Rust facade—not a mechanical 1:1 port of every Rust type and builder.

State: complete
Evidence: parity ledger, 0.7 compatibility report, milestone plan, design, ADR-017

Deliverables:

  • A separate installable package (working name oxiland, published to PyPI) built against the Rust crate (for example PyO3 / maturin), not against oxiland-capi.
  • Idiomatic Python surface for models, terms, I/O, SPARQL query/update, and results: keyword arguments, properties, context managers where acquisition and release apply, and iterators that follow the iterator protocol.
  • A documented exception hierarchy aligned with Oxiland error categories (not raw stringly Rust error text as the only API).
  • Type hints and packaging that support static checkers (PEP 561 / stub or inline annotations).
  • pathlib.Path / path-like acceptance for file entry points; buffer/bytes and text paths that match Python I/O norms.
  • Streaming result and parse consumers that do not force full materialization when the Rust facade streams.
  • Python examples and a standalone documentation track that teach installation, models, I/O, SPARQL, operations, and the API on Python's own terms.
  • An explicit design note for what is not mirrored 1:1 from Rust (builders flattened to functions/kwargs, ownership differences, naming).
  • Optional interop story evaluated and recorded (for example converting to/from common Python RDF types); first release may ship without rdflib integration if the ADR rejects it for scope.

Evidence gates:

  • Wheel (or equivalent) builds and installs cleanly in CI on the published platform matrix.
  • Pytest covers model CRUD, parse/serialize, ASK/SELECT/Update, and failure paths through the Python API.
  • Public Python APIs have type information checked in CI.
  • Docs and examples run as part of the Python package verification.
  • The package does not claim CPython ABI stability tied to oxiland-capi, and does not present itself as a drop-in for legacy Redland Python bindings unless a later decision adds that claim with fixtures.
  • A design/ADR records the Pythonic-vs-thin-binding boundary before the first public beta.

Not in this milestone: wrapping every Oxigraph or Redland Python API; a pure ctypes/cffi binding of the C ABI; guaranteeing behavioral identity with rdflib; or freezing the Python API for 1.0 before 0.10 soak.

Depends on: durable models and query/update from 0.3–0.4, and reviewed safe Rust mappings from 0.6 before a non-experimental PyPI release.

0.8 — C ABI preview

Outcome: run representative existing C consumers against an auditable Oxiland compatibility library.

State: complete
Evidence: parity ledger, 0.8 compatibility report, inventory, milestone plan, design, ADR-022, ADR-023

Deliverables:

  • A separate oxiland-capi workspace crate.
  • A sealed durable-store adapter boundary with Fjall running through it; no backend-native type crosses the safe facade or C ABI.
  • Typed backend selection and availability/capability discovery that can name a known but disabled optional adapter without treating it as an unknown store.
  • Generated librdf.h-compatible declarations.
  • Opaque handles, allocation rules, callbacks, and error translation.
  • cdylib and staticlib artifacts.
  • Symbol versioning and platform naming strategy.
  • Panic containment and a documented thread-safety matrix.
  • Installable headers and pkg-config metadata.

Evidence gates:

  • A representative unmodified Redland C program compiles and runs.
  • Sanitizers find no leaks, use-after-free, or callback lifetime defects.
  • Exported-symbol checks run in CI on supported platforms.
  • ABI limitations are documented prominently.
  • Every exported pointer type has allocation, aliasing, and destruction tests.
  • Null, invalid UTF-8, callback re-entry, and double-free defenses are tested.
  • No unsafe block lacks a local safety argument.
  • The existing Fjall format-v1 and storage transaction suites pass through the common backend conformance harness.
  • The default build remains free of native C/C++ storage dependencies.

Depends on: 0.6 safe API accounting and stable ownership semantics.

0.9 — C compatibility and ecosystem validation

Outcome: prove broad source and behavioral compatibility using real consumers.

State: complete

Deliverables:

  • Complete applicable C symbol implementations.
  • First-party optional storage adapters for redb, RocksDB, SQLite, and LMDB, each behind an explicit Cargo feature and selected through the common API.
  • Evidence-backed promote/defer/reject decisions for sled, LevelDB, MDBX, and SurrealKV; no evaluation backend is advertised as supported before it passes the common crash, reopen, transaction, and platform gates.
  • Consistent backend selection and capability discovery in Rust, the CLI, Python, and C, plus standards-RDF and evaluated direct-copy migration paths.
  • Differential harnesses that execute the same cases against both libraries.
  • Builds of selected Redland language bindings and downstream applications.
  • Performance and memory baselines.
  • A published supported-platform and downstream-consumer matrix.
  • Packaging smoke tests using installed rather than workspace artifacts.

Evidence gates:

  • The C symbol inventory has no unexplained gaps.
  • Selected downstream consumers pass their test suites unchanged.
  • Known behavioral deviations are either fixed or accepted in published compatibility notes.
  • No severity-high correctness or memory-safety defect remains open.
  • Source and ABI claims are separately measured on each supported platform.
  • Performance regressions above agreed budgets have decisions, not silent waivers.
  • Every promoted storage adapter passes the shared conformance suite and its documented feature/platform build matrix.
  • Opening a store with the wrong backend fails before any files are initialized or mutated.

Depends on: a sanitizer-clean 0.8 ABI preview.

0.10 — Qualification scaffold

Outcome: freeze the intended 1.0 contracts, complete the candidate function surface, and build the first parity/performance qualification bundle.

State: complete

Execution specification: milestone 0.10

Qualification report: 0.10 report

Deliverables:

  • API and ABI stabilization (Rust, Python package, and C where promised).
  • Freeze the supported storage backend identities, feature names, StorageCapabilities, and per-backend layout-reader policy intended for 1.0.
  • Accept or reject a safe public custom-backend trait after the sealed adapter has been exercised by the first-party matrix.
  • Cross-platform packaging and installation documentation.
  • Upgrade guide for Redland users.
  • Security, fuzzing, interoperability, and performance hardening.
  • A reproducible, apples-to-apples Oxiland-versus-Redland benchmark suite for every supported target/build profile.
  • Support, deprecation, MSRV, and vulnerability-response policies.
  • Reproducible source archives and checksummed release artifacts.

Evidence gates:

  • The candidate public function inventory is classified, the corresponding C exports exist, and local lifecycle/factory tests pass.
  • The target/profile matrix, storage contract, behavior-evidence schema, and comparison workloads are frozen for the corrective qualification phase.
  • The checked-in 0.10 bundle passes scripts/check-0.10-release.py. This proves the 0.10 scaffold is internally consistent; it does not establish native cross-platform differential behavior, source compatibility, or binary ABI interchange.
  • The frozen performance suite and synthetic candidate fixtures exercise the comparison validator. Native per-target wins are not a 0.10 claim and must be re-established on the exact parity-qualified artifacts before 1.0.
  • Rust public-API snapshots and C ABI snapshots are enforced in CI.
  • Python package versioning and wheel matrix are documented and green.
  • CI conformance and local differential smokes are green; native cross-platform differentials remain the 0.11 proof obligation.
  • Documentation includes complete examples for supported Redland workflows.
  • Release candidates receive real downstream testing.
  • No release-blocking item remains in the risk register.
  • A clean environment can install, link, execute, and uninstall every artifact.
  • At least one release-candidate soak period completes without an ABI reset.
  • Every supported durable layout has a tested reader/export path, and removing an adapter cannot strand the only readable copy of user data.

The 0.10 qualification artifacts are retained for audit history. Their verified labels are candidates for 0.11 reverification and do not satisfy the full-parity claim by themselves.

0.11 — Demonstrated full Redland parity

Outcome: prove full parity with pinned Redland librdf 1.0.17 using native, two-sided, revision-bound evidence on every supported target and profile.

State: complete

Execution specification: milestone 0.11

Progress report: 0.11 report

Deliverables:

  • A complete public denominator covering functions, exported data, headers, public types/layouts/constants/macros, callbacks, factories, ownership, errors, CLI workflows, and observable behavior.
  • A data-driven harness that executes each obligation through native Redland and Oxiland release artifacts and compares raw observations.
  • Safe Rust workflow mappings derived from passing behavioral evidence.
  • Unchanged-source C builds and actual binary interchange: programs linked against Redland run against Oxiland without recompilation or relinking.
  • Per-target/profile bundles produced by real executions on those hosts and bound to the exact clean source revision, fixtures, harnesses, and artifacts.
  • A fail-closed checker that derives status from raw results and rejects stale, copied, synthesized, incomplete, or wrong-profile evidence.
  • Candidate-bound sanitizer, fuzz, W3C, storage/crash, downstream, packaging, performance, and soak evidence.

Evidence gates:

  • Every in-scope inventory item maps to positive, boundary, failure, ownership, and callback obligations as applicable, and every obligation passes through both native implementations.
  • Every required target/profile was actually executed; profile results may not be cloned from a shared symbol list or inferred from another host.
  • C source compatibility passes under warnings-as-errors for the frozen corpus and selected unchanged downstream consumers.
  • Redland-built binaries load and pass against Oxiland without rebuild or relink; library identity, symbol versions, calling conventions, layouts, constants, allocator boundaries, and callbacks are verified.
  • There are zero skips, mismatches, accepted deviations, quarantines, capability-error substitutes, migration-only workarounds, stale revisions, and missing raw artifacts inside the denominator.
  • The exact parity-qualified artifacts pass safety, standards, persistence, packaging, performance, independent-reproduction, and soak gates.
  • User-facing documentation matches the verified matrix and no longer labels the C surface a preview once source and binary gates pass.

0.12 — Performance optimization

Outcome: close the ADR-028 competitive-parity gate on the frozen matrix (Oxiland within about 10% of Redland on every required case), fill resource budgets, retain 0.11 parity on the optimized artifacts, and publish scoped ratios. A suite-wide faster-than-Redland claim is closed separately under milestone 0.13 (ADR-029).

State: complete

Execution specification: milestone 0.12

Progress report: 0.12 report

Deliverables:

  • A frozen 0.12 performance suite revision with measured RSS and disk budgets.
  • Attribution for every required loss or tie against Redland on each host.
  • Optimizations for C-call/handle overhead, model scan/stream paths, and any remaining mutation, parse, serialize, or query gaps below the gate.
  • Windows competitiveness at the same statistical threshold as Unix.
  • Fail-closed native performance qualification tooling bound to the candidate revision and artifacts.
  • User and evaluator documentation that publishes per-case ratios with confidence intervals—not a geometric-mean marketing claim.
  • Reconfirmed 0.11 parity, packaging, and soak evidence on the same candidate.

Evidence gates:

  • Every required throughput case has Oxiland/Redland median ratio ≥ 0.90 with a 95% bootstrap CI excluding the competitive-parity failure band on every required target/profile (ADR-028).
  • Every required latency case has Oxiland/Redland median ratio ≤ 1.20 with the same CI rule.
  • Peak memory and disk amplification stay within the frozen budgets.
  • No required case is deleted, marked optional, or waived after a failure.
  • Samples are native (synthetic: false), revision-bound, built with Cargo --release (production compile) and independently reproducible; synthetic, debug/dev, or fabricated paired ratios are rejected.
  • scripts/check-0.11-release.py (parity retention) and the 0.12 performance release checker are green on the same candidate.
  • Risk R-022 has no open trigger on the release candidate.

0.11’s native samples remain the diagnostic baseline. Host-scoped strict wins after library-path isolation are documented separately; suite-wide authorization is the 0.13 ADR-029 nine-cell bundle.

0.13 — Suite-wide faster-than-Redland

Outcome: close ADR-029 by proving three independent corrected-runner passes on Linux, macOS, and Windows against the frozen strict suite.

State: complete

Execution specification: milestone 0.13

Progress report: 0.13 report

Deliverables:

  • Frozen 0.13-suite.json / 0.13-matrix.json with strict thresholds and checksummed perf_bench_0_13.c.
  • Fail-closed collector (run-0.13-performance.py --run-index) and checker (check-0.13-release.py).
  • GitHub Actions qualification matrix (.github/workflows/qualify-0.13.yml).
  • Committed nine-cell evidence under compatibility/qualification/performance/0.13/.

Evidence gates:

  • Every required throughput case has Oxiland/Redland median ratio ≥ 1.05 with 95% bootstrap CI lower bound > 1.0 on every required target.
  • Every required latency case has Oxiland/Redland median ratio ≤ 0.95 with CI upper bound < 1.0.
  • Three independent execution_ids per target; production-compile provenance; RSS budgets within 1.25.
  • scripts/check-0.13-release.py green on the staged nine-cell bundle.

1.0 readiness

Version 1.0 is eligible only after 0.11 has passed the demonstrated full Redland parity gate, 0.12 has closed the ADR-028 competitive-parity performance gate on the exact parity-qualified (and performance-optimized) artifacts, and the suite-wide faster-than-Redland claim (ADR-029) is closed (nine corrected-runner cells via .github/workflows/qualify-0.13.yml / scripts/check-0.13-release.py—complete on tip) or explicitly deferred with documented scope. The safe Rust mappings and the promised C source, binary ABI, and behavioral surfaces must meet their published definitions with no in-scope exclusion or deviation. The Python package (if still in the 1.0 promise) must also meet its published PyPI contract. Independent Raptor/Rasqal APIs not exposed through librdf, third-party plug-ins outside the pinned baseline, and targets outside the published support matrix are not part of the denominator; anything inside that denominator is mandatory.

The release decision consumes the evidence defined above; elapsed time, inventory percentages alone, or a green unit-test suite are insufficient.