Types and units

The document operations use typed values, and the database operations add time values. The tables use the type names of your selected language. Use it to find the unit, range, default, and absent value of a field.

Text uses UTF-8. This includes string values, object keys, and JSON, DUST, and EDN input and output. The document builders reject invalid UTF-8 strings and keys. TRON is binary, but its strings and keys also use UTF-8. Byte lengths count encoded bytes, rather than characters.

This matches JSON's UTF-8 requirement for interchange (RFC 8259, section 8.1).

Evaluation and database read results recursively omit object fields containing empty objects or arrays. This includes objects emptied by nested omissions. Null, empty strings, false, zero and array positions stay intact. Input documents and expanded programs preserve their contents.

  • Time and units defines the tick, its range and resolution, and the host conversion.
  • Value types defines documents, formats, node IDs, transactions, entities, instants, durations, numbers, and bytes.
  • Other kinds defines the remaining parameter and result kinds, such as text and counts.

Time and units

The ABI uses one time unit: the 100 ns tick, stored as an i64 count.

  • A duration is a signed tick count.
  • An instant is the tick count since the Unix epoch, 1970-01-01T00:00:00Z. It is in UTC, with no leap seconds and no time zone.
  • DUST durations and UTC values use the same unit, so database data and API parameters need no unit conversion.

Range

An i64 tick count holds approximately 29,227 years on each side of the Unix epoch:

QuantityValue
Largest positive count2^63 - 1 = 9,223,372,036,854,775,807 ticks
Ticks per second10,000,000
Largest positive durationApproximately 922,337,203,685 seconds, or 29,227.7 Gregorian years
Instant range from the Unix epochApproximately 27,258 BCE to 31,197 CE

This covers all written history, including cuneiform from approximately 3400 BCE.

Note

It also covers these fictional settings:

Resolution

One tick is 100 ns, or 0.0000001 s.

Note

At its peak speed, the Parker Solar Probe, the fastest human-made object, travels approximately 19 mm in one tick.

CalculationValue
Probe's peak speed191.2 km/s = 191,200 m/s
Time interval1 tick = 0.0000001 s
Distance = speed × time191,200 × 0.0000001 = 0.01912 m ≈ 19 mm

Thread wake-up jitter on common platforms is microseconds, so a smaller unit gives no useful precision. Windows also counts time in 100 ns units.

Order and time zones

  • Integer ticks have no floating-point rounding. ABI numbers are i64 or f64 only.
  • An instant in UTC ticks has no time zone or daylight-saving state. Each instant has one meaning, and integer comparison gives the time order.
  • The host applies time zones for presentation.
  • Each binding uses the duration and instant types of its language and converts at the call boundary.

Rust conversion

Rust uses std::time::Duration and std::time::SystemTime.

  • Duration has no sign. A negative tick count converts to zero, or to None when a negative value has a meaning: a negative lock_timeout waits without limit.
  • Conversion to ticks truncates sub-tick nanoseconds toward zero.
  • A Duration beyond the i64 tick range saturates.
  • A SystemTime is UNIX_EPOCH plus or minus the tick count. An instant outside the host range causes invalid_argument with code time_out_of_range.
  • None shows an absent instant.

Value types

Each value type has one meaning in every language. Types below use the selected language's spelling.

ValueTypeUnitRangeAbsent
documentDocumentNoneAvailable memoryA null handle
formatFormatNoneJSON, DUST, EDN, TRONNever absent
node_idNodeIdCount0 through 21474836464294967295
transactioni64CountSigned 64-bit integerZero selects the latest snapshot
entityi64CountSigned 64-bit integerNever absent
instantOption<SystemTime>100 ns ticksSigned 64-bit ticks (host ranges differ)Zero when no commit was written
durationDuration or Option<Duration>100 ns ticksSigned 64-bit ticks (host ranges differ)Each field defines its zero or negative sentinel
numberNumber::I64 or Number::F64Nonei64 or finite f64Never absent
bytes&[u8]BytesAvailable memoryAn empty sequence

document

An owned native document preserves ordered members and duplicate keys.

format

The format selects a text codec or binary TRON.

node_id

A node ID selects a node within its owning document.

transaction

A transaction selects a committed database snapshot.

entity

An entity identifies an object in a database.

instant

An instant counts 100 ns ticks since the Unix epoch. An instant outside the host range reports time_out_of_range.

duration

A duration counts 100 ns ticks. Conversions beyond a host duration range saturate.

number

A number is a signed integer or finite floating-point value.

bytes

Bytes contain a borrowed byte sequence with an explicit length.

Other kinds

These kinds have no value type of their own. The signature of each operation gives the exact type. Parameter tables link handle and record kinds to the operation or record that defines them.

KindMeaning
noneThe operation returns no value.
versionAn ABI version number.
textUTF-8 text, or binary bytes for TRON.
integerA signed 64-bit integer.
realA finite 64-bit floating-point number.
countA count that is not negative.
booleanTrue or false.
nameA string: a key, title, path, kind or pattern.
valueA host value. The host mapping gives its document form.
sourceA stored definition path or an inline definition document.

Binding mechanics

Bindings may include these arguments in addition to native operation arguments:

ArgumentPurpose
AllocatorOwns copied output and diagnostics.
Cancellation contextControls cancellation.
Loaded librarySelects the native ABI library.

Optional wrappers such as pointers, Option and Maybe keep the wrapped type's contract.

Record examples

The generator captured each result from the native library.

Activate the license from a token file

rust124 B
let token = std::fs::read_to_string("license.token")?;
stardust::activate(token.trim())?;
let result = stardust::license()?;
Result / 396 B
{:value {:active              true
         :failure             "none"
         :support_end         72580320000000000
         :expires             nil
         :build               nil
         :refused_support_end nil
         :subject             "test"
         :license_id          "test"
         :name                ""
         :license             ""
         :tier                ""}}

Add a typed integer node

rust183 B
let input = stardust::NodeInput { kind: Kind::NUMBER, number: Number::I64(41), ..Default::default() };
let mut builder = stardust::builder()?;
builder.add(input)?;
let result = input;
Result / 137 B
{:value {:parent  nil
         :kind    "number"
         :boolean false
         :number  41
         :key     ""
         :text    ""}}

database/merge_patch

seed_text holds this document:

edn287 B
{:#_ada {:name "Ada"
         :role "engineer"
         :age  36}
 :#_bob {:name   "Bob"
         :role   "engineer"
         :age    41
         :mentor {:#link "#_ada"}}
 :#_cy  {:name "Cy"
         :role "designer"
         :age  29}
 :#_tx  {:author "smoke"
         :reason "seed"}}
rust97 B
let patch = stardust::parse(seed_text, Format::EDN)?;
let result = db.merge_patch(&patch, None)?;
Result / 228 B
{:value {:status       "committed"
         :transaction  4
         :facts        12
         :committed_at 17923367685039269
         :ids          {:#_ada 1
                        :#_bob 2
                        :#_cy  3}}}

database/mutation

birthday_text holds this document:

edn82 B
{:query {:find  [?e]
         :where [[?e "name" "Ada"]]}
 :patch {:?e {:age 37}}}
rust160 B
let source = stardust::parse(birthday_text, Format::EDN)?;
let mutation = db.mutation(&source)?;
let result = mutation.run(None, &RunOptions::default(), None)?;
Result / 153 B
{:value {:status       "committed"
         :transaction  5
         :facts        1
         :committed_at 17923367687196265
         :ids          {}}}

database/patch_definition

definition_text holds this document:

edn133 B
{:parameters {:?role "engineer"}
 :find       [?name]
 :where      [
   [?e "role" ?role]
   [?e "name" ?name]]
 :orderBy    [?name]}
rust141 B
let definition = stardust::parse(definition_text, Format::EDN)?;
let result = db.patch_definition("queries", "people/by_role", &definition)?;
Result / 153 B
{:value {:status       "committed"
         :transaction  3
         :facts        0
         :committed_at 17923367687832135
         :ids          {}}}

document/read

input_text holds this document:

edn7 B
{:x 41}
rust95 B
let input = stardust::parse(input_text, Format::EDN)?;
let result = input.read(input.root()?)?;
Result / 218 B
{:value {:kind         "object"
         :boolean      false
         :parent       nil
         :position     0
         :first_child  1
         :next_sibling nil
         :key          ""
         :text         ""}}

document/read_many

input_text holds this document:

edn7 B
{:x 41}
rust169 B
let input = stardust::parse(input_text, Format::EDN)?;
let views = input.read_many(input.root()?, 1)?;
let result = views.into_iter().next().ok_or("missing node view")?;
Result / 218 B
{:value {:kind         "object"
         :boolean      false
         :parent       nil
         :position     0
         :first_child  1
         :next_sibling nil
         :key          ""
         :text         ""}}

Read the process license

rust34 B
let result = stardust::license()?;
Result / 396 B
{:value {:active              true
         :failure             "none"
         :support_end         72580320000000000
         :expires             nil
         :build               nil
         :refused_support_end nil
         :subject             "test"
         :license_id          "test"
         :name                ""
         :license             ""
         :tier                ""}}

mutation/close

birthday_text holds this document:

edn82 B
{:query {:find  [?e]
         :where [[?e "name" "Ada"]]}
 :patch {:?e {:age 37}}}
rust178 B
let source = stardust::parse(birthday_text, Format::EDN)?;
let mutation = db.mutation(&source)?;
let result = mutation.run(None, &RunOptions::default(), None)?;
mutation.close();
Result / 153 B
{:value {:status       "committed"
         :transaction  5
         :facts        1
         :committed_at 17923367690415775
         :ids          {}}}

mutation/run

birthday_text holds this document:

edn82 B
{:query {:find  [?e]
         :where [[?e "name" "Ada"]]}
 :patch {:?e {:age 37}}}
rust160 B
let source = stardust::parse(birthday_text, Format::EDN)?;
let mutation = db.mutation(&source)?;
let result = mutation.run(None, &RunOptions::default(), None)?;
Result / 153 B
{:value {:status       "committed"
         :transaction  5
         :facts        1
         :committed_at 17923367691241152
         :ids          {}}}

Open with explicit native options

rust151 B
let options = stardust::Options { page_size: 0, ..Default::default() };
let _database = stardust::open(database_path, &options)?;
let result = options;
Result / 302 B
{:value {:create              true
         :clear               false
         :pin_memory          false
         :page_size           0
         :lock_timeout        0
         :initial_map_bytes   0
         :commit_batch        0
         :plugins             nil
         :memory_budget_bytes 0}}

Wait for the database lock without a limit

rust171 B
let options = stardust::Options { page_size: 0, lock_timeout: None, ..Default::default() };
let _database = stardust::open(database_path, &options)?;
let result = options;
Result / 304 B
{:value {:create              true
         :clear               false
         :pin_memory          false
         :page_size           0
         :lock_timeout        nil
         :initial_map_bytes   0
         :commit_batch        0
         :plugins             nil
         :memory_budget_bytes 0}}

Capture the host duration boundary

query_text holds this document:

edn66 B
{:find    [?name]
 :where   [[?e "name" ?name]]
 :orderBy [?name]}

boundary_text holds this document:

edn19 B
9223372036854775807
rust394 B
let definition = stardust::parse(query_text, Format::EDN)?;
let query = db.query(&definition)?;
let boundary = stardust::parse(boundary_text, Format::EDN)?;
let seconds = boundary.i64(boundary.root()?)? as u64;
let options = RunOptions { page_size: 2, max_cost: std::time::Duration::from_secs(seconds), ..Default::default() };
let _rows = query.run(None, &options, None)?;
let result = options;
Result / 85 B
{:value {:page_size 2
         :max_cost  9223372036854775807
         :as_of     0}}

Truncate a positive sub-tick duration

query_text holds this document:

edn66 B
{:find    [?name]
 :where   [[?e "name" ?name]]
 :orderBy [?name]}

boundary_text holds this document:

edn2 B
99
rust391 B
let definition = stardust::parse(query_text, Format::EDN)?;
let query = db.query(&definition)?;
let boundary = stardust::parse(boundary_text, Format::EDN)?;
let nanos = boundary.i64(boundary.root()?)? as u64;
let options = RunOptions { page_size: 2, max_cost: std::time::Duration::from_nanos(nanos), ..Default::default() };
let _rows = query.run(None, &options, None)?;
let result = options;
Result / 67 B
{:value {:page_size 2
         :max_cost  0
         :as_of     0}}

Run with typed query options

query_text holds this document:

edn66 B
{:find    [?name]
 :where   [[?e "name" ?name]]
 :orderBy [?name]}
rust273 B
let definition = stardust::parse(query_text, Format::EDN)?;
let query = db.query(&definition)?;
let options = RunOptions { page_size: 2, max_cost: std::time::Duration::from_secs(1), ..Default::default() };
let _rows = query.run(None, &options, None)?;
let result = options;
Result / 74 B
{:value {:page_size 2
         :max_cost  10000000
         :as_of     0}}

Read the complete initial subscription event

query_text holds this document:

edn66 B
{:find    [?name]
 :where   [[?e "name" ?name]]
 :orderBy [?name]}
rust253 B
let definition = stardust::parse(query_text, Format::EDN)?;
let query = db.query(&definition)?;
let mut subscription = query.subscribe(None, &RunOptions::default())?;
let event = subscription.next().await?.ok_or("no initial event")?;
let result = event;
Result / 138 B
{:value {:sequence    1
         :superseded  0
         :transaction 4
         :result      [{:name "Ada"} {:name "Bob"} {:name "Cy"}]}}