This reference describes unreleased code on main; no release documents it yet.

rlmesh::ext::ModelServeOptions

structPreviewuse rlmesh::ext::ModelServeOptions;[source]

The Rust- and C-only fields of a model serve, reached through ModelServeOptions::ext.

struct ModelServeOptions

Fields

tokenBearer token every model RPC must carry.
predict_concurrencyHow many Join-stream requests the served model processes at once per connection; None is the build's default cap.

token

field[source]

token: Option<String>

Bearer token every model RPC must carry. RLMESH_MODEL_ENDPOINT_TOKEN, when set, replaces it. None or empty disables authentication.

predict_concurrency

field[source]

predict_concurrency: Option<usize>

How many Join-stream requests the served model processes at once per connection; None is the build’s default cap. Some(0) is the ValueError class. Corner calls stay serialized either way.

Trait implementations

impl Clone for ModelServeOptions
impl Debug for ModelServeOptions
impl Default for ModelServeOptions