rlmesh::ModelServeOptions
Options for Model::serve, including cancellation and native extras.
struct ModelServeOptionsFields
options
field[source]options: Option<ServeOptions>The transport lifecycle policy; None drain and close timeouts take
a 5 s cap.
cancel
field[source]cancel: Option<CancelToken>Cancelling it stops the server (drain, close), and serve fails with
the cancellation class.
ext
field[source]ext: Option<ModelServeOptions>The Rust- and C-only extras.
Trait implementations
- impl Clone for ModelServeOptions
- impl Debug for ModelServeOptions
- impl Default for ModelServeOptions