InferenceEngine
interface InferenceEngine
The single seam between Faktel's model-agnostic pipelines and a native runtime (ONNX Runtime, LiteRT, NCNN...). Implement this to plug in a different backend; see the faktel-ort module for the reference implementation.
Functions
Link copied to clipboard
abstract fun createSession(model: ByteArray, options: SessionOptions = SessionOptions()): InferenceSession