InferenceEngine

interface InferenceEngine

The single seam between Faktel's model-agnostic pipelines and a native runtime (ONNX Runtime, LiteRT, NCNN...). Implement this to plug in a different backend; see the faktel-ort module for the reference implementation.

Functions

Link copied to clipboard
abstract fun createSession(model: ByteArray, options: SessionOptions = SessionOptions()): InferenceSession