UE::NNE::IModelInstanceNPU Class Reference

#include <NNERuntimeNPU.h>

Inheritance diagram for UE::NNE::IModelInstanceNPU:

Additional Inherited Members
Public Types inherited from UE::NNE::IModelInstanceRunSync
using	ESetInputTensorShapesStatus = EResultStatus
using	ERunSyncStatus = EResultStatus
Public Member Functions inherited from UE::NNE::IModelInstanceRunSync
virtual	~IModelInstanceRunSync ()=default
virtual TConstArrayView< FTensorDesc >	GetInputTensorDescs () const =0
virtual TConstArrayView< FTensorDesc >	GetOutputTensorDescs () const =0
virtual TConstArrayView< FTensorShape >	GetInputTensorShapes () const =0
virtual TConstArrayView< FTensorShape >	GetOutputTensorShapes () const =0
virtual ESetInputTensorShapesStatus	SetInputTensorShapes (TConstArrayView< FTensorShape > InInputShapes)=0
virtual ERunSyncStatus	RunSync (TConstArrayView< FTensorBindingCPU > InInputTensors, TConstArrayView< FTensorBindingCPU > InOutputTensors)=0

Detailed Description

The interface of a model instance that can run on NPU.

Use UE::NNE::IModelNPU::CreateModelInstance() to get a model instance. Use UE::NNE::GetRuntime<INNERuntimeNPU>(RuntimeName) to get a runtime capable of creating NPU models.

---

The documentation for this class was generated from the following file:

• Engine/Source/Runtime/NNE/Public/NNERuntimeNPU.h