UE::NNE::IModelInstanceGPU Class Reference

#include <NNERuntimeGPU.h>

Inheritance diagram for UE::NNE::IModelInstanceGPU:

Additional Inherited Members
Public Types inherited from UE::NNE::IModelInstanceRunSync
using	ESetInputTensorShapesStatus = EResultStatus
using	ERunSyncStatus = EResultStatus
Public Member Functions inherited from UE::NNE::IModelInstanceRunSync
virtual	~IModelInstanceRunSync ()=default
virtual TConstArrayView< FTensorDesc >	GetInputTensorDescs () const =0
virtual TConstArrayView< FTensorDesc >	GetOutputTensorDescs () const =0
virtual TConstArrayView< FTensorShape >	GetInputTensorShapes () const =0
virtual TConstArrayView< FTensorShape >	GetOutputTensorShapes () const =0
virtual ESetInputTensorShapesStatus	SetInputTensorShapes (TConstArrayView< FTensorShape > InInputShapes)=0
virtual ERunSyncStatus	RunSync (TConstArrayView< FTensorBindingCPU > InInputTensors, TConstArrayView< FTensorBindingCPU > InOutputTensors)=0

Detailed Description

The interface of a model instance that can run on GPU.

Use UE::NNE::IModelGPU::CreateModelInstance() to get a model instance. Use UE::NNE::GetRuntime<INNERuntimeGPU>(RuntimeName) to get a runtime capable of creating GPU models.

---

The documentation for this class was generated from the following file:

• Engine/Source/Runtime/NNE/Public/NNERuntimeGPU.h