UE::NNE::IModelCPU Class Reference

#include <NNERuntimeCPU.h>

Public Member Functions
virtual	~IModelCPU ()=default
virtual TSharedPtr< UE::NNE::IModelInstanceCPU >	CreateModelInstanceCPU ()=0

Detailed Description

The interface of a model capable of creating model instance that can run on CPU.

Use UE::NNE::GetRuntime<INNERuntimeCPU>(RuntimeName) to get a runtime capable of creating CPU models.

Constructor & Destructor Documentation

~IModelCPU()

virtual UE::NNE::IModelCPU::~IModelCPU ( )

virtualdefault

Member Function Documentation

CreateModelInstanceCPU()

virtual TSharedPtr< UE::NNE::IModelInstanceCPU > UE::NNE::IModelCPU::CreateModelInstanceCPU ( )

pure virtual

Create a model instance for inference

The runtime have the opportunity to share the model weights among multiple IModelInstanceCPU created from an IModelCPU instance, however this is not mandatory. The caller can decide to convert the result into a shared pointer if required (e.g. if the model needs to be shared with an async task for evaluation).

Returns

A caller owned model representing the neural network instance created.

---

The documentation for this class was generated from the following file:

• Engine/Source/Runtime/NNE/Public/NNERuntimeCPU.h