IModelGPU::CreateModelInstanceGPU

Navigation

API > API/Runtime > API/Runtime/NNE > API/Runtime/NNE/IModelGPU

Description

Create a model instance for inference

The runtime have the opportunity to share the model weights among multiple IModelInstanceGPU created from an IModelGPU instance, however this is not mandatory. The caller can decide to convert the result into a shared pointer if required (e.g. if the model needs to be shared with an async task for evaluation).

TSharedPtr< UE::NNE::IModelInstanceGPU > CreateModelInstanceGPU()  
Copy full snippet

TSharedPtr< UE::NNE::IModelInstanceGPU > CreateModelInstanceGPU()

A caller owned model representing the neural network instance created.