Navigation
API > API/Runtime > API/Runtime/NNE
References
| Module | NNE |
| Header | /Engine/Source/Runtime/NNE/Public/NNERuntimeGPU.h |
| Include | #include "NNERuntimeGPU.h" |
Syntax
class IModelInstanceGPU
Remarks
The interface of a model instance that can run on GPU.
Use UE::NNE::IModelGPU::CreateModelInstance() to get a model instance. Use UE::NNE::GetRuntime
Destructors
| Type | Name | Description | |
|---|---|---|---|
  |
Functions
| Type | Name | Description | |
|---|---|---|---|
  |
TConstArrayView< FTensorDesc > | Get the input tensor descriptions as defined by the model, potentially with variable dimensions. | |
  |
TConstArrayView< FTensorShape > | Get the input shapes.SetInputTensorShapes must be called prior of running a model. | |
  |
TConstArrayView< FTensorDesc > | Get the output tensor descriptions as defined by the model, potentially with variable dimensions. | |
  |
TConstArrayView< FTensorShape > | Getters for outputs shapes if they were already resolved. | |
 |
ERunSyncStatus | RunSync
(
TConstArrayView< FTensorBindingGPU > InInputTensors, |
Evaluate the model synchronously. |
 |
ESetInputTensorShapesStatus | SetInputTensorShapes
(
TConstArrayView< FTensorShape > InInputShapes |
Prepare the model to be run with the given input shape. |
Typedefs
| Name | Description |
|---|---|
| ERunSyncStatus | |
| ESetInputTensorShapesStatus |