1. Epic GamesDeveloper
  3. ULearningAgentsCritic

ULearningAgentsCritic

A critic used for training the policy.

API > API/Plugins > API/Plugins/LearningAgents

A critic used for training the policy. Can be used at inference time to estimate the discounted returns.

   
Name ULearningAgentsCritic
Type class
Header File /Engine/Plugins/Experimental/LearningAgents/Source/LearningAgents/Public/LearningAgentsCritic.h
Include Path #include "LearningAgentsCritic.h"

Syntax

UCLASS (MinimalAPI, BlueprintType, Blueprintable, Meta=(BlueprintSpawnableComponent))  
class ULearningAgentsCritic : public ULearningAgentsManagerListener

Inheritance Hierarchy

Constructors

Name Remarks Include Path Unreal Specifiers
These constructors/destructors are needed to make forward declarations happy. LearningAgentsCritic.h  
  LearningAgentsCritic.h  

Destructors

Name Remarks Include Path Unreal Specifiers

virtual ~ULearningAgentsCritic()

   LearningAgentsCritic.h  

Variables

Protected

Name Type Remarks Include Path Unreal Specifiers
CriticNetwork TObjectPtr< ULearningAgentsNeuralNetwork > The underlying neural network. LearningAgentsCritic.h
  • VisibleAnywhere
  • Transient
  • Category="LearningAgents"
CriticObject TSharedPtr< UE::Learning::FNeuralNetworkCritic > Internal Critic Function Object LearningAgentsCritic.h  
Interactor TObjectPtr< ULearningAgentsInteractor > --Private Data -- LearningAgentsCritic.h
  • VisibleAnywhere
  • Transient
  • Category="LearningAgents"
Policy TObjectPtr< ULearningAgentsPolicy > The policy this critic is associated with. LearningAgentsCritic.h
  • VisibleAnywhere
  • Transient
  • Category="LearningAgents"
Returns TLearningArray< 1, float, TInlineAllocator< 32 > > Buffer to store the computed returns for each agent LearningAgentsCritic.h  
ReturnsIteration TLearningArray< 1, uint64, TInlineAllocator< 32 > > Number of times the returns have been computed for all agents LearningAgentsCritic.h  
ValidAgentIds TArray< int32 > Temp buffers used to record the set of agents that are valid for evaluation LearningAgentsCritic.h  
ValidAgentSet UE::Learning::FIndexSet   LearningAgentsCritic.h  

Functions

Public

Name Remarks Include Path Unreal Specifiers

void EvaluateCritic ()

 -- Blueprint public interface -- LearningAgentsCritic.h
  • BlueprintCallable
  • Category="LearningAgents"

ULearningAgentsNeuralNetwork * GetCriticNetworkAsset()

 Gets the current Network Asset being used LearningAgentsCritic.h
  • BlueprintPure
  • Category="LearningAgents"
-- Non-blueprint public interface -- LearningAgentsCritic.h  

float GetEstimatedDiscountedReturn ( const int32 AgentId
) const

 Gets an estimate of the average discounted return expected by an agent according to the critic. LearningAgentsCritic.h
  • BlueprintPure
  • Category="LearningAgents"
  • Meta=(AgentId=1)

virtual void OnAgentsAdded_Implementation ( const TArray< int32 >& AgentIds
)

   LearningAgentsCritic.h  

virtual void OnAgentsRemoved_Implementation ( const TArray< int32 >& AgentIds
)

   LearningAgentsCritic.h  

virtual void OnAgentsReset_Implementation ( const TArray< int32 >& AgentIds
)

   LearningAgentsCritic.h  

void SetupCritic ( ULearningAgentsManager*& InManager,
ULearningAgentsInteractor*& InInteractor,
ULearningAgentsPolicy*& InPolicy,
ULearningAgentsNeuralNetwork* CriticNeuralNetworkAsset,
const bool bReinitializeCriticNetwork,
const FLearningAgentsCriticSettings& CriticSettings,
const int32 Seed
)

 Initializes a critic to be used with the given agent interactor and critic settings. LearningAgentsCritic.h
  • BlueprintCallable
  • Category="LearningAgents"
  • Meta=(AutoCreateRefTerm="CriticSettings")

Static

Name Remarks Include Path Unreal Specifiers

static ULearningAgentsCritic * MakeCritic ( ULearningAgentsManager*& InManager,
ULearningAgentsInteractor*& InInteractor,
ULearningAgentsPolicy*& InPolicy,
TSubclassOf< ULearningAgentsCritic > Class,
const FName Name,
ULearningAgentsNeuralNetwork* CriticNeuralNetworkAsset,
const bool bReinitializeCriticNetwork,
const FLearningAgentsCriticSettings& CriticSettings,
const int32 Seed
)

 Constructs a Critic to be used with the given agent interactor and critic settings. LearningAgentsCritic.h
  • BlueprintCallable
  • Category="LearningAgents"
  • Meta=(Class="/Script/LearningAgents.LearningAgentsCritic", DeterminesOutputType="Class", AutoCreateRefTerm="CriticSettings")

Ask questions and help your peers Developer Forums

Write your own tutorials or read those from others Learning Library

On this page