FSyntaxTokenizer | Unreal Engine 5.7 Documentation

Tokenize the text based upon the given rule set


Name	FSyntaxTokenizer
Type	class
Header File	/Engine/Source/Runtime/Slate/Public/Framework/Text/SyntaxTokenizer.h
Include Path	#include "Framework/Text/SyntaxTokenizer.h"

Syntax

class FSyntaxTokenizer : public ISyntaxTokenizer

Name	Remarks	Include Path	Unreal Specifiers
FSyntaxTokenizer ( TArray< FRule > InRules )		Framework/Text/SyntaxTokenizer.h

Name	Remarks	Include Path	Unreal Specifiers
virtual ~FSyntaxTokenizer()		Framework/Text/SyntaxTokenizer.h

Name	Remarks
FRule	Rule used to match syntax token types

Name	Type	Remarks	Include Path	Unreal Specifiers
Rules	TArray< FRule >	Rules to control the tokenizer, processed in-order so the most greedy matches must come first	Framework/Text/SyntaxTokenizer.h

Name	Remarks	Include Path	Unreal Specifiers
virtual void Process ( TArray< FTokenizedLine >& OutTokenizedLines, const FString& Input )		Framework/Text/SyntaxTokenizer.h

Name	Remarks	Include Path	Unreal Specifiers
static TSharedRef< FSyntaxTokenizer > Create ( TArray< FRule > InRules )	Create a new tokenizer which will use the given rules to match syntax tokens	Framework/Text/SyntaxTokenizer.h