Token flags

Variables
constexpr int	UNSUPPORTED = 1 << 0
	Unsupported token. Parser will throw an error if it encounters this.
constexpr int	GLOB_EXPAND = 1 << 1
	Tells the parser to expand globs in this kind of token.
constexpr int	VAR_EXPAND = 1 << 2
	Tells the parser to expand variables in this kind of token.
constexpr int	WORD_LIKE = 1 << 3
	This token is a potential argument/command that will be forwarded to argv.
constexpr int	NO_WORD_SPLIT = 1 << 4
	This token is not eligible for word splitting.
constexpr int	COMMAND_SEPARATOR = 1 << 5
	This token separates simple commands. Used for parsing.
constexpr int	REDIRECT = 1 << 6
	This token is a redirect. Used for parsing.
constexpr int	ASSIGNMENT_WORD = 1 << 7
	This token is an assignment word. Used for parsing.

Detailed Description

These flags are used to tell the parser and utilities how to treat a specific token.