Skip to content

Latest commit

History

16 Commits

Folders and files

NameName
Last commit message
Last commit date

Repository files navigation

dfa

Compiles a regular expression like syntax to fast deterministic finite automata. Useful for pattern matching against non-string sequences.

Example

This example matches Hangul syllables. The symbols defined in the machine are Unicode character categories which could be mapped from code points.

Machine definition:

# define symbolsX=0; # Other characterL=1; # Leading consonantV=2; # Medial vowelT=3; # Trailing consonantLV=4; # Composed <LV> syllableLVT=5; # Composed <LVT> syllableM=6; # Tone mark# define variablesdecomposed=LV T?;
partial=LV T?;
composed= LVT;
# define main state machine patternmain= (decomposed | partial | composed) M?;

Visualized, the machine looks like this (double circles are accepting states):

dfa

Compiling and using the machine:

importcompilefrom'dfa/compile';importfsfrom'fs';letstateMachine=compile(fs.readFileSync('hangul.machine','utf8'));// find matchesfor(let[startIndex,endIndex]ofstateMachine.match([0,1,2,3,0,4,6]){console.log('match:',startIndex,endIndex);}

Output:

match: 1 3
match: 5 6

Syntax

A state machine file contains a list of assignment statements. Comments are also allowed and are started with the # character. Each statement is an assignment of a variable name to a value or expression. Assigning a variable to a number produces a symbol, which is added to the state machine's alphabet. Assigning a variable to an expression allows for substitutions into later expressions. The special main variable should always be assigned to at the end of the file, and is the final expression that will be compiled.

A subset of common regular expression syntax is supported. A list of operators and their precedence is below. Operators with the same precedence are evaluated left to right.

PrecedenceSyntaxTypeMeaning
1a | bAlternationMatches either a or b
2a bConcatenationMatches a followed by b
3a*RepetitionMatches zero or more occurrences of a
3a+RepetitionMatches one ore more occurrences of a
3a?OptionalMatches zero or one occurrence of a
3a{n}RepetitionMatches exactly n occurrences of a
3a{n,}RepetitionMatches n or more occurrences of a
3a{,n}RepetitionMatches up to n occurrences of a
3a{n,m}RepetitionMatches n to m occurrences of a
4t:<expr>TagTags the following expression with tag t
5(<expr>)GroupingGroups an expression

License

MIT

About

State machine compiler with regular expression style syntax

Resources

Stars

62 stars

Watchers

5 watching

Forks

Releases

Packages

Used by

Contributors

Languages