Labeled Automaton

Try out the automaton with the sample text:

<h1>Important Heading</h1>

When the automaton reaches the final state, a token has been recognized. A transducer based on this automaton returns a token to its caller when it reaches the final state.

A transducer based on this automaton does the following:

The loop at the start state discards white space characters. Each transition out of the start state saves the first character of a token. Then the loop for the word state or the loop for the tag state collect characters for the token.

Finally, when a delimiter is read, a transition is made to the final state and the token is returned.