Pushdown automaton

Classes of automata

(Clicking on each layer gets an article on that subject)

In the theory of computation, a branch of theoretical computer science, a pushdown automaton (PDA) is a type of automaton that employs a stack.

Pushdown automata are used in theories about what can be computed by machines. They are more capable than finite-state machines but less capable than Turing machines (see below). Deterministic pushdown automata can recognize all deterministic context-free languages while nondeterministic ones can recognize all context-free languages, with the former often used in parser design.

The term "pushdown" refers to the fact that the stack can be regarded as being "pushed down" like a tray dispenser at a cafeteria, since the operations never work on elements other than the top element. A stack automaton, by contrast, does allow access to and operations on deeper elements. Stack automata can recognize a strictly larger set of languages than pushdown automata. ^[1] A nested stack automaton allows full access, and also allows stacked values to be entire sub-stacks rather than just single finite symbols.

Informal description

A diagram of a pushdown automaton

A finite-state machine just looks at the input signal and the current state: it has no stack to work with, and therefore is unable to access previous values of the input. It can only choose a new state, the result of following the transition. A pushdown automaton (PDA) differs from a finite state machine in two ways:

1. It can use the top of the stack to decide which transition to take.
2. It can manipulate the stack as part of performing a transition.

A pushdown automaton reads a given input string from left to right. In each step, it chooses a transition by indexing a table by input symbol, current state, and the symbol at the top of the stack. A pushdown automaton can also manipulate the stack, as part of performing a transition. The manipulation can be to push a particular symbol to the top of the stack, or to pop off the top of the stack. The automaton can alternatively ignore the stack, and leave it as it is.

Put together: Given an input symbol, current state, and stack symbol, the automaton can follow a transition to another state, and optionally manipulate (push or pop) the stack.

If, in every situation, at most one such transition action is possible, then the automaton is called a deterministic pushdown automaton (DPDA). In general, if several actions are possible, then the automaton is called a general, or nondeterministic, PDA. A given input string may drive a nondeterministic pushdown automaton to one of several configuration sequences; if one of them leads to an accepting configuration after reading the complete input string, the latter is said to belong to the language accepted by the automaton.

Formal definition

We use standard formal language notation: ${\displaystyle \Gamma ^{*}}$ denotes the set of finite-length strings over alphabet ${\displaystyle \Gamma }$ and ${\displaystyle \varepsilon }$ denotes the empty string.

A PDA is formally defined as a 7-tuple:

${\displaystyle M=(Q,\Sigma ,\Gamma ,\delta ,q_{0},Z,F)}$ where

• ${\displaystyle Q}$ is a finite set of states
• ${\displaystyle \Sigma }$ is a finite set which is called the input alphabet
• ${\displaystyle \Gamma }$ is a finite set which is called the stack alphabet
• ${\displaystyle \delta }$ is a finite subset of ${\displaystyle Q\times (\Sigma \cup \{\varepsilon \})\times \Gamma \times Q\times \Gamma ^{*}}$, the transition relation
• ${\displaystyle q_{0}\in Q}$ is the start state
• ${\displaystyle Z\in \Gamma }$ is the initial stack symbol
• ${\displaystyle F\subseteq Q}$ is the set of accepting states

An element ${\displaystyle (p,a,A,q,\alpha )\in \delta }$ is a transition of ${\displaystyle M}$. It has the intended meaning that ${\displaystyle M}$, in state ${\displaystyle p\in Q}$, on the input ${\displaystyle a\in \Sigma \cup \{\varepsilon \}}$ and with ${\displaystyle A\in \Gamma }$ as topmost stack symbol, may read ${\displaystyle a}$, change the state to ${\displaystyle q}$, pop ${\displaystyle A}$, replacing it by pushing ${\displaystyle \alpha \in \Gamma ^{*}}$. The ${\displaystyle (\Sigma \cup \{\varepsilon \})}$ component of the transition relation is used to formalize that the PDA can either read a letter from the input, or proceed leaving the input untouched.^{[ citation needed ]}

In many texts ^{[2] : 110} the transition relation is replaced by an (equivalent) formalization, where

• ${\displaystyle \delta }$ is the transition function, mapping ${\displaystyle Q\times (\Sigma \cup \{\varepsilon \})\times \Gamma }$ into finite subsets of ${\displaystyle Q\times \Gamma ^{*}}$

Here ${\displaystyle \delta (p,a,A)}$ contains all possible actions in state ${\displaystyle p}$ with ${\displaystyle A}$ on the stack, while reading ${\displaystyle a}$ on the input. One writes for example ${\displaystyle \delta (p,a,A)=\{(q,BA)\}}$ precisely when ${\displaystyle (q,BA)\in \{(q,BA)\},(q,BA)\in \delta (p,a,A),}$ because ${\displaystyle ((p,a,A),\{(q,BA)\})\in \delta }$. Note that finite in this definition is essential.

Computations

a step of the pushdown automaton

In order to formalize the semantics of the pushdown automaton a description of the current situation is introduced. Any 3-tuple ${\displaystyle (p,w,\beta )\in Q\times \Sigma ^{*}\times \Gamma ^{*}}$ is called an instantaneous description (ID) of ${\displaystyle M}$, which includes the current state, the part of the input tape that has not been read, and the contents of the stack (topmost symbol written first). The transition relation ${\displaystyle \delta }$ defines the step-relation ${\displaystyle \vdash _{M}}$ of ${\displaystyle M}$ on instantaneous descriptions. For instruction ${\displaystyle (p,a,A,q,\alpha )\in \delta }$ there exists a step ${\displaystyle (p,ax,A\gamma )\vdash _{M}(q,x,\alpha \gamma )}$, for every ${\displaystyle x\in \Sigma ^{*}}$ and every ${\displaystyle \gamma \in \Gamma ^{*}}$.

In general pushdown automata are nondeterministic meaning that in a given instantaneous description ${\displaystyle (p,w,\beta )}$ there may be several possible steps. Any of these steps can be chosen in a computation. With the above definition in each step always a single symbol (top of the stack) is popped, replacing it with as many symbols as necessary. As a consequence no step is defined when the stack is empty.

Computations of the pushdown automaton are sequences of steps. The computation starts in the initial state ${\displaystyle q_{0}}$ with the initial stack symbol ${\displaystyle Z}$ on the stack, and a string ${\displaystyle w}$ on the input tape, thus with initial description ${\displaystyle (q_{0},w,Z)}$. There are two modes of accepting. The pushdown automaton either accepts by final state, which means after reading its input the automaton reaches an accepting state (in ${\displaystyle F}$), or it accepts by empty stack (${\displaystyle \varepsilon }$), which means after reading its input the automaton empties its stack. The first acceptance mode uses the internal memory (state), the second the external memory (stack).

Formally one defines

1. ${\displaystyle L(M)=\{w\in \Sigma ^{*}|(q_{0},w,Z)\vdash _{M}^{*}(f,\varepsilon ,\gamma )}$ with ${\displaystyle f\in F}$ and ${\displaystyle \gamma \in \Gamma ^{*}\}}$ (final state)
2. ${\displaystyle N(M)=\{w\in \Sigma ^{*}|(q_{0},w,Z)\vdash _{M}^{*}(q,\varepsilon ,\varepsilon )}$ with ${\displaystyle q\in Q\}}$ (empty stack)

Here ${\displaystyle \vdash _{M}^{*}}$ represents the reflexive and transitive closure of the step relation ${\displaystyle \vdash _{M}}$ meaning any number of consecutive steps (zero, one or more).

For each single pushdown automaton these two languages need to have no relation: they may be equal but usually this is not the case. A specification of the automaton should also include the intended mode of acceptance. Taken over all pushdown automata both acceptance conditions define the same family of languages.

Theorem. For each pushdown automaton ${\displaystyle M}$ one may construct a pushdown automaton ${\displaystyle M'}$ such that ${\displaystyle L(M)=N(M')}$, and vice versa, for each pushdown automaton ${\displaystyle M}$ one may construct a pushdown automaton ${\displaystyle M'}$ such that ${\displaystyle N(M)=L(M')}$

Example

The following is the formal description of the PDA which recognizes the language ${\displaystyle \{0^{n}1^{n}\mid n\geq 0\}}$ by final state:

PDA for ${\displaystyle \{0^{n}1^{n}\mid n\geq 0\}}$
(by final state)

${\displaystyle M=(Q,\ \Sigma ,\ \Gamma ,\ \delta ,\ q_{0},\ Z,\ F)}$, where

• states:${\displaystyle Q=\{p,q,r\}}$
• input alphabet:${\displaystyle \Sigma =\{0,1\}}$
• stack alphabet:${\displaystyle \Gamma =\{A,Z\}}$
• start state:${\displaystyle q_{0}=p}$
• start stack symbol:Z
• accepting states:${\displaystyle F=\{r\}}$

The transition relation ${\displaystyle \delta }$ consists of the following six instructions:

${\displaystyle (p,0,Z,p,AZ)}$,

${\displaystyle (p,0,A,p,AA)}$,

${\displaystyle (p,\epsilon ,Z,q,Z)}$,

${\displaystyle (p,\epsilon ,A,q,A)}$,

${\displaystyle (q,1,A,q,\epsilon )}$, and

${\displaystyle (q,\epsilon ,Z,r,Z)}$.

In words, the first two instructions say that in state p any time the symbol 0 is read, one A is pushed onto the stack. Pushing symbol A on top of another A is formalized as replacing top A by AA (and similarly for pushing symbol A on top of a Z).

The third and fourth instructions say that, at any moment the automaton may move from state p to state q.

The fifth instruction says that in state q, for each symbol 1 read, one A is popped.

Finally, the sixth instruction says that the machine may move from state q to accepting state r only when the stack consists of a single Z.

There seems to be no generally used representation for PDA. Here we have depicted the instruction ${\displaystyle (p,a,A,q,\alpha )}$ by an edge from state p to state q labelled by ${\displaystyle a;A/\alpha }$ (read a; replace A by ${\displaystyle \alpha }$).

Explanation

accepting computation for 0011

The following illustrates how the above PDA computes on different input strings. The subscript M from the step symbol ${\displaystyle \vdash }$ is here omitted.

1. Input string = 0011. There are various computations, depending on the moment the move from state p to state q is made. Only one of these is accepting.
   1. ${\displaystyle (p,0011,Z)\vdash (q,0011,Z)\vdash (r,0011,Z)}$
      The final state is accepting, but the input is not accepted this way as it has not been read.
   2. ${\displaystyle (p,0011,Z)\vdash (p,011,AZ)\vdash (q,011,AZ)}$
      No further steps possible.
   3. ${\displaystyle (p,0011,Z)\vdash (p,011,AZ)\vdash (p,11,AAZ)\vdash (q,11,AAZ)\vdash (q,1,AZ)\vdash (q,\epsilon ,Z)\vdash (r,\epsilon ,Z)}$
      Accepting computation: ends in accepting state, while complete input has been read.
2. Input string = 00111. Again there are various computations. None of these is accepting.
   1. ${\displaystyle (p,00111,Z)\vdash (q,00111,Z)\vdash (r,00111,Z)}$
      The final state is accepting, but the input is not accepted this way as it has not been read.
   2. ${\displaystyle (p,00111,Z)\vdash (p,0111,AZ)\vdash (q,0111,AZ)}$
      No further steps possible.
   3. ${\displaystyle (p,00111,Z)\vdash (p,0111,AZ)\vdash (p,111,AAZ)\vdash (q,111,AAZ)\vdash (q,11,AZ)\vdash (q,1,Z)\vdash (r,1,Z)}$
      The final state is accepting, but the input is not accepted this way as it has not been (completely) read.

Context-free languages

Every context-free grammar can be transformed into an equivalent nondeterministic pushdown automaton. The derivation process of the grammar is simulated in a leftmost way. Where the grammar rewrites a nonterminal, the PDA takes the topmost nonterminal from its stack and replaces it by the right-hand part of a grammatical rule (expand). Where the grammar generates a terminal symbol, the PDA reads a symbol from input when it is the topmost symbol on the stack (match). In a sense the stack of the PDA contains the unprocessed data of the grammar, corresponding to a pre-order traversal of a derivation tree.

Technically, given a context-free grammar, the PDA has a single state, 1, and its transition relation is constructed as follows.

1. ${\displaystyle (1,\varepsilon ,A,1,\alpha )}$ for each rule ${\displaystyle A\to \alpha }$ (expand)
2. ${\displaystyle (1,a,a,1,\varepsilon )}$ for each terminal symbol ${\displaystyle a}$ (match)

The PDA accepts by empty stack. Its initial stack symbol is the grammar's start symbol. ^[3]

For a context-free grammar in Greibach normal form, defining (1,γ) ∈ δ(1,a,A) for each grammar rule A → aγ also yields an equivalent nondeterministic pushdown automaton. ^{[2] : 115}

The converse, finding a grammar for a given PDA, is not that easy. The trick is to code two states of the PDA into the nonterminals of the grammar.

Theorem. For each pushdown automaton ${\displaystyle M}$ one may construct a context-free grammar ${\displaystyle G}$ such that ${\displaystyle N(M)=L(G)}$. ^{[2] : 116}

The language of strings accepted by a deterministic pushdown automaton (DPDA) is called a deterministic context-free language. Not all context-free languages are deterministic. ^{[note 1]} As a consequence, the DPDA is a strictly weaker variant of the PDA. Even for regular languages, there is a size explosion problem: for any recursive function ${\displaystyle f}$ and for arbitrarily large integers ${\displaystyle n}$, there is a PDA of size ${\displaystyle n}$ describing a regular language whose smallest DPDA has at least ${\displaystyle f(n)}$ states. ^[5] For many non-regular PDAs, any equivalent DPDA would require an unbounded number of states.

A finite automaton with access to two stacks is a more powerful device, equivalent in power to a Turing machine. ^{[2] : 171} A linear bounded automaton is a device which is more powerful than a pushdown automaton but less so than a Turing machine. ^{[note 2]}

Turing machines

A pushdown automaton is computationally equivalent to a 'restricted' Turing Machine (TM) with two tapes which is restricted in the following manner- On the first tape, the TM can only read the input and move from left to right (it cannot make changes). On the second tape, it can only 'push' and 'pop' data. Or equivalently, it can read, write and move left and right with the restriction that the only action it can perform at each step is to either delete the left-most character in the string (pop) or add an extra character left to the left-most character in the string (push).

That a PDA is weaker than a TM can be brought down to the fact that the procedure 'pop' deletes some data. In order to make a PDA as strong as a TM, we need to save somewhere the data lost through 'pop'. We can achieve this by introducing a second stack. In the TM model of PDA of last paragraph, this is equivalent to a TM with 3 tapes, where the first tape is the read-only input tape, and the 2nd and the 3rd tape are the 'push and pop' (stack) tapes. In order for such a PDA to simulate any given TM, we give the input of the PDA to the first tape, while keeping both the stacks empty. It then goes on to push all the input from the input tape to the first stack. When the entire input is transferred to the 1st stack, now we proceed like a normal TM, where moving right on the tape is the same as popping a symbol from the 1st stack and pushing a (possibly updated) symbol into the second stack, and moving left corresponds to popping a symbol from the 2nd stack and pushing a (possibly updated) symbol into the first stack. We hence have a PDA with 2 stacks that can simulate any TM.

Generalization

A generalized pushdown automaton (GPDA) is a PDA that writes an entire string of some known length to the stack or removes an entire string from the stack in one step.

A GPDA is formally defined as a 6-tuple:

${\displaystyle M=(Q,\ \Sigma ,\ \Gamma ,\ \delta ,\ q_{0},\ F)}$

where ${\displaystyle Q,\Sigma \,,\Gamma \,,q_{0}}$, and ${\displaystyle F}$ are defined the same way as a PDA.

${\displaystyle \,\delta }$: ${\displaystyle Q\times \Sigma _{\epsilon }\times \Gamma ^{*}\longrightarrow P(Q\times \Gamma ^{*})}$

is the transition function.

Computation rules for a GPDA are the same as a PDA except that the ${\displaystyle a_{i+1}}$'s and ${\displaystyle b_{i+1}}$'s are now strings instead of symbols.

GPDA's and PDA's are equivalent in that if a language is recognized by a PDA, it is also recognized by a GPDA and vice versa.

One can formulate an analytic proof for the equivalence of GPDA's and PDA's using the following simulation:

Let ${\displaystyle \delta (q_{1},w,x_{1}x_{2}\cdot x_{m})\longrightarrow (q_{2},y_{1}y_{2}...y_{n})}$ be a transition of the GPDA

where ${\displaystyle q_{1},q_{2}\in Q,w\in \Sigma _{\epsilon },x_{1},x_{2},\ldots ,x_{m}\in \Gamma ^{*},m\geq 0,y_{1},y_{2},\ldots ,y_{n}\in \Gamma ^{*},n\geq 0}$.

Construct the following transitions for the PDA:

${\displaystyle {\begin{array}{lcl}\delta '(q_{1},w,x_{1})&\longrightarrow &(p_{1},\epsilon )\\\delta '(p_{1},\epsilon ,x_{2})&\longrightarrow &(p_{2},\epsilon )\\&\vdots &\\\delta '(p_{m-1},\epsilon ,x_{m})&\longrightarrow &(p_{m},\epsilon )\\\delta '(p_{m},\epsilon ,\epsilon )&\longrightarrow &(p_{m+1},y_{n})\\\delta '(p_{m+1},\epsilon ,\epsilon )&\longrightarrow &(p_{m+2},y_{n-1})\\&\vdots &\\\delta '(p_{m+n-1},\epsilon ,\epsilon )&\longrightarrow &(q_{2},y_{1}).\end{array}}}$

Stack automata

As a generalization of pushdown automata, Ginsburg, Greibach, and Harrison (1967) investigated stack automata, which may additionally step left or right in the input string (surrounded by special endmarker symbols to prevent slipping out), and step up or down in the stack in read-only mode. ^{[6] [7]} A stack automaton is called nonerasing if it never pops from the stack. The class of languages accepted by nondeterministic, nonerasing stack automata is NSPACE (n²), which is a superset of the context-sensitive languages. ^[1] The class of languages accepted by deterministic, nonerasing stack automata is DSPACE (n⋅log(n)). ^[1]

Alternating pushdown automata

An alternating pushdown automaton (APDA) is a pushdown automaton with a state set

• ${\displaystyle Q=Q_{\exists }\cup Q_{\forall }}$ where ${\displaystyle Q_{\exists }\cap Q_{\forall }=\emptyset }$.

States in ${\displaystyle Q_{\exists }}$ and ${\displaystyle Q_{\forall }}$ are called existential resp. universal. In an existential state an APDA nondeterministically chooses the next state and accepts if at least one of the resulting computations accepts. In a universal state APDA moves to all next states and accepts if all the resulting computations accept.

The model was introduced by Chandra, Kozen and Stockmeyer. ^[8] Ladner, Lipton and Stockmeyer ^[9] proved that this model is equivalent to EXPTIME i.e. a language is accepted by some APDA if, and only if, it can be decided by an exponential-time algorithm.

Aizikowitz and Kaminski ^[10] introduced synchronized alternating pushdown automata (SAPDA) that are equivalent to conjunctive grammars in the same way as nondeterministic PDA are equivalent to context-free grammars.

See also

• Context-free grammar
• Counter automaton
• Finite-state machine
• Queue automaton
• Stack machine

Notes

1. The set of even-length palindromes of bits can't be recognized by a deterministic PDA, but is a context-free language, with the grammar S → ε | 0S0 | 1S1. ^[4]
2. Linear bounded automata are acceptors for the class of context-sensitive languages, ^{[2] : 225} which is a proper superclass of the context-free languages, and a proper subclass of Turing-recognizable (i.e. recursively enumerable) languages. ^{[2] : 228}

References

1. John E. Hopcroft; Jeffrey D. Ullman (1967). "Nonerasing Stack Automata". Journal of Computer and System Sciences. 1 (2): 166–186. doi: 10.1016/s0022-0000(67)80013-8 .
2. John E. Hopcroft and Jeffrey D. Ullman (1979). Introduction to Automata Theory, Languages, and Computation . Reading/MA: Addison-Wesley. ISBN   0-201-02988-X.
3. "Pushdown Automata". www.cs.odu.edu. Retrieved 2024-04-07.
4. John E. Hopcroft; Rajeev Motwani; Jeffrey D. Ullman (2003). Introduction to Automata Theory, Languages, and Computation. Addison Wesley. Here: Sect.6.4.3, p.249
5. Holzer, Markus; Kutrib, Martin (2019). "Non-Recursive Trade-Offs Are "Almost Everywhere"". Computing with Foresight and Industry. 11558: 25–36. doi:10.1007/978-3-030-22996-2_3. This follows from the quoted [22, Proposition 7] and the stated observation that any deterministic pushdown automaton can be converted into an equivalent finite automaton^{[ clarify ]} of at most doubly-exponential size.
6. Seymour Ginsburg, Sheila A. Greibach and Michael A. Harrison (1967). "Stack Automata and Compiling". J. ACM. 14 (1): 172–201. doi: 10.1145/321371.321385 .
7. Seymour Ginsburg, Sheila A. Greibach and Michael A. Harrison (1967). "One-Way Stack Automata". J. ACM. 14 (2): 389–418. doi: 10.1145/321386.321403 .
8. Chandra, Ashok K.; Kozen, Dexter C.; Stockmeyer, Larry J. (1981). "Alternation". Journal of the ACM. 28 (1): 114–133. doi: 10.1145/322234.322243 . ISSN   0004-5411.
9. Ladner, Richard E.; Lipton, Richard J.; Stockmeyer, Larry J. (1984). "Alternating Pushdown and Stack Automata". SIAM Journal on Computing. 13 (1): 135–155. doi:10.1137/0213010. ISSN   0097-5397.
10. Aizikowitz, Tamar; Kaminski, Michael (2011). "LR(0) Conjunctive Grammars and Deterministic Synchronized Alternating Pushdown Automata". Computer Science – Theory and Applications. Lecture Notes in Computer Science. Vol. 6651. pp. 345–358. doi:10.1007/978-3-642-20712-9_27. ISBN   978-3-642-20711-2. ISSN   0302-9743.

• Michael Sipser (1997). Introduction to the Theory of Computation . PWS Publishing. ISBN   0-534-94728-X. Section 2.2: Pushdown Automata, pp. 101–114.
• Jean-Michel Autebert, Jean Berstel, Luc Boasson, Context-Free Languages and Push-Down Automata, in: G. Rozenberg, A. Salomaa (eds.), Handbook of Formal Languages, Vol. 1, Springer-Verlag, 1997, 111–174.

External links

• JFLAP, simulator for several types of automata including nondeterministic pushdown automata
• CoAn, another simulator for several machine types including nondeterministic pushdown automata (C++, Windows, Linux, MacOS)