
- Automata Theory - Applications
- Automata Terminology
- Basics of String in Automata
- Set Theory for Automata
- Finite Sets and Infinite Sets
- Algebraic Operations on Sets
- Relations Sets in Automata Theory
- Graph and Tree in Automata Theory
- Transition Table in Automata
- What is Queue Automata?
- Compound Finite Automata
- Complementation Process in DFA
- Closure Properties in Automata
- Concatenation Process in DFA
- Language and Grammars
- Language and Grammar
- Grammars in Theory of Computation
- Language Generated by a Grammar
- Chomsky Classification of Grammars
- Context-Sensitive Languages
- Finite Automata
- What is Finite Automata?
- Finite Automata Types
- Applications of Finite Automata
- Limitations of Finite Automata
- Two-way Deterministic Finite Automata
- Deterministic Finite Automaton (DFA)
- Non-deterministic Finite Automaton (NFA)
- NDFA to DFA Conversion
- Equivalence of NFA and DFA
- Dead State in Finite Automata
- Minimization of DFA
- Automata Moore Machine
- Automata Mealy Machine
- Moore vs Mealy Machines
- Moore to Mealy Machine
- Mealy to Moore Machine
- Myhill–Nerode Theorem
- Mealy Machine for 1’s Complement
- Finite Automata Exercises
- Complement of DFA
- Regular Expressions
- Regular Expression in Automata
- Regular Expression Identities
- Applications of Regular Expression
- Regular Expressions vs Regular Grammar
- Kleene Closure in Automata
- Arden’s Theorem in Automata
- Convert Regular Expression to Finite Automata
- Conversion of Regular Expression to DFA
- Equivalence of Two Finite Automata
- Equivalence of Two Regular Expressions
- Convert Regular Expression to Regular Grammar
- Convert Regular Grammar to Finite Automata
- Pumping Lemma in Theory of Computation
- Pumping Lemma for Regular Grammar
- Pumping Lemma for Regular Expression
- Pumping Lemma for Regular Languages
- Applications of Pumping Lemma
- Closure Properties of Regular Set
- Closure Properties of Regular Language
- Decision Problems for Regular Languages
- Decision Problems for Automata and Grammars
- Conversion of Epsilon-NFA to DFA
- Regular Sets in Theory of Computation
- Context-Free Grammars
- Context-Free Grammars (CFG)
- Derivation Tree
- Parse Tree
- Ambiguity in Context-Free Grammar
- CFG vs Regular Grammar
- Applications of Context-Free Grammar
- Left Recursion and Left Factoring
- Closure Properties of Context Free Languages
- Simplifying Context Free Grammars
- Removal of Useless Symbols in CFG
- Removal Unit Production in CFG
- Removal of Null Productions in CFG
- Linear Grammar
- Chomsky Normal Form (CNF)
- Greibach Normal Form (GNF)
- Pumping Lemma for Context-Free Grammars
- Decision Problems of CFG
- Pushdown Automata
- Pushdown Automata (PDA)
- Pushdown Automata Acceptance
- Deterministic Pushdown Automata
- Non-deterministic Pushdown Automata
- Construction of PDA from CFG
- CFG Equivalent to PDA Conversion
- Pushdown Automata Graphical Notation
- Pushdown Automata and Parsing
- Two-stack Pushdown Automata
- Turing Machines
- Basics of Turing Machine (TM)
- Representation of Turing Machine
- Examples of Turing Machine
- Turing Machine Accepted Languages
- Variations of Turing Machine
- Multi-tape Turing Machine
- Multi-head Turing Machine
- Multitrack Turing Machine
- Non-Deterministic Turing Machine
- Semi-Infinite Tape Turing Machine
- K-dimensional Turing Machine
- Enumerator Turing Machine
- Universal Turing Machine
- Restricted Turing Machine
- Convert Regular Expression to Turing Machine
- Two-stack PDA and Turing Machine
- Turing Machine as Integer Function
- Post–Turing Machine
- Turing Machine for Addition
- Turing Machine for Copying Data
- Turing Machine as Comparator
- Turing Machine for Multiplication
- Turing Machine for Subtraction
- Modifications to Standard Turing Machine
- Linear-Bounded Automata (LBA)
- Church's Thesis for Turing Machine
- Recursively Enumerable Language
- Computability & Undecidability
- Turing Language Decidability
- Undecidable Languages
- Turing Machine and Grammar
- Kuroda Normal Form
- Converting Grammar to Kuroda Normal Form
- Decidability
- Undecidability
- Reducibility
- Halting Problem
- Turing Machine Halting Problem
- Rice's Theorem in Theory of Computation
- Post’s Correspondence Problem (PCP)
- Types of Functions
- Recursive Functions
- Injective Functions
- Surjective Function
- Bijective Function
- Partial Recursive Function
- Total Recursive Function
- Primitive Recursive Function
- μ Recursive Function
- Ackermann’s Function
- Russell’s Paradox
- Gödel Numbering
- Recursive Enumerations
- Kleene's Theorem
- Kleene's Recursion Theorem
- Advanced Concepts
- Matrix Grammars
- Probabilistic Finite Automata
- Cellular Automata
- Reduction of CFG
- Reduction Theorem
- Regular expression to ∈-NFA
- Quotient Operation
- Parikh’s Theorem
- Ladner’s Theorem
Reduction Theorem in TOC
The Reduction Theorem is an important idea used in complexity classes theorems. It helps to understand how problems relate to each other in terms of their complexity. In this chapter, we will understand the basics of the Reduction Theorem, and its importance, and see at several examples for a better understanding of their applications.
Reduction Theorem
To define the reduction, we can explain this formally like, the reduction theorem involves a function that maps one problem to another.
Formally, a reduction from A to B is a function f : Σ1* → Σ2* such that for any w ∈ Σ1* , w ∈ A if and only if f(w) ∈ B.
In simpler terms −
- Every w ∈ A maps to some f(w) ∈ B.
- Every w ∉ A maps to some f(w) ∉ B.
- The function f does not have to be injective or surjective.
We use the following notations to represent reductions −
- A <= B: Problem A is reducible to problem B.
- A <=m B: Problem A is many-to-one reducible to problem B.
- A <=p B: Problem A is reducible in a polynomial manner to problem B.

Reductions are important because they allow us to relate the difficulty of different problems. If language A reduces to language B, we can use a recognizer, co-recognizer, or decider for B to recognize, co-recognize, or decide problem A.
When we say A is reducible to B (A <= B), it indicates that problem B is at least as hard as problem A. This helps us categorize problems based on their complexity.

Mapping Reductions
A mapping reduction is a specific type of reduction. It's defined as follows −
A function f : Σ1* → Σ2* is called a mapping reduction from A to B if −
- For any w ∈ Σ1* , w ∈ A if and only if f(w) ∈ B.
- f is a computable function.

A mapping reduction from A to B means that a computer can transform any instance of A into an instance of B such that the answer to B is the answer to A.
Properties of Reduction
Let us see the properties of reduction. Some key properties are listed below −
- If A <= B and A is undecidable, then B is also undecidable.
- If A <= B and B is decidable, then A is also decidable.
- If A <= B and B is recursive, then A is also recursive.
- If A <= B and B is recursively enumerable, then A is also recursively enumerable.
- If A <= B and B is a P-problem, then A is also a P-problem.
- If A <= B and B is an NP-problem, then A is also an NP-problem.
- If A <= B and B <= C, then A <= C (transitivity).
- If A <= B and B <= A, then A and B are polynomially equivalent.
- If A <= B and A is not recursively enumerable, then B is also not recursively enumerable.
- If A <= B and A is not a P-problem, then B is also not a P-problem.
- If A <= B and A is not a recursive problem, then B is also not a recursive problem.
Examples of Reduction Theorem
Let us see some examples to understand how reduction works.
Example 1: Mathematical Reduction
Consider the following reduction −
$$\mathrm{A \: :\: t^4 \:-\: 1 \quad \text{reduces to} \quad B \: : \:t^2 \:-\: 1 \quad \text{and} \quad C \: : \: t^2 \: +\: 1}$$
Here, A is solvable, and since B and C < A, both B and C are also solvable. We can see this because −
$$\mathrm{(t^4 \:-\: 1) \:=\: (t^2 \:-\: 1)(t^2 \:+\: 1)}$$
Example 2: Language Problem Reduction
Problem A: Is L(D) = Σ* ? This can be reduced to: Problem B: Is L(D1) = Σ* - L(D2)?
In this case, B is a subset of A, so A is reduced to Problem B.
Example 3: Grammar Problem Reduction
Problem A: Is L(G) = NULL? This can be reduced to: Problem B: Is L(G1) a subset of L(G2)?
By reducing Problem A to the simpler Problem B, we can find an easier solution.
Example 4: Polynomial Reduction
$\mathrm{A \: :\: a^3 \:+\: b^3 \:+\: 3a^2b \:+\: 3b^2a \quad \text{can be reduced to} \quad B\: :\: (a \:+\: b)^3}$
If A reduces to B and B is "solvable," then A is also "solvable."
Example 5: Language Reduction
Reduction of L to 01: W = 01 and W = 10
The reduced form f(w) will be −
$$\mathrm{f(w) \:=\: \begin{cases} 01 & \text{if } w \in L, \\ 10 & \text{if } w \notin L \end{cases}}$$
Example 6: Grammar Reduction
Given a grammar G with production rules −
$\mathrm{P \: : \:S\: \rightarrow \:AC\: \mid \:B, \quad A\: \rightarrow \:a, \quad C\: \rightarrow\: c\: \mid\: BC, \quad E\: \rightarrow\: aA\: \mid\: e}$
We can reduce it to an equivalent grammar G' in two phases −
$\mathrm{\text{Phase 1: } \:G' \:=\: \{(A,\: C,\: E,\: S),\: (A,\: C,\: E),\: P,\: (S) \}, \quad P \: :\: S \: \rightarrow \: AC, \quad A\: \rightarrow\: a, \quad C \:\rightarrow\: c, \quad E\: \rightarrow\: aA\: \mid\: e}$
$\mathrm{\text{Phase 2: }\: G''\: =\: \{ (A,\: C,\: S),\: (a,\: c),\: P,\: \{ S \} \}, \quad P\: :\: S\: \rightarrow \: AC, \quad A\: \rightarrow \:a, \quad C\: \rightarrow\: c}$
Example 7: Real-World Problem Reduction
Problem A (Hard Problem): Move from New Guinea to Amazon City. We know there's an easy way from New Guinea to Canada, so we can reduce this to: Problem B (Easier Problem): Move from Canada to Amazon City.
This example shows how we can reduce a hard problem to an easier one. If we can solve the easier problem, we can use that solution to solve the harder one.
Example 8: Decidability Reduction
Given Problem,
$$\mathrm{A \: :\: L_1\: \leq \:L_3\: \text{ and }\: L_2\: \leq\: L_3}$$
We can deduce −
If L3 is decidable, then L1 is decidable and L2 is either decidable or not decidable.
If L3 is unde cidable, then L1 is either decidable or not decidable and L3 is undecidable.
Conclusion
In this chapter, we explained the concept of Reduction Theorem in Automata. We discussed the meaning of reduction and why it matters in computational theory. We then looked at mapping reductions and the important properties of reductions. We covered several examples from simple mathematical reductions to more complex language and grammar problems.