Bounded arithmetic

Bounded arithmetic is a collective name for a family of weak subtheories of Peano arithmetic. Such theories are typically obtained by requiring that quantifiers be bounded in the induction axiom or equivalent postulates (a bounded quantifier is of the form ∀x ≤ t or ∃x ≤ t, where t is a term not containing x). The main purpose is to characterize one or another class of computational complexity in the sense that a function is provably total if and only if it belongs to a given complexity class. Further, theories of bounded arithmetic present uniform counterparts to standard propositional proof systems such as Frege system and are, in particular, useful for constructing polynomial-size proofs in these systems. The characterization of standard complexity classes and correspondence to propositional proof systems allows to interpret theories of bounded arithmetic as formal systems capturing various levels of feasible reasoning (see below).

The approach was initiated by Rohit Jivanlal Parikh^[1] in 1971, and later developed by Samuel R. Buss. ^[2] and a number of other logicians.

Stephen Cook introduced an equational theory P V {\displaystyle PV} (for Polynomially Verifiable) formalizing feasibly constructive proofs (resp. polynomial-time reasoning).^[3] The language of P V {\displaystyle PV} consists of function symbols for all polynomial-time algorithms introduced inductively using Cobham's characterization of polynomial-time functions. Axioms and derivations of the theory are introduced simultaneously with the symbols from the language. The theory is equational, i.e. its statements assert only that two terms are equal. A popular extension of P V {\displaystyle PV} is a theory P V 1 {\displaystyle PV_{1}} , an ordinary first-order theory.^[4] Axioms of P V 1 {\displaystyle PV_{1}} are universal sentences and contain all equations provable in P V {\displaystyle PV} . In addition, P V 1 {\displaystyle PV_{1}} contains axioms replacing the induction axioms for open formulas.

Samuel Buss introduced first-order theories of bounded arithmetic S 2 i {\displaystyle S_{2}^{i}} .^[2] S 2 i {\displaystyle S_{2}^{i}} are first-order theories with equality in the language L = { 0 , S , + , ⋅ , ♯ , | x | , ⌊ x 2 ⌋ } {\displaystyle L=\{0,S,+,\cdot ,\sharp ,|x|,\lfloor {\frac {x}{2}}\rfloor \}} , where the function | x | {\displaystyle |x|} is intended to designate ⌈ log ⁡ ( x + 1 ) ⌉ {\displaystyle \lceil \log(x+1)\rceil } (the number of digits in the binary representation of x {\displaystyle x} ) and x ♯ y {\displaystyle x\sharp y} is 2 | x | ⋅ | y | {\displaystyle 2^{|x|\cdot |y|}} . (Note that | x ♯ x | ∼ | x | 2 {\displaystyle |x\sharp x|\sim |x|^{2}} , i.e. ♯ {\displaystyle \sharp } allows to express polynomial bounds in the bit-length of the input.) Bounded quantifiers are expressions of the form ∃ x ≤ t ⋯ := ∃ x ( x ≤ t ∧ … ) {\displaystyle \exists x\leq t\dots :=\exists x(x\leq t\wedge \dots )} , ∀ x ≤ t ⋯ := ∀ x ( x ≤ t → … ) {\displaystyle \forall x\leq t\dots :=\forall x(x\leq t\rightarrow \dots )} , where t {\displaystyle t} is a term without an occurrence of x {\displaystyle x} . A bounded quantifier is sharply bounded if t {\displaystyle t} has the form of | s | {\displaystyle |s|} for a term s {\displaystyle s} . A formula ϕ {\displaystyle \phi } is sharply bounded if all quantifiers in the formula are sharply bounded. The hierarchy of Σ i b {\displaystyle \Sigma _{i}^{b}} and Π i b {\displaystyle \Pi _{i}^{b}} formulas is defined inductively: Σ 0 b = Π 0 b {\displaystyle \Sigma _{0}^{b}=\Pi _{0}^{b}} is the set of sharply bounded formulas. Σ i + 1 b {\displaystyle \Sigma _{i+1}^{b}} is the closure of Π i b {\displaystyle \Pi _{i}^{b}} under bounded existential and sharply bounded universal quantifiers, and Π i + 1 b {\displaystyle \Pi _{i+1}^{b}} is the closure of Σ i b {\displaystyle \Sigma _{i}^{b}} under bounded universal and sharply bounded existential quantifiers. Bounded formulas capture the polynomial-time hierarchy: for any i ≥ 1 {\displaystyle i\geq 1} , the class Σ i P {\displaystyle \Sigma _{i}^{P}} coincides with the set of natural numbers definable by Σ i b {\displaystyle \Sigma _{i}^{b}} in N {\displaystyle \mathbb {N} } (the standard model of arithmetic) and dually Π i b = Π i P ( N ) {\displaystyle \Pi _{i}^{b}=\Pi _{i}^{P}(\mathbb {N} )} . In particular, N P = Σ 1 b ( N ) {\displaystyle NP=\Sigma _{1}^{b}(\mathbb {N} )} .

The theory S 2 i {\displaystyle S_{2}^{i}} consists of a finite list of open axioms denoted BASIC and the polynomial induction schema

ϕ ( 0 ) ∧ ∀ x ≤ a ( ϕ ( ⌊ x 2 ⌋ ) → ϕ ( x ) ) → ϕ ( a ) {\displaystyle \phi (0)\wedge \forall x\leq a(\phi (\lfloor {\frac {x}{2}}\rfloor )\rightarrow \phi (x))\rightarrow \phi (a)}

where ϕ ∈ Σ i b {\displaystyle \phi \in \Sigma _{i}^{b}} .

Buss (1986) proved that Σ 1 b {\displaystyle \Sigma _{1}^{b}} theorems of S 2 1 {\displaystyle S_{2}^{1}} are witnessed by polynomial-time functions.^[2]

Theorem (Buss 1986)

Assume that S 2 1 ⊢ ∀ x ∃ y ϕ ( x , y ) {\displaystyle S_{2}^{1}\vdash \forall x\exists y\phi (x,y)} , with ϕ ∈ Σ 1 b {\displaystyle \phi \in \Sigma _{1}^{b}} . Then, there exists a P V {\displaystyle PV} -function symbol f {\displaystyle f} such that P V ⊢ ∀ x ϕ ( x , f ( x ) ) {\displaystyle PV\vdash \forall x\phi (x,f(x))} .

Moreover, S 2 1 {\displaystyle S_{2}^{1}} can Σ 1 b {\displaystyle \Sigma _{1}^{b}} -define all polynomial-time functions. That is, Σ 1 b {\displaystyle \Sigma _{1}^{b}} -definable functions in S 2 1 {\displaystyle S_{2}^{1}} are precisely the functions computable in polynomial time. The characterization can be generalized to higher levels of the polynomial hierarchy.

Theories of bounded arithmetic are often studied in connection to propositional proof systems. Similarly as Turing machines are uniform equivalents of nonuniform models of computation such as Boolean circuits, theories of bounded arithmetic can be seen as uniform equivalents of propositional proof systems. The connection is particularly useful for constructions of short propositional proofs. It is often easier to prove a theorem in a theory of bounded arithmetic and translate the first-order proof into a sequence of short proofs in a propositional proof system than to design short propositional proofs directly in the propositional proof system.

The correspondence was introduced by S. Cook.^[3]

Informally, a Π 1 b {\displaystyle \Pi _{1}^{b}} statement ∀ x Φ ( x ) {\displaystyle \forall x\Phi (x)} can be equivalently expressed as a sequence of formulas Φ n ( x ) := ∀ x ( | x | = n → Φ ( x ) ) {\displaystyle \Phi _{n}(x):=\forall x(|x|=n\rightarrow \Phi (x))} . Since Φ n ( x ) {\displaystyle \Phi _{n}(x)} is a coNP predicate, each Φ n ( x ) {\displaystyle \Phi _{n}(x)} can be in turn formulated as a propositional tautology | | ϕ | | n {\displaystyle ||\phi ||^{n}} (possibly containing new variables needed to encode the computation of the predicate Φ n {\displaystyle \Phi _{n}} ).

Theorem (Cook 1975)

Assume that S 2 1 ⊢ ∀ x Φ ( x ) {\displaystyle S_{2}^{1}\vdash \forall x\Phi (x)} , where Φ ∈ Π 1 b {\displaystyle \Phi \in \Pi _{1}^{b}} . Then tautologies | | ϕ | | n {\displaystyle ||\phi ||^{n}} have polynomial-size Extended Frege proofs. Moreover, the proofs are constructible by a polynomial-time function and P V {\displaystyle PV} proves this fact.

Further, S 2 1 {\displaystyle S_{2}^{1}} proves the so called reflection principle for Extended Frege system, which implies that Extended Frege system is the weakest proof system with the property from the theorem above: each proof system satisfying the implication simulates Extended Frege.

An alternative translation between second-order statements and propositional formulas given by Jeff Paris and Alex Wilkie (1985) has been more practical for capturing subsystems of Extended Frege such as Frege or constant-depth Frege.^{[5] [6]}

• Proof complexity
• Computational complexity
• Mathematical logic
• Proof theory
• Complexity classes
• NP (complexity)
• coNP

• Buss, Samuel, "Bounded Arithmetic", Bibliopolis, Naples, Italy, 1986.
• Cook, Stephen; Nguyen, Phuong (2010), Logical Foundations of Proof Complexity, Perspectives in Logic, Cambridge: Cambridge University Press, doi:10.1017/CBO9780511676277, ISBN 978-0-521-51729-4, MR 2589550 (draft from 2008)
• Krajíček, Jan (1995), Bounded arithmetic, propositional logic, and complexity theory, Cambridge University Press
• Krajíček, Jan, Proof Complexity, Cambridge University Press, 2019.
• Pudlák, Pavel (2013), Logical Foundations of Mathematics and Computational Complexity, a gentle introduction, Springer
• Hájek, Petr; Pudlák, Pavel (2016). Metamathematics of First-Order Arithmetic. Perspectives in Logic. Cambridge University Press. ISBN 978-1-107-16841-1. OCLC 982287942.

• Proof complexity mailing list.