KEVOS
ArticlesServicesCase studiesAboutContact
ArticlesServicesCase studiesAboutContact
← ArticlesThe Quadratic Sieve: Linear Algebra StageEngineering · Engineering MathematicsLesson 880/887← PrevNext →
GuidePublished 7 Aug 2026Updated 13 Aug 20267 min readBy Kevin Joginlinear algebrasparse matrixblock LanczosWiedemann
On this page

Ask about this page

KEVOS AIThe Quadratic Sieve: Linear Algebra Stage

KEVOS knowledge first · trusted web sources when needed

Modern Factoring Methods

The Quadratic Sieve: Linear Algebra Stage

Finding dependencies in the relation matrix over the field with two elements, and why this stage is the practical bottleneck.

Engineering / MathematicsModern Factoring Methods8 min readKV-MATH-0675

Relations are combined into a congruence of squares by finding dependencies in a large sparse matrix over the field with two elements. This stage is where large factorisations most often become impractical.

The matrix

Rows are relations, columns are factor base primes, entries are exponents reduced modulo two. A kernel vector identifies a subset of relations whose product is a perfect square.

Matrix characteristics

DimensionMillions of rows and columns for large targets
DensityExtremely sparse — a few tens of entries per row
FieldTwo elements; entries are bits
GoalSeveral independent kernel vectors

Key point

Only parity matters, since the goal is a perfect square. Working over the field with two elements rather than the integers is what makes the problem tractable at all, and it allows bit-level packing.

Why elimination fails

Caution

Ordinary Gaussian elimination causes catastrophic fill-in: a matrix with tens of entries per row becomes dense within a few thousand eliminations, and a dense matrix of that dimension cannot be stored, let alone reduced.

The methods used

Solving the sparse system
MethodCharacterNote
Structured eliminationPreprocessingRemoves singletons and light rows; shrinks the matrix substantially
Block LanczosIterativePreserves sparsity; the common choice
Block WiedemannIterativeDistributes better across machines
Dense eliminationFinal stepApplied only to the small dense residue

Key point

Structured elimination first is essential and often halves the dimension or better. Relations involving a prime that appears only once can be discarded outright, and that removal cascades.

The parallelism problem

Caution

The iterative methods require a matrix-vector product at every step, with global communication between steps. Unlike sieving, this does not distribute across loosely coupled machines. It is the reason large factorisations need a tightly coupled cluster for one stage even when the rest ran on volunteer hardware.

From dependency to factor

Extracting the factor

  1. Take a kernel vectorIdentifying a subset of relations.
  2. Form the two sidesThe product of the relation values, and the product of the corresponding roots.
  3. Take square rootsOf the factor base side, using the known exponent vector.
  4. Take a GCDOf the difference with the target.
  5. Retry if trivialAbout half of dependencies give a trivial factor; use the next kernel vector.

Note

Roughly half of all dependencies yield only the trivial factorisation. Collecting several extra relations so that several independent kernel vectors are available is standard practice and costs little.

The same problem elsewhere

Class group computation has an identical linear algebra stage, over the integers rather than the field with two elements — see relation matrix construction and Smith normal form.

Source. Henri Cohen, A Course in Computational Algebraic Number Theory, Springer GTM 138 — 10.4. Structural reference unverified: the source file was not available during authoring; chapter and section numbers are taken from the published edition and have not been checked against a physical copy.

Related pages

  • Gaussian Elimination over Finite Fields
  • The Multiple Polynomial Quadratic Sieve
  • Number Field Sieve: Polynomial Selection and Structure

Handbook application: from concept to controlled practice

Purpose. This expanded section turns the original page into a practical handbook. It preserves the supplied material and adds a repeatable way to apply, check and review The Quadratic Sieve: Linear Algebra Stage. It does not replace a contract, legislation, a controlled standard, competent engineering judgement or specialist advice.

The operating aim is to turn a compact mathematical statement into a usable chain of definitions, claims, examples and checks. Read the original explanation first, then use the workflow and checks below to convert knowledge into evidence.

Treat The Quadratic Sieve: Linear Algebra Stage as a network of definitions and implications, not as a list of formulas. The working vocabulary on this page—matrix, linear, algebra, stage, dependency—should be made explicit before any proof or computation begins. Record the ambient set or structure, the permitted operations and the equality or equivalence relation in use. A compact theorem often changes meaning when the base field, finiteness condition, commutativity assumption or direction of an action changes.

For a proof, write the hypotheses as a checklist and mark the line at which each one is used. For a computation, state the representation of the input, the arithmetic model, the termination condition and the output invariant. For a classification problem, distinguish existence from uniqueness and distinguish an object from its representation. These separations prevent a correct local calculation from being mistaken for the general result.

A useful worked example should be small enough to inspect completely but rich enough to exercise the main mechanism. Compute the result in two ways where practical: symbolically and by substitution, structurally and numerically, or directly and through a normal form. Then include one near-miss example in which a hypothesis fails. The contrast explains why the theorem is shaped as it is and gives the reader a diagnostic pattern for later problems.

Verification is part of the mathematics. Check domains and codomains, substitute proposed solutions, test identity and zero cases, compare dimensions or cardinalities, and confirm that maps respect the required operations. In numerical work, report precision, conditioning and a residual rather than digits alone. In algorithmic work, separate mathematical correctness from implementation complexity and resource limits.

Step-by-step operating method

  1. Fix the setting. State the objects, ambient structure, notation and assumptions before manipulating symbols.
  2. Separate claims. Distinguish definitions, hypotheses, conclusions, equivalent conditions and consequences.
  3. Choose a method. Select proof, construction, calculation or algorithm according to the question actually asked.
  4. Work a small case. Use the smallest non-trivial example to expose the mechanism and test edge behaviour.
  5. Verify independently. Substitute back, check invariants, test boundary cases or use an alternative derivation.

Worked-example protocol

Illustrative method—not a source theorem. Start with a small admissible input and list the definitions it must satisfy. Carry out each transformation on a separate line, citing the property that permits it. Preserve exact values until approximation is necessary. At the end, verify the output against the original definition and one invariant such as dimension, degree, determinant, order, norm or residual. Then alter one hypothesis and observe which step ceases to be valid. This protocol creates a reusable example without inventing a theorem-specific numerical answer.

StageRecordQuality check
InputObjects, domain, notation, assumptionsEvery symbol is defined
MethodPermitted operation or cited result at each stepAll hypotheses hold
OutputExact result and representationCorrect type, domain and form
VerificationSubstitution, invariant or alternative derivationIndependent agreement
Boundary testZero, identity, degenerate or failed hypothesisScope is understood

Common failure modes and recovery actions

1. Watch for

Using a theorem without checking every hypothesis.

Recovery: Return to the governing definition or requirement and restate the decision in one sentence.

2. Watch for

Treating a suggestive example as a proof of the general case.

Recovery: Separate evidence from assumption, assign an owner and set a date for validation.

3. Watch for

Changing notation or conventions part-way through an argument.

Recovery: Run a small counterexample, boundary test, pilot or independent check before proceeding.

4. Watch for

Hiding a division-by-zero, convergence, finiteness or commutativity assumption.

Recovery: Record the consequence, decision and rationale, then update the controlled baseline.

5. Watch for

Reporting a computed result without a residual, substitution or structural check.

Recovery: Escalate when the issue affects safety, compliance, acceptance, material value or an agreed tolerance.

Review checklist

  • Can every symbol be traced to a definition or prior result?
  • Which hypothesis does each major step use?
  • Does the method cover zero, identity, degenerate and boundary cases?
  • Can the conclusion be checked by a second representation or calculation?
  • Are mandatory requirements distinguished from recommendations and illustrative values?
  • Are sources, assumptions, units, dates and versions recorded closely enough to reproduce the decision?
  • Have safety, legal, ethical, stakeholder and operational consequences been considered at the appropriate level?
  • Is there a named owner and a trigger for review, escalation, change or retirement?

Questions for deeper application

What is the most important distinction a practitioner must preserve when applying The Quadratic Sieve: Linear Algebra Stage?

Answer with a fact or cited source where available. Where evidence is incomplete, record the assumption, consequence, responsible owner and next validation action.

Which assumption about matrix would change the result most if it proved false?

Answer with a fact or cited source where available. Where evidence is incomplete, record the assumption, consequence, responsible owner and next validation action.

What evidence would allow an independent reviewer to reproduce or challenge the conclusion?

Answer with a fact or cited source where available. Where evidence is incomplete, record the assumption, consequence, responsible owner and next validation action.

Which boundary, exception or failure case has not yet been tested?

Answer with a fact or cited source where available. Where evidence is incomplete, record the assumption, consequence, responsible owner and next validation action.

What must be handed over, monitored or reviewed after the immediate work is complete?

Answer with a fact or cited source where available. Where evidence is incomplete, record the assumption, consequence, responsible owner and next validation action.

Authoritative references and use notes

The sources below were selected as institutional or primary guidance for the broader practice. They support the handbook method; they do not imply that every statement or clause in a source applies to every project. Confirm the current edition, jurisdiction, contract and application before treating any requirement as mandatory.

  • MIT OpenCourseWare — Number Theory I — Massachusetts Institute of Technology. Used for algebraic and analytic number theory. Accessed 2026-08-13.
  • MIT OpenCourseWare — Algebra I — Massachusetts Institute of Technology. Used for groups, vector spaces, linear transformations and linear groups. Accessed 2026-08-13.

Continue learning

The Multiple Polynomial Quadratic SieveGuide · Engineering MathematicsNEXT LESSON →Number Field Sieve: Polynomial Selection and StructureGuide · Engineering MathematicsThe Quadratic Sieve: Sieving StageGuide · Engineering MathematicsNumber Theory Software PackagesGuide · Engineering Mathematics
KEVOS · Engineering, manufacturing and project improvement
ArticlesServicesCase studiesAboutContact
© 2026 KEVOS®