Research Markets

Decomposing SGD Dynamics in Neural Networks: Teacher-Induced Spikes and Variance Inflation

Source ↗

Key Insights

  • We study two-layer neural networks trained by stochastic gradient descent (SGD) on a multi-index teacher model, focusing on how first-layer parameters orthogonal to the teacher subspace affect general.
Cite this synthesis DOI: 10.48550/arXiv.2611.24908 ↗
Show formatted citation
@misc{ acaciamarkets-research-decomposing-sgd-dynamics-in-neural-networks-teacher-induced,
  title = { Decomposing SGD Dynamics in Neural Networks: Teacher-Induced Spikes and Variance Inflation },
  author = { Leszek },
  year = { 2026 },
  doi = { 10.48550/arXiv.2611.24908 },
  url = { http://arxiv.org/abs/2611.24908v1 },
  note = {Summarized and classified by AcaciaFund}
}
TY  - GEN
TI  - Decomposing SGD Dynamics in Neural Networks: Teacher-Induced Spikes and Variance Inflation
AU  - Leszek
PY  - 2026
DO  - 10.48550/arXiv.2611.24908
UR  - http://arxiv.org/abs/2611.24908v1
ER  -

Edit on GitHub — registry.json

Overview

We study two-layer neural networks trained by stochastic gradient descent (SGD) on a multi-index teacher model, focusing on how first-layer parameters orthogonal to the teacher subspace affect general

Key Topics

  • Quantitative Modeling: A theme covered by this item within the markets context.
  • Macro Finance: A theme covered by this item within the markets context.

Why It Matters

This item adds to the markets knowledge base. Practitioners can use it to stay current on Decomposing SGD Dynamics in Neural Networks: Teacher-Induced Spikes and Variance Inflation, but should validate its claims against primary sources and more recent work before relying on it in production decisions.

Key Takeaways

  • Understand how Decomposing SGD Dynamics in Neural Networks: Teacher-Induced Spikes and Variance Inflation relates to markets workflows and controls.
  • Assess evidence quality and freshness before acting on the findings.
  • Use the tagged topics to connect this item to related content in the library.
Article Metadata

Cross-Pillar Connections

Further Reading

  • SEC

    US Securities and Exchange Commission — filings, rules, enforcement

  • MSCI

    MSCI research — factor investing, ESG, market analytics

  • arXiv q-fin

    arXiv Quantitative Finance — mathematical finance papers, market models, portfolio theory

  • Citadel Securities

    Semi-annual market structure reports — OTC, options, equity microstructure

  • BIS

    Bank for International Settlements — monetary and financial stability

  • Bloomberg Insights

    Bloomberg Intelligence — market research, sector analysis

Related Research

Related Lessons

Stay Updated

Get the latest research summaries delivered to your inbox.