• Posts
  • Tags
  • about me

    4 Jan 2025 4 min
    4 Jan 2025 4 min

  • what's that animation? ⇨

    4 Jan 2025 1 min
    4 Jan 2025 1 min

    mousemove over it. trust me.

  • research papers

    4 Jan 2025 5 min
    4 Jan 2025 5 min

  • Lazy (NTK) and active (muP) training -- what gives?

    6 Oct 2024 6 min
    6 Oct 2024 6 min

    There's only one degree of freedom in choosing how hyperparameters scale with network width.

  • How to take derivatives of matrix expressions

    19 Sept 2024 8 min
    19 Sept 2024 8 min

    Using einsums for pen-and-paper matrix differentiation

  • Quick n dirty derivation of Larmor radiation and gravitational waves

    31 Aug 2024 4 min
    31 Aug 2024 4 min

    How to derive order-of-magnitude expressions for radiation formulas

  • Statistical physics of signal propagation in deep neural networks

    7 Dec 2022 7 min
    7 Dec 2022 7 min

    Using statistical physics to understand what makes a good activation function

  • Detecting and tracking structures in protostellar outflows

    6 Jun 2021 1 min
    6 Jun 2021 1 min

    My senior thesis won an award

  • Blackbody radiation made simpler

    15 Aug 2019 10 min
    15 Aug 2019 10 min

    The "cavity with a hole" is soo confusing.

GitHub / Email / X 

© 2025 Dhruva Karkada

Powered by Astro and Retypeset