hackertube.io

AI can't cross this line and we don't know why.

Welch Labs · explainer · Watch on YouTube

Machine learning & deep learningLLMs & generative AI

What it is

A Welch Labs explainer on neural scaling laws and the compute-efficient frontier, asking why model loss seems to hit a line it cannot cross. It draws an analogy to an ideal gas law for AI.

Why Hacker News recommends it

Recommended as a well-made, digestible introduction to scaling laws and why models cluster along a similar efficiency frontier.

  • 2 people recommended it
  • 2 different months
  • 0 strong recommendations
  • first 2024, last 2025

What HN commenters said

  1. “see eg for a well made/easily digestable intro”

    Well-made, accessible introduction to scaling laws.

    kla-s, 2024-10 · Recommendation · in “Zamba2-7B”

  2. “it's title reminded me of an interesting video I saw recently”

    Interesting video on AI hitting a scaling limit.

    mdaniel, 2025-08 · Recommendation · in “Break the quadratic wall of Transformer attention: WERSA, paper+code open source”

Excerpts from Hacker News comments, linked to the originals. Summaries and labels were written by a language model from those comments.

Topics: scaling laws, compute frontier, neural networks, loss curves, deep learning

Also recommended by the same people