hackertube.io

Parsing JSON Really Quickly: Lessons Learned

InfoQ · talk · Watch on YouTube

Software performance & optimizationCompilers, interpreters & program analysisAlgorithms & data structures

What it is

Daniel Lemire's QCon talk on how simdjson parses gigabytes of JSON per second. It covers SIMD vectorization, branch prediction and the lessons learned building a fast parser.

Why Hacker News recommends it

HN points to it as the best explanation of simdjson internals and of why fast parsing is rarely disk-bound.

  • 3 people recommended it
  • 3 different months
  • 0 strong recommendations
  • first 2020, last 2026

What HN commenters said

  1. “how to vectorize code (thanks to Daniel Lemire's”

    Taught vectorizing code

    dehesa, 2020-05 · Recommendation · in “So you want to write your own CSV code (2014)”

  2. “It's worth looking at if you're into this sort of thing.”

    Talk on simdjson parsing JSON very fast

    Rendello, 2021-10 · Recommendation · in “Word-Aligned Bloom Filters”

  3. “Daniel Lemire has an interesting talk on this”

    Lemire talk arguing disk is rarely the bottleneck in fast parsing.

    D4ckard, 2024-01 · Recommendation · in “The One Billion Row Challenge”

Excerpts from Hacker News comments, linked to the originals. Summaries and labels were written by a language model from those comments.

Topics: simdjson, simd, daniel lemire, performance, parsing

Also recommended by the same people