Frame from Rust at speed — building a fast concurrent database Plays with YouTube's privacy-enhanced embed

Rust at speed — building a fast concurrent database

Open on YouTube First HN thread

2 HN users recommended this lecture in 2 different months between 2019 and 2022.

2007–2026
2 recommendations 2 citations HackerTube score 2

HN points to it as a detailed, captivating talk by the Noria author, including a good explanation of deduplicating data between maps using unsafe.

A guest lecture Jon Gjengset gave at Two Sigma on using Rust for large, high-performance systems. It covers why Rust suits such projects, the Noria research database, a concurrent data structure used in it, and practical experience.

Pull quote: “gave a great talk about the system” (HN, 2021)

Also tagged: rust systems programming, rust, noria, concurrent data structures, databases, jon gjengset

What Hacker News said

4 labeled comments from the HN archive; up to 20 are kept per video, favoring different commenters. Each one links back to the original thread.

Citations, criticism and jokes

Cites it Jonhoo November 2022 under How PlanetScale Boost serves SQL queries faster
Shorter talk on partially-stateful dataflow
Read the full comment
:wave: Author of the paper this work is based on here. I'm so excited to see dynamic, partially-stateful data-flow for incremental materialized view maintenance becoming more wide-spread! I continue to think it's a _great_ idea, and the speed-ups (and complexity reduction) it can yield are pretty immense, so seeing more folks building on the idea makes me very happy. The PlanetScale blog post references my original "Noria" OSDI paper ( [link] ), but I'd actually recommend my PhD thesis instead ( [link] ), as it goes much deeper about some of the technical challenges and solutions involved. It also has a chapter (Appendix A) that covers how it all works by analogy, which the less-technical among the audience may appreciate :) A recording of my thesis defense on this, which may be more digestible than the thesis itself, is also online at [link] , as well as a shorter talk from a few years earlier at [this video] . And the Noria research prototype (written in Rust) is on GitHub: [link] . As others have already mentioned in the comments, I co-founded ReadySet ( [link] ) shortly after graduating specifically to build off of Noria, and they're doing amazing work to provide these kinds of speed-ups for general-purpose relational databases. If you're using one of those, it's worth giving ReadySet a look to get these kinds of speedups there! It's also source-available @ [link] if you're curious.

Keyboard shortcuts

/
Search
j k
Next / previous video in a list
Enter
Open the focused video
l
Like (on a video page)
w
Watch later (on a video page)
?
This help
Esc
Close