#500 Episode 500!

About this episode

Topics covered in this episode: • A quick chat with Brian looking back • Extras • Joke Watch on YouTube About the show Brian #1: A quick chat with Brian looking back Nick #2: Jev and the Case for Boring ML Vincent Warmerdam from marimo benchmarked Jev, a new "System 1" decision model from TypeSafe AI. In his video It handles classification without the latency or token cost of generative LLMs, which raises a practical question for data teams: where does this fit alongside traditional machine learning? • He tested Jev against classical machine learning models to see if its speed and accuracy hold up on real-world datasets. • General LLMs work well for reasoning, but generating full token streams just to assign a category adds unnecessary latency and cloud cost. • Jev avoids generation entirely by evaluating the input and returning only the decision, which makes it much faster and cheaper than standard chat APIs. • It consistently outperformed eight-shot sentence transformer setups like SetFit out of the box, especially on datasets with dozens of target categories. • Traditional models like logistic regression still matter because they run in single