Episode 558: Background Batches with JP Camara

About this episode

JP Camara joins the show to explore background job coordination, real-time collaboration, and the opportunities he sees for Ruby and Rails as AI changes how developers work. First, JP shares the story behind bringing batches to Solid Queue, from an early proposal to the conference conversations and community interest that helped move the feature forward. He explains how batches let developers treat a group of jobs as a unit, track success and failure, and trigger callbacks when processing finishes—making it easier to coordinate workflows that span many background jobs. JP also discusses the implementation challenges behind the feature, including database transactions, jobs deferred until a transaction commits, and reducing the performance overhead of tracking batches. He describes his related work on Mission Control Jobs, which gives developers a visual way to inspect batch progress, investigate failures, and find the jobs involved. The conversation then turns to YRBY, JP’s project for adding real-time collaborative editing to Rails applications. He explains how conflict-free replicated data types, or CRDTs, support Google Docs-style collaboration, and how Ruby bindings to