#547: Parallel Python at Anyscale with Ray

Talk Python To Me - Python conversations for passionate developers by Michael Kennedy

May 6, 202659:16Technology

When OpenAI trained GPT-3, they didn't roll their own orchestration layer. They used Ray, an open source Python framework born out of the same Berkeley research lab lineage that gave us Apache Spark. And here's the twist...

Related Episodes

Continue listening to more episodes from Talk Python To Me - Python conversations for passionate developers.

#563: Getting Started with Rust as Python Devs

Sep 16, 2026 - 70:50

Lint the entire CPython code base from scratch. It takes 0.3 seconds. Three blinks of an eye. That is ruf...

#562: DuckLake: The Lakehouse That's Just SQL and Parquet

Sep 10, 2026 - 71:09

How many files does your query read before it reads any data? On some data lakes, you go through JSON and...

#561: TonIO, a Multi-threaded Async Runtime for Python

Sep 4, 2026 - 75:47

How many cores does your machine have, 10, 18? Your async Python code uses just one of them. That isn't a...

#560: Building a Research OS: From Django to 30,000 Samples

Aug 26, 2026 - 62:49

In 2020, a gastroenterologist in Glasgow did the math on his new research study and came up with 30,000 s...

#559: 12 Things You Should (and Shouldn't) Do in AWS

Aug 19, 2026 - 67:51

Your site is down. It's 3am. Is it a bug, a bill, or a breach? You can't tell yet, and everyone is watchi...

#558: Hyper-Personal Software with Python

Aug 10, 2026 - 62:13

Every company has one. The little internal tool that Jane built back in 2021, and then Jane left. Nobody...

#557: Security of everything at PyCon 2026

Aug 2, 2026 - 68:00

Security has always been the vegetables of software. Everyone agrees it matters, and somehow it never qui...

#556: Updates on Django's Async Story

Jul 26, 2026 - 64:56

For years, "Django and async" came with an asterisk. The docs themselves warned you off it. Scary perform...