Image by Author

Pandas v Polars

Thomas Reid
Level Up Coding
Published in
6 min readAug 1, 2023

--

A database speed test. Who wins?

We have a process that runs against our AWS RDS Postgres database. It’s based on a Python Jupyter Notebook and reads a large table into a Pandas data frame before further manipulating the contents of the data frame.

I was interested to compare the run-time of reading the table into a data frame using Pandas versus using Polars. Note that the version of…

--

--

A data engineer , specialising in the AWS cloud with particular interest in AI, serverless and the energy, finance and insurance sectors