Pandas has a hard job (and does it well)
May 26, 2020
I’ve had to dive into pandas’ code base over the last year for a project (siuba), and my attitude has shifted dramatically from..
old attitude: why does pandas have to make things so hard? new attitude: pandas has a crazy difficult job. I think this is most apparent in the functions that decide what dtype a Block—the most basic thing that stores data in pandas—should be.
For the ubiquitous Object dtype, it often figures out which of the many possible more specific types to cast it to.
...
Read more