My Most Viewed Medium Stories — (Updated Monthly)

The Pandas defaults aren’t optimal. A tiny configuration can compress your dataframe to fit in your memory. — I never thought my code needed improvement. I’ve always complained that I don’t have enough memory or the dataset was too big to handle. My go-to solution was to put them on a Postgres DB and write SQL queries. After all, that is an acceptable way to handle large-scale datasets…

Nobody wants a messy codebase; few have the patience to clean it — Writing code is hard enough, but ensuring it's well-formatted and easy to read can be even more challenging. My coding skills have improved a lot in a decade. But the majority of them are not some fancy API usage or anything. It's how I format the code. In my earliest…

What skills you as a developer should have to be irreplaceable? — The world is simplified. The work of developers is to be. Ever since we started using machines, there has been programming. The algorithm for the Analytical Engine is considered the first computer programming language. The English mathematician Ada Lovelace created it in 1883 for Charles Babbage’s mechanical general-purpose computer.

This amazing platform has a different purpose. Use it wisely. — If you say YouTube is your last resort, I have no objection. But being free and super popular doesn’t make YouTube the best learning platform. Having tons of tutorial videos doesn’t either. YouTube is a social media built for videos. Over time it has proven valuable in many ways—people from…

When speed matters, lists aren’t the best. — Speed is always a concern for developers — especially for data-savvy work. The ability to iterate is the basis of all automation and scaling. The first and foremost choice for all of us is a for-loop. It’s excellent, simple, and flexible. Yet, they are not built for scaling up to…

Uncover the Hidden Bias in Your Models and Fix Them — We should be using more AI solutions by now. But there's this bias issue to consider! We've seen AI models perform differently for underrepresented groups. These issues have been debated heavily in recent years. …

Models that once did well may start to deteriorate. This is how you could stay on course. — There’s only one constant in the universe — CHANGE! Everything you see and sense was a version of itself a moment ago — the data you used to fit your models are no exception. A perfect model over time fails to predict as it used to. It’s not a bug…

You can use Crontab, or you can use this — Running tasks on a schedule is not a rare use case. Pretty much every programmer does it. The standard technique used for scheduling is using Cron jobs. I have no objection to using Cron and still think it’s a stable way. But what if you want a scheduler all in…

How to painlessly monitor file creation, modification, and deletion programmatically — Imagine you work with a client system where they upload files to an FTP folder. We’ve got to process the file as soon as it appears in the folder and push it to a database. A real-time dashboard is accessing the database. …