Big Data - Data Blogger

Scale out your Pandas DataFrame operations using Dask

In Pandas, one can easily apply operations on all the data using the apply method. However, this method is quite slow and is not useful when scaling up your methods. Is there a way to speed up these operations? And if so, how? Yes, there is! This blog post will

Big Data

Decoding Data Pipelines for Startups

In this era of Big Data, an issue that has been escalating off- late relates to data fragmentation across organisations. This makes the process of analytics and reporting to become even more complex. This is where data pipeline tools come into play. To define it, a data pipeline denotes a

Big Data

What is Big Data?

When I first heard the term Big Data few years ago, I didn’t think much of it. Soon after, Big Data started appearing in many of my conversations with many of my tech friends. So when I met this Mr. Know It All consultant, I asked him ‘What is