Abhijat Sarari

Abhijat Sarari

6 Articles Published

Articles by Abhijat Sarari

6 articles

Partitioning by multiple columns in PySpark with columns in a list

Abhijat Sarari
Abhijat Sarari
Updated on 27-Mar-2026 338 Views

When working with large datasets in PySpark, partitioning is a crucial technique for optimizing performance. This article explores how to partition data by multiple columns using a list, making data processing more efficient and scalable. What is Partitioning? Partitioning divides large datasets into smaller, manageable segments called "partitions." Instead of processing one massive file, PySpark can work on multiple smaller files simultaneously, significantly reducing processing time. Think of it like organizing a library — books are grouped by subject and author, making it faster to find what you need. Why Partition by Multiple Columns? Multi-column partitioning ...

Read More

How to interpret machine learning models with SHAP values

Abhijat Sarari
Abhijat Sarari
Updated on 09-Sep-2024 505 Views

Understanding how machine learning models make decisions can feel like magic to beginners. One of the most often utilized instruments for elucidating these choices is broken out in this blog post: SHAP values. By the conclusion of our session, you will have a better understanding of how SHAP values may assist you in interpreting machine learning models since we will walk you through the fundamentals in plain, understandable language. Introduction When it comes to understanding how machine learning models make choices, they can occasionally feel like a mysterious black box. SHAP (SHapley Additive exPlanations) values allow us to look within ...

Read More

How to Build Machine Learning Models with Reliable Validation Scores

Abhijat Sarari
Abhijat Sarari
Updated on 05-Sep-2024 224 Views

Machine learning (ML) is a fascinating field that lets computers learn from data and make decisions without being explicitly programmed. It may seem a little complex, if you're just getting started but fear not ! We'll cover the fundamentals of creating machine learning models that function effectively and, most importantly, have consistent validation scores in this post. You will have a thorough knowledge of the vocabulary, essential ideas and procedures involved, in creating successful machine learning models at the conclusion of this tutorial. Introduction Imagine you're building a robot that can predict the weather. You want it to be as ...

Read More

Difference Between Random Forest and Decision Tree

Abhijat Sarari
Abhijat Sarari
Updated on 05-Sep-2024 679 Views

Have you ever wondered how decision-making works in computers? Algorithms are a type of specialized tool, that they employ frequently. Random Forest and Decision Tree are two well-liked algorithms for determining decisions. Let's examine these and their functions. Introduction When you're exploring the world of machine learning, you might come across terms like "Decision Tree" and "Random Forest." Both of these are widely used techniques for data-driven prediction. However, what are they precisely and how are they unique? Even if you're unfamiliar with the subject you should be able to understand the main principles, since we'll simplify and make it ...

Read More

Difference between General tree and Binary tree

Abhijat Sarari
Abhijat Sarari
Updated on 05-Sep-2024 3K+ Views

In both mathematics and computer science trees are fundamental concepts. They assist us in putting data in an orderly manner much like a family tree illustrates the links between various family members. However, there are several varieties of trees each with special characteristics, when discussing them in a technical sense. Binary trees and general trees are the two most popular forms. Do not worry if this is a new topic to you ! These ideas will be explained in an understandable manner in this text. You will understand General Trees and Binary Trees, their distinctions, and their applications at the ...

Read More

Difference Between A* and AO* Algorithm

Abhijat Sarari
Abhijat Sarari
Updated on 04-Sep-2024 8K+ Views

In the fields of artificial intelligence and computer science search algorithms are essential for resolving challenging issues. Envision yourself searching for the way out of an enormous maze. You might aimlessly attempt every route in the hopes of failing. But wouldn't it be preferable to have a knowledgeable guide who is familiar with the maze ? In the digital realm, search algorithms are precisely like that! They assist computers much like you in a maze of options in determining the optimal course. The algorithms A* and AO* are two examples. In this blog article we'll go over their definitions, mechanisms, ...

Read More
Showing 1–6 of 6 articles
« Prev 1 Next »
Advertisements