Data Structure
Networking
RDBMS
Operating System
Java
MS Excel
iOS
HTML
CSS
Android
Python
C Programming
C++
C#
MongoDB
MySQL
Javascript
PHP
Bucketing is a method in Hive which is used for organizing the data. It is a concept of separating data into ranges known as buckets. Bucketing in hives comes helpful when the use of partitioning becomes hard. A user can determine the range of a specific bucket by the hash value. Partitioned tables can be bucketed to separate the data further to perform queries more efficiently. Every bucket is stored as a file within the table or the partition’s directories on HDFS. The records having a similar value within a column are always stored in the same bucket. Bucketing can ... Read More
The full name of the RDD is a distributed database. Spark performance is based on this ambiguous set, enabling it to consistently cope with major data processing conditions, including MapReduce, streaming, SQL, machine learning, graphs, etc. Spark supports many programming languages, including Scala, Python, and R. RDD also supports the maintenance of material in these languages. How to create RDD Spark supports RDDS architecture in many areas, including local file systems, HDFS file systems, memory, and HBase. For the local file system, we can create RDD through the following way − val distFile = sc.textFile("file:///user/root/rddData.txt") By default, Spark takes ... Read More
Data was previously stored in relational data management systems when Hadoop and big data concepts were not available. After introducing Big Data concepts, it was essential to store the data more concisely and efficiently. However all data stored in the related data management system needs to be transferred to the Hadoop archive. With Sqoop, we can transfer this amount of personal data. Sqoop transfers data from a related database management system to a Hadoop server. Thus, it facilitates the transfer of large volumes of data from one source to another. Here are the basic features of Sqoop − Sqoop ... Read More
Array is a data type which can store multiple elements of similar data types. For example, if array is declared as integer data type then it stores one or more elements of the integer data type. In JavaScript, Arrays are objects and these objects have some inbuilt functions and properties by which one can do the operations faster and easier. In this tutorial a functionality of array object ‘findIndex()’ is explained and demonstrated with some examples. The ‘findIndex()’ method in JavaScript arrays will return the first element from the given array with the given constraint being satisfied. This method will ... Read More
The Hadoop framework is open-source that has the ability to expand computation and storage. A spread environment across a host of computers lets you store and process big data. As an alternative, Spark is an open-source clustering technology. It was designed to speed up computing. This product enables whole program clusters that are fault tolerant and implicitly parallel. The prime characteristic of Spark is in-memory cluster computing, which improves an application's speed. These technologies have some similarities and differences, so let's briefly discuss them. What is Hadoop? In the year of 2006, Hadoop began as a Yahoo project. ... Read More
In JavaScript finally is a block of code or statements that are executed in all cases while handling errors with a try and catch block whenever used. These try, catch and finally blocks in JavaScript will execute the code that is prone to error and may cause the program to behave incorrectly (terminate abruptly). This finally block is positioned after the try and catch blocks, will unquestionably be executed if either of those blocks, try or catch, is ever executed. The finally block allows us to define the actions that must be performed regardless of whether some code succeeds or ... Read More
Apache Hadoop is a data file system, but to perform data processing, we need an SQL, such as a language that can change data or make complex data conversions according to our requirements. Apache PIG can achieve this data manipulation. An advanced writing language like SQL is used with Hadoop to create the Pig. Pig Data types work with formal and informal data and are translated into a Map Reduce number processed in the Hadoop collection. We must know about Pig Data Types before understanding operators in Pig. Any data uploaded to a pig has a specific structure and schema ... Read More
The dictionary view objects include dict.keys(), dict.values(), dict.items(). They are used to obtain the dynamic view of the dictionary elements in python. These objects reflect the changes made to the dictionary. To retrieve some data or perform various operations on these view objects, there are 5 build-in functions in python that are supported. They are as follows − len(obj) iter(obj) reversed(obj) sorted(obj) ist(obj) We will discuss about all the functions mentioned above in this article. The len(obj) method The len(obj) method takes a view object as a parameter and returns the number of items in the dictionary. Example ... Read More
What is broken user authentication? Poor implementation of API authentication allows attackers to predict other user’s identities. In more general terms, broken user authentication occurs when an API having an authentication system but does not in working, or that the implemented authentication system fails in some cases, allowing attackers to project himself as an authenticated user. The weaknesses present in the system, mentioned above, will be divided into two different groups, namely poor credential management and poor session management. A. Poor credential management Victim credentials can be collected to gain access to the system. There are various ways that the ... Read More
What is Broken Object-Level Authorization? Broken object-level authorizations (BOLA) is also known as insecure direct object reference (IDOR). This issue occurs when the server does not properly verify if the currently authorized user or an unauthorized user is accessing data to read, update or delete an object to which they are not having the rights. Types of Broken Object Level Authorization (BOLA Mainly there are 2 types of BOLA. Those can be carried out if a userID is passed on to the server or an objectID, we will look into both. Based on User ID If a userID is passing ... Read More