Article Categories
- All Categories
-
Data Structure
-
Networking
-
RDBMS
-
Operating System
-
Java
-
MS Excel
-
iOS
-
HTML
-
CSS
-
Android
-
Python
-
C Programming
-
C++
-
C#
-
MongoDB
-
MySQL
-
Javascript
-
PHP
-
Economics & Finance
Programming Articles
Page 398 of 2547
How to use Boto3 to start a trigger in AWS Glue Data Catalog
In this article, we will see how to start a trigger in AWS Glue Data Catalog using the boto3 Python library. Triggers in AWS Glue are used to start ETL jobs based on schedules or events. Prerequisites Before starting, ensure you have ? AWS credentials configured (access key, secret key) Appropriate IAM permissions for AWS Glue operations An existing trigger in your AWS Glue Data Catalog The boto3 library installed Approach to Start a Glue Trigger Follow these steps to start a trigger programmatically ? Step 1: Import boto3 and botocore ...
Read MoreHow to use Boto3 to start a crawler in AWS Glue Data Catalog
In this article, we will see how to start a crawler in AWS Glue Data Catalog using Python's boto3 library. A crawler automatically discovers and catalogs metadata about your data sources. Problem Statement Use boto3 library in Python to programmatically start an AWS Glue crawler. Algorithm to Solve This Problem Step 1: Import boto3 and botocore exceptions to handle errors Step 2: Define a function that accepts crawler_name as parameter Step 3: Create an AWS session using boto3. Ensure region_name is configured in ...
Read MoreHow to use Boto3 to reset the bookmark of job in AWS account
In this article, we will see how to reset the bookmark of an AWS Glue job using the boto3 Python library. Job bookmarks help AWS Glue track the data that has already been processed during previous job runs. What are Job Bookmarks? AWS Glue job bookmarks prevent reprocessing of old data by keeping track of data that has already been processed. Resetting a bookmark allows the job to reprocess all data from the beginning. Approach to Reset Job Bookmark Step 1: Import boto3 and botocore exceptions to handle errors. Step 2: Create an AWS session ...
Read MoreHow to use Boto3 to get the list of workflows present an in AWS account
In this article, we will see how to use Boto3 to get the list of all workflows present in an AWS account using AWS Glue service. AWS Glue workflows help orchestrate ETL jobs and crawlers. The list_workflows() method retrieves all workflows from the AWS Glue Data Catalog. Prerequisites Before running this code, ensure you have ? AWS credentials configured (via AWS CLI, environment variables, or IAM roles) Boto3 library installed: pip install boto3 Appropriate permissions to access AWS Glue workflows Approach The solution involves the following steps ? Step 1: ...
Read MorePython program to unique keys count for Value in Tuple List
When working with lists of tuples, you may need to count how many times each unique tuple appears. Python's collections.defaultdict provides an elegant solution for counting occurrences without manually checking if keys exist. Using collections.defaultdict The defaultdict(int) automatically initializes missing keys with a default value of 0, making counting operations simple ? import collections my_result = collections.defaultdict(int) my_list = [[('Hello', 'Hey')], [('Jane', 'Will')], [('William', 'John')], [('Hello', 'Hey')], [('z', 'q')]] print("The list of list is:") print(my_list) for elem in my_list: my_result[elem[0]] += 1 print("The result is:") print(my_result) ...
Read MorePython program to count Bidirectional Tuple Pairs
When it is required to count the number of bidirectional tuple pairs in a list of tuples, we can iterate over the list using nested loops and check if pairs are reverse of each other. A bidirectional pair means if we have tuple (a, b), there exists another tuple (b, a) in the list. Below is a demonstration of the same − Example my_list = [(45, 67), (11, 23), (67, 45), (23, 11), (0, 9), (67, 45)] print("The list is : ") print(my_list) my_result = 0 for idx in range(0, len(my_list)): ...
Read MorePython Program to Find the Sum of all Nodes in a Tree
Finding the sum of all nodes in a tree is a fundamental operation in tree data structures. This can be accomplished using a Tree_structure class with methods to add nodes and calculate the total sum recursively. Tree Structure Implementation The following example demonstrates a complete tree implementation with sum calculation ? class Tree_structure: def __init__(self, data=None): self.key = data self.children = [] def set_root(self, data): ...
Read MorePython Program to Count Number of Non Leaf Nodes of a given Tree
When it is required to find the count of the non-leaf nodes in a Tree, a Tree_structure class is created with methods to set a root value, add nodes, and count non-leaf nodes. A non-leaf node is any node that has at least one child. Below is a demonstration of the same − What are Non-Leaf Nodes? In a tree data structure: Leaf nodes − nodes with no children Non-leaf nodes − nodes that have at least one child (also called internal nodes) 34 Non-leaf ...
Read MorePython Program to Count Number of Leaf Node in a Tree
A leaf node in a tree is a node that has no children. In this program, we'll create a tree structure and implement a method to count all leaf nodes using recursive traversal. Understanding Leaf Nodes A leaf node is identified by having an empty children list. We'll use a helper function to recursively traverse the tree and collect all leaf nodes ? Tree Structure Implementation class Tree_structure: def __init__(self, data=None): self.key = data self.children ...
Read MoreHow to use Boto3 to get the list of triggers present in an AWS account
In this article, we will see how to use Boto3 to get the list of all triggers present in an AWS Glue Data Catalog. AWS Glue triggers are used to start jobs or crawlers based on schedules or events. Prerequisites Before running this code, ensure you have: AWS credentials configured (via AWS CLI, IAM role, or environment variables) Boto3 library installed: pip install boto3 Appropriate IAM permissions for AWS Glue operations Approach The solution involves these key steps: Step 1: Import boto3 and botocore exceptions to handle errors Step 2: Create ...
Read More