In this article, we will see how a user can get the list of all crawlers present in an AWS account.ExampleProblem Statement: Use boto3 library in Python to get the list of all crawlers.Approach/Algorithm to solve this problemStep 1: Import boto3 and botocore exceptions to handle exceptions.Step 2: There are no parameters in this function.Step 3: Create an AWS session using boto3 lib. Make sure region_name is mentioned in the default profile. If it is not mentioned, then explicitly pass the region_name while creating the session.Step 4: Create an AWS client for glue.Step 5: Now use the list_crawlersStep 6: It ... Read More

In this article, we will see how a user can get the resource metadata of a workflow.ExampleGet the details of a workflow from AWS Glue Data Catalog that is created in your account.Problem Statement: Use boto3 library in Python to get the metadata of a workflow that is created in your account.Approach/Algorithm to solve this problemStep 1: Import boto3 and botocore exceptions to handle exceptions.Step 2: workflow_name is the required parameter for this function. It will fetch the metadata of the given workflow.Step 3: Create an AWS session using boto3 lib. Make sure region_name is mentioned in the default profile. ... Read More

When it is required to implement a queue using a stack, a queue class can be defined, where two stack instances can be defined. Different operations can be performed on the queue that are defined as methods in this class.Below is a demonstration of the same −Example Live Democlass Queue_structure:    def __init__(self):       self.in_val = Stack_structure()       self.out_val = Stack_structure()    def check_empty(self):       return (self.in_val.check_empty() and self.out_val.check_empty())    def enqueue_operation(self, data):       self.in_val.push_operation(data)    def dequeue_operation(self):       if self.out_val.check_empty():          while not self.in_val.check_empty(): ... Read More

When it is required to implement a stack using two queues, a ‘Stack_structure’ class is required along with a Queue_structure class. Respective methods are defined in these classes to add and delete values from the stack and queue respectively.Below is a demonstration of the same −Example Live Democlass Stack_structure:    def __init__(self):       self.queue_1 = Queue_structure()       self.queue_2 = Queue_structure()    def check_empty(self):       return self.queue_2.check_empty()    def push_val(self, data):       self.queue_1.enqueue_operation(data)       while not self.queue_2.check_empty():          x = self.queue_2.dequeue_operation()          self.queue_1.enqueue_operation(x)   ... Read More

When it is required to implement a stack using a single queue, a ‘Stack_structure’ class is required along with a Queue_structure class. Respective methods are defined in these classes to add and delete values from the stack and queue respectively.Below is a demonstration of the same −Example Live Democlass Stack_structure:    def __init__(self):       self.q = Queue_structure()    def check_empty(self):       return self.q.check_empty()    def push_val(self, data):       self.q.enqueue_operation(data)    def pop_val(self):       for _ in range(self.q.size_calculate() - 1):          dequeued = self.q.dequeue_operation()         ... Read More

When it is required to reverse a stack data structure using recursion, a ‘stack_reverse’ method, in addition to methods to add value, delete value, and print the elements of the stack are defined.Below is a demonstration of the same −Example Live Democlass Stack_structure:    def __init__(self):       self.items = []    def check_empty(self):       return self.items == []    def push_val(self, data):       self.items.append(data)    def pop_val(self):       return self.items.pop()    def print_it(self):       for data in reversed(self.items):          print(data) def insert_bottom(instance, data): ... Read More

When it is required to select the nth largest element from a list in linear time complexity, two methods are required. One method to find the largest element, and another method that divides the list into two parts. This division depends on the ‘i’ value that is given by user. Based on this value, the list is split, and the largest element is determined.Below is a demonstration of the same −Example Live Demodef select_largest(my_list, beg, end, i):    if end - beg k:       return select_largest(my_list, beg, pivot_val, i - k)    return my_list[pivot_val] def start_partition(my_list, ... Read More

Let's see how a user can get the details of multiple function definitions from AWS Glue Data Catalog.ExampleProblem Statement: Use boto3 library in Python to get the details of multiple function definitions present in a database(s) from AWS Glue Data Catalog.Approach/Algorithm to solve this problemStep 1: Import boto3 and botocore exceptions to handle exceptions.Step 2: database_name and regular_pattern are optional parameters. If details are not provided for these, the function fetches the definition of all the functions present in AWS User account. If database_name is provided but regular_pattern is not provided, then it fetches all the functions in a given ... Read More

Let's see how a user can get the details of a specified function definition from AWS Glue Data Catalog.ExampleGet the details of a function definition named as insert_employee_record in database employee.Problem Statement: Use boto3 library in Python to get the details of a specified function definition from AWS Glue Data Catalog.Approach/Algorithm to solve this problemStep 1: Import boto3 and botocore exceptions to handle exceptions.Step 2: database_name and function_name are the required parameters. It fetches the definition of a given function_name in a given database.Step 3: Create an AWS session using boto3 lib. Make sure region_name is mentioned in the default ... Read More

In this article, we will see how a user can get the details of all the triggers associated with a job from AWS Glue Data Catalog.ExampleGet the details of all the triggers associated with a job - 'employee_details'.Problem Statement: Use boto3 library in Python to get the details of all the triggers that is associated with a job.Approach/Algorithm to solve this problemStep 1: Import boto3 and botocore exceptions to handle exceptions.Step 2: job_name is the optional parameter for this function. If job_name is provided, it retrieves all the triggers those are associated with the same job and can start this ... Read More