Article Categories
- All Categories
-
Data Structure
-
Networking
-
RDBMS
-
Operating System
-
Java
-
MS Excel
-
iOS
-
HTML
-
CSS
-
Android
-
Python
-
C Programming
-
C++
-
C#
-
MongoDB
-
MySQL
-
Javascript
-
PHP
Articles by Ashish Anand
Page 11 of 14
How to use Boto3 to get the specified version table definition of a database from AWS Glue Data Catalog?
Problem Statement − Use boto3 library in Python to retrieve the table definition of a database.Example − Retrieve the table definition of a database ‘QA-test’ and table as ‘security’ for version 2.Approach/Algorithm to solve this problemStep 1 − Import boto3 and botocore exceptions to handle exceptions.Step 2 − database_name, table_name and version_id is the mandatory parameter. It fetches definition of given table for a specified version.Step 3 − Create an AWS session using boto3 library. Make sure region_name is mentioned in default profile. If it is not mentioned, then explicitly pass the region_name while creating the session.Step 4 − Create ...
Read MoreHow to use Boto3 to get the table definition of a database from AWS Glue Data Catalog?
Problem Statement − Use boto3 library in Python to retrieve the table definition of a database.Example − Retrieve the table definition of a database ‘QA-test’ and table as ‘security’.Approach/Algorithm to solve this problemStep 1 − Import boto3 and botocore exceptions to handle exceptions.Step 2 − database_name and table_name is the mandatory parameter. It fetches the definition of given table.Step 3 − Create an AWS session using boto3 library. Make sure region_name is mentioned in default profile. If it is not mentioned, then explicitly pass the region_name while creating the session.Step 4 − Create an AWS client for glue.Step 5 − ...
Read MoreHow to use Boto3 to get the details of a specified security configuration present in AWS Glue Security?
Problem Statement − Use boto3 library in Python to get details of a specified security configuration present in AWS Glue Security.Example − Get details of a specified security configuration (‘job-security-settings’) present in AWS Glue Security.Approach/Algorithm to solve this problemStep 1 − Import boto3 and botocore exceptions to handle exceptions.Step 2 − security_name is the mandatory parameter whose configuration details needs to be fetched.Step 3 − Create an AWS session using boto3 library. Make sure region_name is mentioned in default profile. If it is not mentioned, then explicitly pass the region_name while creating the session.Step 4 − Create an AWS client ...
Read MoreHow to use Boto3 to get the definition of all the Glue jobs at a time?
Problem Statement − Use boto3 library in Python to get definition of all glue jobs present in user’s AWS Glue Data catalog.Example − Get definition of all glue jobs present in AWS Glue Data catalog.Approach/Algorithm to solve this problemStep 1 − Import boto3 and botocore exceptions to handle exceptions.Step 2 − No parameter is required for this function. It will fetch definition of all listed jobs for user account.Step 3 − Create an AWS session using boto3 library. Make sure region_name is mentioned in default profile. If it is not mentioned, then explicitly pass the region_name while creating the session.Step ...
Read MoreHow to use Boto3 to get the details of a job that is bookmarked in AWS Glue Data Catalog?
Example − Retrieve the details of bookmarked job ‘book-job’ in AWS Glue Data Catalog.Problem Statement − Use boto3 library in Python to retrieve the details of a bookmarked job in AWS Glue Data Catalog.Approach/Algorithm to solve this problemStep 1 − Import boto3 and botocore exceptions to handle exceptions.Step 2 − bookmarked_job_name is the mandatory parameter. It should have job_name that is already bookmarked, otherwise it will throw EntityNotFoundException.Step 3 − Create an AWS session using boto3 library. Make sure region_name is mentioned in default profile. If it is not mentioned, then explicitly pass the region_name while creating the session.Step 4 ...
Read MoreHow to use Boto3 get the details of all the databases from AWS Glue Data Catalog?
Problem Statement − Use boto3 library in Python to retrieve the definition of all the databases.Example − Retrieve the definition of all the databases.Approach/Algorithm to solve this problemStep 1 − Import boto3 and botocore exceptions to handle exceptions.Step 2 − There is no parameter.Step 3 − Create an AWS session using boto3 library. Make sure region_name is mentioned in default profile. If it is not mentioned, then explicitly pass the region_name while creating the session.Step 4 − Create an AWS client for glue.Step 5 − Now use get_databases function.Step 6 − It returns the definition of all databases present in ...
Read MoreHow to use Boto3 to get the security configuration/encryption settings of a catalog from AWS Glue Data Catalog?
Problem Statement − Use boto3 library in Python to retrieve the security configuration/encryption settings of a catalog.Example − Retrieve the security configuration/encryption settings of a catalog.Approach/Algorithm to solve this problemStep 1 − Import boto3 and botocore exceptions to handle exceptions.Step 2 − catalog_id is the optional parameter. If it is not provided, it takes the detail of user’s AWS account.Step 3 − Create an AWS session using boto3 library. Make sure region_name is mentioned in default profile. If it is not mentioned, then explicitly pass the region_name while creating the session.Step 4 − Create an AWS client for glue.Step 5 ...
Read MoreHow to use Boto3 to get the metrics of one/manyspecified crawler from AWS Glue Data Catalog?
Problem Statement − Use boto3 library in Python to retrieve the metrics of a specified crawler.Example − Retrieve the metrics of a specified crawler, crawler_for_s3_file_job.Approach/Algorithm to solve this problemStep 1 − Import boto3 and botocore exceptions to handle exceptions.Step 2 − crawler_names is the mandatory parameter. It is a list so user can send one or many crawler names at a time to fetch metrics.Step 3 − Create an AWS session using boto3 library. Make sure region_name is mentioned in default profile. If it is not mentioned, then explicitly pass the region_name while creating the session.Step 4 − Create an ...
Read MoreHow to use Boto3 to get the details of a single crawler?
Problem Statement − Use boto3 library in Python to get the details of a crawler.Example − Get the details of a crawler, crawler_for_s3_file_job.Approach/Algorithm to solve this problemStep 1 − Import boto3 and botocore exceptions to handle exceptions.Step 2 − crawler_name is the mandatory parameter. It is a string so user can send only one crawler name at a time to fetch details.Step 3 − Create an AWS session using boto3 library. Make sure region_name is mentioned in default profile. If it is not mentioned, then explicitly pass the region_name while creating the session.Step 4 − Create an AWS client for ...
Read MoreHow to use Boto3 to get the details of a connection from AWS Glue Data catalog?
Problem Statement − Use boto3 library in Python to get details of a connection present in AWS Glue Data catalog.Example − Get the details of a connection definition, ‘aurora-test’.Approach/Algorithm to solve this problemStep 1 − Import boto3 and botocore exceptions to handle exceptions.Step 2 − Pass the parameter connection_name whose definition needs to check.Step 3 − Create an AWS session using boto3 library. Make sure region_name is mentioned in default profile. If it is not mentioned, then explicitly pass the region_name while creating the session.Step 4 − Create an AWS client for glue.Step 5 − Call get_connection function and pass ...
Read More