Data Warehousing - System Managers

Advertisements


Introduction

The system management is must for the successful implementation of data warehouse. In this chapter we will discuss the most important system managers such as following mentioned below.

  • System Configuration Manager

  • System Scheduling Manager

  • System Event Manager

  • System Database Manager

  • System Backup Recovery Manager

System Configuration Manager

  • The system configuration manager is responsible for the management of the setup and configuration of data warehouse.

  • The Structure of configuration manager varies from the operating system to operating system.

  • In unix structure of configuration manager varies from vendor to vendor.

  • Configuration manager have the single user interface.

  • The interface of configuration manager allow us to control of all aspects of the system.

Note: The most important configuration tool is the I/O manager.

System Scheduling Manager

The System Scheduling Manager is also responsible for the successful implementation of the data warehouse. The purpose of this scheduling manager is to schedule the ad hoc queries. Every operating system has its own scheduler with some form of batch control mechanism. Features of System Scheduling Manager are following.

  • Work across cluster or MPP boundaries.

  • Deal with international time differences.

  • Handle job failure.

  • Handle multiple queries.

  • Supports job priorities.

  • Restart or requeue the failed jobs.

  • Notify the user or a process when job is completed.

  • Maintain the job schedules across system outages.

  • Requeue jobs to other queues.

  • Support the stopping and starting of queues.

  • Log Queued jobs.

  • Deal with interqueue processing.

Note: The above are the evaluation parameters for evaluation of a good scheduler.

Some important jobs that the scheduler must be able to handle are as followed:

  • Daily and ad hoc query scheduling.

  • execution of regular report requirements.

  • Data load

  • Data Processing

  • Index creation

  • Backup

  • Aggregation creation

  • data transformation

Note: If the data warehouse is running on a cluster or MPP architecture, then the system scheduling manager must be capable of running across the architecture.

System Event Manager

The event manager is a kind of a software. The event manager manages the events that are defined on the data warehouse system. We cannot manage the data warehouse manually because the structure of data warehouse is very complex. Therefore we need a tool that automatically handle all the events without intervention of the user.

Note: The Event manager monitor the events occurrences and deal with them. the event manager also track the myriad of things that can go wrong on this complex data warehouse system.

Events

The question arises is What is an event? event is nothing but the action that are generated by the user or the system itself. It may be noted that the event is measurable, observable, occurrence of defined action.

The following are the common events that are required to be tracked.

  • hardware failure.

  • Running out of space on certain key disks.

  • A process dying.

  • A process returning an error.

  • CPU usage exceeding an 805 threshold.

  • Internal contention on database serialization points.

  • Buffer cache hit ratios exceeding or failure below threshold.

  • A table reaching to maximum of its size.

  • Excessive memory swapping.

  • A table failing to extend due to lack of space.

  • Disk exhibiting I/O bottlenecks.

  • Usage of temporary or sort area reaching a certain thresholds.

  • Any other database shared memory usage.

The most important thing about is that they should be capable of executing on their own. there event packages that defined the procedures for the predefined events. The code associated with each event is known as event handler. This code is executed whenever an event occurs.

System and Database Manager

System and Database manager are the two separate piece of software but they do the same job. The objective of these tools is to automate the certain processes and to simplify the execution of others. The Criteria of choosing the system and database manager are an abitlity to:

  • increase user's Quota.

  • assign and deassign role to the users.

  • assign and deassign the profiles to the users.

  • perform database space management

  • monitor and report on space usage.

  • tidy up fragmented and unused space.

  • add and expand the space.

  • add and remove users.

  • manage user password.

  • manage summary or temporary tables.

  • assign or deassign temporary space to and from the user.

  • reclaim the space form old or outofdate temporary tables.

  • manage error and trace logs.

  • to browse log and trace files.

  • redirect error or trace information.

  • switch on and off error and trace logging.

  • perform system space management.

  • monitor and report on space usage.

  • clean up old and unused file directories.

  • add or expand space.

System Backup Recovery Manager

The backup and recovery tool make it easy for operations and management staff to backup the data. It is worth noted that the system backup manager must be integrated with the schedule manager software being used. The important features that are required for the management of backups are following.

  • Scheduling

  • Backup data tracking

  • Database awareness.

The backup are taken only to protect the data against loss. Following are the important points to remember.

  • The backup software will keep some from of database of where and when the piece of data was backed up.

  • The backup recovery manager must have a good front end to that database.

  • The backup recovery software should be database aware.

  • Being aware of database the software then can be addressed in database terms, and will not perform backups that would not be viable.



Advertisements
Advertisements