Apache Pig - SUBSTRING()

This function returns a substring from the given string.

Syntax

Given below is the syntax of the SUBSTRING() function. This function accepts three parameters one is the column name of the string we want. And the other two are the start and stop indexes of the required substring.

grunt> SUBSTRING(string, startIndex, stopIndex) 

Example

Assume that there is a file named emp.txt in the HDFS directory /pig_data/ as shown below. This file contains the employee details such as id, name age and city.

emp.txt

001,Robin,22,newyork
002,Stacy,25,Bhuwaneshwar 
003,Kelly,22,Chennai

And, we have loaded this file into Pig with a relation named emp_data as shown below.

grunt> emp_data = LOAD 'hdfs://localhost:9000/pig_data/emp.txt' USING PigStorage(',')as (id:int, name:chararray, age:int, city:chararray);

Following is an example of the SUBSTRING() function. This example fetches the sub strings that starts with 0^th letter and ends with 2^nd letter from the employee names.

grunt> substring_data = FOREACH emp_data GENERATE (id,name), SUBSTRING (name, 0, 2);

The above statement fetches the required substrings from the names of the employees. The result of the statement will be stored in the relation named substring_data.

Verify the content of the relation substring_data, using the Dump operator as shown below.

grunt> Dump substring_data;

((1,Robin),Rob)
((2,Stacy),Sta)
((3,Kelly),Kel)