Apache Pig - SUBSTRING()


This function returns a substring from the given string.


Given below is the syntax of the SUBSTRING() function. This function accepts three parameters one is the column name of the string we want. And the other two are the start and stop indexes of the required substring.

grunt> SUBSTRING(string, startIndex, stopIndex) 


Assume that there is a file named emp.txt in the HDFS directory /pig_data/ as shown below. This file contains the employee details such as id, name age and city.



And, we have loaded this file into Pig with a relation named emp_data as shown below.

grunt> emp_data = LOAD 'hdfs://localhost:9000/pig_data/emp.txt' USING PigStorage(',')as (id:int, name:chararray, age:int, city:chararray);

Following is an example of the SUBSTRING() function. This example fetches the sub strings that starts with 0th letter and ends with 2nd letter from the employee names.

grunt> substring_data = FOREACH emp_data GENERATE (id,name), SUBSTRING (name, 0, 2);

The above statement fetches the required substrings from the names of the employees. The result of the statement will be stored in the relation named substring_data.

Verify the content of the relation substring_data, using the Dump operator as shown below.

grunt> Dump substring_data;