Apache Pig - MilliSecondsBetween()

This function accepts two date-time objects and calculates the number of milliseconds between the two given date-time objects.

Syntax

Here is the syntax of the MilliSecondsBetween() function.

grunt> MilliSecondsBetween(datetime1, datetime2)

Example

Assume that there is a file named doj_dob.txt in the HDFS directory /pig_data/. This file contains the date-of-birth and date-of-joining details of a particular person, id, dateof-birth and date-of-joining.

doj_dob.txt

001,26/09/1989 09:00:00,16/01/2015 09:00:00
002,20/06/1980 10:22:00,10/08/2011 09:00:00
003,19/12/1990 03:11:44,25/10/2012 09:00:00 

And, we have loaded this file into Pig with a relation named doj_dob_data as shown below.

doj_doba_data = LOAD 'hdfs://localhost:9000/pig_data/doj_dob.txt' USING PigStorage(',')
   as (id:int, dob:chararray, doj:chararray);

Let us now calculate the number of milli seconds between date-of-birth and date-of-joining of the employees using the MilliSecondsBetween() function as shown below.

grunt> millisecondsbetween_data = foreach doj_dob_data generate 
   MilliSecondsBetween(ToDate(doj,'dd/MM/yyyy HH:mm:ss'), ToDate(dob,'dd/MM/yyyy HH:mm:ss'));

The above statement stores the result in the relation named millisecondsbetween_data. Verify the contents of the relation using the Dump operator as shown below.

grunt> Dump millisecondsbetween_data;  

(798595200000)
(982622280000)
(689579296000)