Introduction to Hive TimeStamp
Hive timestamps is an interpret to be time-zone less and stored as an offset in the format of UNIX. It is useful to get the updated information of tables at different internal changes to happen in the table. The hive timestamp format is YEAR-Month-Day-Hours-Minutes-seconds [YYYY-MM-DD HH:MM:SS] with an optional fraction of seconds. Anything else that will come with the above format should be read as a string and converted later.
In the hive, the timestamp plays a very vital role in different applications like transactions to identify the changes or updates on the hive tables.
Syntax:
Function name ( string date | string timestamp | string patter | string startdate | string enddate | string timezone | string fmt )
Note: In hive timestamp just we need to use the different timestamp or date function available in the hive and use it as per our requirement.
How does TimeStamp Work in Hive?
In the hive timestamp, it is having the inbuilt functionality of timestamp. With the help of these predefined functions. We are able to work on the hive timestamp. It is having the functionality to convert the hive timestamp to UNIX time format or form UNIX time format to hive timestamp. All the existing date time user definition functions like a month, day, year, hour, etc. are working with the TIMESTAMP data type.
The hive timestamp support below three conversions:
- Integer numeric types: In integer numeric, we can interpret the UNIX timestamp in seconds
- Floating-point numeric types: In floating-point numeric, we can interpret the UNIX timestamp in seconds with decimal format or precision
- Strings type: In string type, we can interpret the JDBC compliant java.sql.Timestamp format “YYYY-MM-DD HH:MM: SS.fffffffff”. it considers 9 decimal place precision.
Examples of HiveTimestamp
Following are the example are given below:
As discussed previously, we have the number of predefined functions available in the hive. Let’s explore one by one.
1. unix_timestamp()
The UNIX timestamp function is helpful to get the timestamp information in the second format. Generally, it is useful to calculate the time difference with a different application in Hadoop like YARN, HBase, etc.
The return data type of unix_timestamp function is “bigint”.
Query:
select unix_timestamp();
Output:
2. unix_timestamp(string date)
The UNIX timestamp with string date function is helpful to convert the human-readable time or string date into seconds. It considers the local time zone (the time zone is using by the cluster or node). The string format should be in “YYYY – MM – DD – HH – MM – SS”.
4.5 (4,193 ratings)
View Course
The return data type of unix_timestampfunction is “bigint”.
Query:
select unix_timestamp('2020-03-25 16:32:01');
Output:
3. unix_timestamp(string date, string pattern)
The UNIX timestamp with string date and patter function is helpful to convert the timestamp in different patterns. As per our requirement, we can get the timestamp in seconds as per “YYYY – MM – DD” or “HH: MM”.
The return data type the unix_timestamp function is “bigint”.
Query – “YYYY – MM – DD” Format
select unix_timestamp(‘2020-03-25′,’yyyy-MM-dd’);
Output:
Query – “HH: MM” Format
select unix_timestamp('16:39','HH:mm');
Output:
4. to_date(string timestamp)
In the above function, we are able to get the complete date information form the timestamp. The timestamp format should in hive timestamp only.
The return data type of to_date function varies from the version of the hive. If the version is below 2.1.0 then its string. If the version is above 2.1.0 then the data type will be “date”.
Query:
select to_date('2020-03-25 16:32:01');
Output:
5. year(string date)
With the help of the year function, we are able to fetch the year form string date. The return data type the year function is “int”.
Query:
select to_year('2020-03-25');
Output:
6. quarter(date | timestamp | string)
In the above function, we are able to get the quarter information form the timestamp. The return data type the quarterfunction is “int”.
Query:
select quarter('2020-03-25 16:32:01');
Output:
7. month(string date | timesatmp)
In the above function, we can fetch the month information form the timestamp. The return data type the monthfunction is “int”.
Query:
select month(‘2020-03-25 16:32:01’);
Output:
8. hour(string date)
In the above function, we can fetch the hour information form the timestamp.
The return data type the hourfunction is “int”.
Query:
select hour('2020-03-25 16:32:01');
Output:
9. minute(string date)
In the above function, we can fetch the minute information form the timestamp.
The return data type the minutefunction is “int”.
Query:
select minute('2020-03-25 16:32:01');
Output:
10. weekofyear(string date)
With the help of weekofyear function, we are able to identify in which week the date belongs to.
The return data type the weekofyear function is “int”.
Query:
select weekofyear('2020-03-25 16:32:01');
Output:
11. datediff(string enddate, string startdate)
With the help of datediff function, we will get the difference between two dates. The output would be in numeric format. The return data type the datediff function is “int”.
Query:
select datediff('2020-03-30', '2020-03-25');
Output:
12. date_add(date |timestamp startdate, smallint |int days)
In the date_add function, we will get the next date with the respective integer values. We have provided in terms of days. The return data type the date_addfunction is “int”.
Query:
select date_add('2020-03-25 16:32:01', 1);
Output:
13. date_sub(date | timestampstartdate, smallint |int days)
In the date_sub function, we will get the past date value with respect to days integer value.
The return data type the date_sub function is “int”.
Query:
select date_sub('2020-03-25 16:32:01', 1);
Output:
Advantages of using Hive Timestamp
- The hive timestamp is useful to write the automation jobs.
- Checks the updated time while inserting the record in the table.
- Useful to comparison the timestamp with different services of Hadoop like YARN, HBase and other services.
- Very useful in transaction applications, retail industry, etc.
- It is helpful in troubleshooting and fixes the hive transactions jobs.
Conclusion
We have seen the uncut concept of “Hive Timestamp” with the proper example, explanation, syntax, SQL Query and different functions. With the help of “Hive Timestamp”, we will get the updated information of the table and current environment of the hive. Majorly it will use in automation script, transaction application, retail industry, etc.
Recommended Articles
This is a guide to Hive TimeStamp. Here we also discuss the Introduction and how does timestamp work in a hive? along with different examples and code implementation. You may also have a look at the following articles to learn more –
