With data in the hiveserver2.log file, this awk scriptlet prints the timestamp, SQL, and seconds to run. There is an issue where the parser thread hands off to the executor, and you can’t always tie the two together. However, at a…
Category: Hive
Oracle SQL Developer and Apache Hive – Never the twain shall meet
If you have come trying to find out why you can’t connect when you know you haven’t fat fingered your password, take heart, you aren’t going crazy. You likely used instructions in the following post to connect SQL Developer to…
Nastiness with Hive/ODBC
We ran into an issue that is not documented, although the hive user guide does indicate it should be set. Whenever we issued a statement with the Hive 64-bit ODBC driver through knox, the knox server would truncate anything after…
Examples of connecting to kerberos hive in JDBC
We had a need to authenticate user requests against AD in a kerberos enabled cluster, and allow “local” hive sessions to use only a keytab. Below are the examples of each. First, we show how to connect over a binary…
Accessing Hive via DBVisualizer
Download the most recent free version of DB Visualizer from the following URL: http://www.dbvis.com/ Execute the downloaded file. If you see the following, it means you have either not installed java, or the installer can’t find where you installed it.…
Getting additional data on a slow hive reducer
We have a query that has been running for almost two hours on the last of 1,009 reducers in the first reduce phase. We wanted to gain additional insight into what it was doing, so we first find the node…
Hive transactions
Below is just a simple example of hive transactions. These are very useful on slowly changing type 1 dimension tables for which you do not wish to retain history, but only the most recent value of the row. The table…
Querying hive from Excel
Install 32 bit driver from the following URL https://downloads.cloudera.com/connectors/hive-2.5.5.1006/Windows/ClouderaHiveODBC32.msi Start Excel and run the query wizard Create a new Data Source Enter the values shown below Enter the values shown below Click the Test button Select the stores table from…
Querying Hive from Tomcat
Below is a very simple example to get started on how Hive can be queried from a web front end. The idea behind this would be to present the user with a csv file mime type that would be opened…
Apache Hive inserts
This is a simple example for getting started with loading data into a hadoop environment front ended by hive. Notice how much longer simple operations take than they do in a RDBMS. This is attributable to the fact hadoop has…