This is a simple example for getting started with loading data into a hadoop environment front ended by hive.<\/p>\n
Notice how much longer simple operations take than they do in a RDBMS. This is attributable to the fact hadoop has the initial setup of creating the job and task tracker.<\/p>\n
\r\n[root@expressdb1 hive-0.9.0-bin]# export HIVE_HOME=\/root\/hive-0.9.0-bin\r\n[root@expressdb1 hive-0.9.0-bin]# export HADOOP_HOME=\/root\/hadoop-0.23.7\r\n[root@expressdb1 hive-0.9.0-bin]# bin\/hive\r\nWARNING: org.apache.hadoop.metrics.jvm.EventCounter is deprecated. Please use org.apache.hadoop.log.metrics.EventCounter in all the log4j.properties files.\r\nLogging initialized using configuration in jar:file:\/root\/hive-0.9.0-bin\/lib\/hive-common-0.9.0.jar!\/hive-log4j.properties\r\nHive history file=\/tmp\/root\/hive_job_log_root_201304301344_249377956.txt\r\nhive> CREATE TABLE x (a INT);\r\nOK\r\nTime taken: 14.982 seconds\r\nhive> select * from x;\r\nOK\r\nTime taken: 0.383 seconds\r\nhive> exit;\r\n[root@expressdb1 hive-0.9.0-bin]# for i in {1..100}; do\r\n> echo $i >> \/tmp\/l.txt\r\n> done\r\n[root@expressdb1 hive-0.9.0-bin]# bin\/hive\r\nWARNING: org.apache.hadoop.metrics.jvm.EventCounter is deprecated. Please use org.apache.hadoop.log.metrics.EventCounter in all the log4j.properties files.\r\nLogging initialized using configuration in jar:file:\/root\/hive-0.9.0-bin\/lib\/hive-common-0.9.0.jar!\/hive-log4j.properties\r\nHive history file=\/tmp\/root\/hive_job_log_root_201304301351_1399235343.txt\r\nhive> LOAD DATA LOCAL INPATH '\/tmp\/l.txt' OVERWRITE INTO TABLE x;\r\nCopying data from file:\/tmp\/l.txt\r\nCopying file: file:\/tmp\/l.txt\r\nLoading data to table default.x\r\nrmr: DEPRECATED: Please use 'rm -r' instead.\r\nDeleted \/user\/hive\/warehouse\/x\r\nOK\r\nTime taken: 8.332 seconds\r\nhive> select * from x;\r\nOK\r\n1\r\n2\r\n3\r\n4\r\n5\r\n....\r\n98\r\n99\r\n100\r\nTime taken: 0.389 seconds\r\nhive> exit;\r\n[root@expressdb1 hive-0.9.0-bin]#\r\n<\/pre>\n","protected":false},"excerpt":{"rendered":"This is a simple example for getting started with loading data into a hadoop environment front ended by hive. Notice how much longer simple operations take than they do in a RDBMS. This is attributable to the fact hadoop has…<\/p>\n