PREHOOK: query: DESCRIBE FUNCTION stack PREHOOK: type: DESCFUNCTION POSTHOOK: query: DESCRIBE FUNCTION stack POSTHOOK: type: DESCFUNCTION stack(n, cols...) - turns k columns into n rows of size k/n each PREHOOK: query: EXPLAIN SELECT x, y FROM src LATERAL VIEW STACK(2, 'x', array(1), 'z') a AS x, y LIMIT 2 PREHOOK: type: QUERY POSTHOOK: query: EXPLAIN SELECT x, y FROM src LATERAL VIEW STACK(2, 'x', array(1), 'z') a AS x, y LIMIT 2 POSTHOOK: type: QUERY ABSTRACT SYNTAX TREE: (TOK_QUERY (TOK_FROM (TOK_LATERAL_VIEW (TOK_SELECT (TOK_SELEXPR (TOK_FUNCTION STACK 2 'x' (TOK_FUNCTION array 1) 'z') x y (TOK_TABALIAS a))) (TOK_TABREF (TOK_TABNAME src)))) (TOK_INSERT (TOK_DESTINATION (TOK_DIR TOK_TMP_FILE)) (TOK_SELECT (TOK_SELEXPR (TOK_TABLE_OR_COL x)) (TOK_SELEXPR (TOK_TABLE_OR_COL y))) (TOK_LIMIT 2))) STAGE DEPENDENCIES: Stage-1 is a root stage Stage-0 is a root stage STAGE PLANS: Stage: Stage-1 Map Reduce Alias -> Map Operator Tree: src TableScan alias: src Lateral View Forward Select Operator SELECT * : (no compute) Lateral View Join Operator outputColumnNames: _col0, _col1, _col2, _col3 Select Operator expressions: expr: _col2 type: string expr: _col3 type: array outputColumnNames: _col0, _col1 Limit File Output Operator compressed: false GlobalTableId: 0 table: input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat Select Operator expressions: expr: 2 type: int expr: 'x' type: string expr: array(1) type: array expr: 'z' type: string outputColumnNames: _col0, _col1, _col2, _col3 UDTF Operator function name: stack Lateral View Join Operator outputColumnNames: _col0, _col1, _col2, _col3 Select Operator expressions: expr: _col2 type: string expr: _col3 type: array outputColumnNames: _col0, _col1 Limit File Output Operator compressed: false GlobalTableId: 0 table: input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat Stage: Stage-0 Fetch Operator limit: 2 PREHOOK: query: EXPLAIN SELECT x, y FROM src LATERAL VIEW STACK(2, 'x', array(1), 'z', array(4)) a AS x, y LIMIT 2 PREHOOK: type: QUERY POSTHOOK: query: EXPLAIN SELECT x, y FROM src LATERAL VIEW STACK(2, 'x', array(1), 'z', array(4)) a AS x, y LIMIT 2 POSTHOOK: type: QUERY ABSTRACT SYNTAX TREE: (TOK_QUERY (TOK_FROM (TOK_LATERAL_VIEW (TOK_SELECT (TOK_SELEXPR (TOK_FUNCTION STACK 2 'x' (TOK_FUNCTION array 1) 'z' (TOK_FUNCTION array 4)) x y (TOK_TABALIAS a))) (TOK_TABREF (TOK_TABNAME src)))) (TOK_INSERT (TOK_DESTINATION (TOK_DIR TOK_TMP_FILE)) (TOK_SELECT (TOK_SELEXPR (TOK_TABLE_OR_COL x)) (TOK_SELEXPR (TOK_TABLE_OR_COL y))) (TOK_LIMIT 2))) STAGE DEPENDENCIES: Stage-1 is a root stage Stage-0 is a root stage STAGE PLANS: Stage: Stage-1 Map Reduce Alias -> Map Operator Tree: src TableScan alias: src Lateral View Forward Select Operator SELECT * : (no compute) Lateral View Join Operator outputColumnNames: _col0, _col1, _col2, _col3 Select Operator expressions: expr: _col2 type: string expr: _col3 type: array outputColumnNames: _col0, _col1 Limit File Output Operator compressed: false GlobalTableId: 0 table: input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat Select Operator expressions: expr: 2 type: int expr: 'x' type: string expr: array(1) type: array expr: 'z' type: string expr: array(4) type: array outputColumnNames: _col0, _col1, _col2, _col3, _col4 UDTF Operator function name: stack Lateral View Join Operator outputColumnNames: _col0, _col1, _col2, _col3 Select Operator expressions: expr: _col2 type: string expr: _col3 type: array outputColumnNames: _col0, _col1 Limit File Output Operator compressed: false GlobalTableId: 0 table: input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat Stage: Stage-0 Fetch Operator limit: 2 PREHOOK: query: SELECT x, y FROM src LATERAL VIEW STACK(2, 'x', array(1), 'z') a AS x, y LIMIT 2 PREHOOK: type: QUERY PREHOOK: Input: default@src PREHOOK: Output: file:/var/folders/71/h_j6fpg10r33hvx1lcxlgttcw61_4s/T/jonchang/hive_2011-10-19_16-00-57_244_5388245899892483193/-mr-10000 POSTHOOK: query: SELECT x, y FROM src LATERAL VIEW STACK(2, 'x', array(1), 'z') a AS x, y LIMIT 2 POSTHOOK: type: QUERY POSTHOOK: Input: default@src POSTHOOK: Output: file:/var/folders/71/h_j6fpg10r33hvx1lcxlgttcw61_4s/T/jonchang/hive_2011-10-19_16-00-57_244_5388245899892483193/-mr-10000 x [1] z null PREHOOK: query: SELECT x, y FROM src LATERAL VIEW STACK(2, 'x', array(1), 'z', array(4)) a AS x, y LIMIT 2 PREHOOK: type: QUERY PREHOOK: Input: default@src PREHOOK: Output: file:/var/folders/71/h_j6fpg10r33hvx1lcxlgttcw61_4s/T/jonchang/hive_2011-10-19_16-01-01_819_5490987258076691735/-mr-10000 POSTHOOK: query: SELECT x, y FROM src LATERAL VIEW STACK(2, 'x', array(1), 'z', array(4)) a AS x, y LIMIT 2 POSTHOOK: type: QUERY POSTHOOK: Input: default@src POSTHOOK: Output: file:/var/folders/71/h_j6fpg10r33hvx1lcxlgttcw61_4s/T/jonchang/hive_2011-10-19_16-01-01_819_5490987258076691735/-mr-10000 x [1] z [4]