| 関連するかも情報 |
|---|
「HadoopにおけるMapとは入力を受け取り、それを変換しkey-valueの形式で出力を行う処理を実装するためのもの」「ReduceではMapで出力したkey-valueのペアのうち同じkeyを持つものを集約して処理を行います」
Hadoop MapReduce入門 | Hadoop Advent Calendar 2016 #01 | Developers.IO
[B!] 2020-07-29 16:37:05
|
hdfs dfs / "The File System (FS) shell includes various shell-like commands that directly interact with the Hadoop Distributed File System (HDFS) as well as other file systems that Hadoop supports, such as Local FS, HFTP FS, S3 FS, and others."
Apache Hadoop 2.6.5 - File System Shell Guide
[B!] 2020-07-29 16:37:35
|
brew install hadoop / core-site.xml / hdfs-site.xml / hadoop namenode -format / brew instll hive
Macに10分でHadoop,Hive環境を作る - Qiita
[B!] 2020-07-29 16:41:09
|
Hive Data Types
LanguageManual Types - Apache Hive - Apache Software Foundation
[B!] 2020-07-29 17:06:30
|
CREATE DATABASE/SCHEMA, TABLE, VIEW, FUNCTION, INDEX / DROP DATABASE/SCHEMA, TABLE, VIEW, INDEX / TRUNCATE TABLE / ALTER DATABASE/SCHEMA, TABLE, VIEW / MSCK REPAIR TABLE (or ALTER TABLE RECOVER PARTITIONS)
LanguageManual DDL - Apache Hive - Apache Software Foundation
[B!] 2020-07-29 17:21:18
|
"A CSVSerde based on OpenCSV has been added. This Serde works for most CSV data, but does not handled embedded newlines. To use the Serde, specify the fully qualified class name org.apache.hadoop.hive.serde2.OpenCSVSerde."
[HIVE-7777] Add CSV Serde based on OpenCSV - ASF JIRA
[B!] 2020-07-29 17:21:37
|
CREATE TABLE IF NOT EXISTS some_scheme.some_table_by_text (col_01 string, col_02 string,col_03 string) ROW FORMAT DELIMITED FIELDS TERNIMATED BY '\t' LINES TERMINATED BY '\n' STORED AS TEXTFILE;
[学習備忘録] hive テーブル構築 by テキストファイル - Qiita
[B!] 2020-07-29 17:33:46
|
「実際にHiveを利用してテーブルの作成からSELECT文の発行までの流れを追いたいと思います」「$ hadoop dfs -ls <path>」「hive> CREATE DATABASE <database名> LOCATION '<hdfsのパス>';」「LOAD DATA LOCAL INPATH '<ファイルのパス>' INTO TABLE iris;」
Hive入門 | Hadoop Advent Calendar 2016 #06 | Developers.IO
[B!] 2020-07-29 17:36:09
|
「本資料では、Apache HadoopとHiveの概要とAWS上での構成イメージを説明します」
Apache Hadoop & Hive 入門 (マーケティングデータ分析基盤技術勉強会)
[B!] 2020-07-29 17:36:34
|
