Hadoop Tutorial

How is big data impacting business and people? Have you ever searched for or bought a product on Amazon? Did you notice that Amazon started making recommendations related to the product you searched for Recommendation engines are a common application of big data. Companies like Amazon, Netflix and Spotify use algorithms based on big data to make specific recommendations based on customer preferences and historical behavior. Personal assistants like Siri on Apple devices use big data to devise answers to the infinite number of questions end users may ask. Google now makes recommendations based on the big data on a user's device. Now that we have an idea of how consumers are using big data, let's take a look at how big data is impacting business. In 2011, McKinsey & Company said that big data was going to become the key basis of competition supporting new waves of productivity growth and innovation. In 2013, UPS announced that it was

----------for database connect-------- mysql -u root -pcloudera ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- >>sqoop import --connect jdbc://localhost/retail_db --username root --password cloudera --table customers --target-dir /data/sqoop/test01 >>sqoop import --connect jdbc:mysql://localhost/retail_db --username root --password cloudera --table customers --target-dir /data/sqoop/test02 -m 10 >>sqoop import --connect jdbc:mysql://localhost/retail_db --username root --password cloudera --table customers --target-dir /data/sqoop/test03 --split-by customer_id --fields-terminated-by '|' -m 10 >>sqoop list-databases --connect jdbc:mysql://localhost/retail_db --username root --password cloudera >>sqoop list-tables --connect jdbc:mysql://localhost/retail_db --username root --password cloudera -----------

create database veer; use veer; create table item_details(item_id int,item_name varchar(30),item_price int,item_color varchar(10)) row format delimited fields terminated by',' lines terminated by '\n' stored as textfile; hadoop fs -put /home/cloudera/sk/data/item.txt /user/hive/warehouse/veer.db/item select count(*) from item_details; select * from item_details order by item_id desc; select item_color,count(*) from item_details group by item_color; ---------------------------31-01-2018---------------------------------- create table flight_nt(s_id int,s_name varchar(30),code varchar(20),state varchar(40)) row format delimited fields terminated by',' lines terminated by '\n' stored as textfile; create table flightdata_part (s_id int, s_name varchar(30), code varchar(20) ) PARTITIONED BY (state VARCHAR(64)) row format delimited fields terminated by ',' lines terminated by '\n'  stored as textfile; LOAD DATA LOCAL INPATH '/local/home/srv

First of all, I want to tell you. here all content you will get  practical only. for the theoretical part, you can follow edureka videos and Durgasoft videos. once you complete some videos related to map-reduce and Hadoop ecosystem..after that you can follow me... you need to go step by step:- 1. What is big data 2. What is the need of Hadoop 3. How Hadoop works. 4. Tools in Hadoop ecosystem. If you are a beginner then first you need some configuration in your system which is: 1: RAM:-             Minimum RAM size should be 8gb otherwise you will get frustrated because of a slow system.             if you go with 16gb RAM then it will be great. My opinion is to go with 16gb RAM. 2: Download VMWARE. https://my.vmware.com/en/web/vmware/info/slug/desktop_end_user_computing/vmware_workstation_pro/14_0 3. Download Cloudera -> https://www.cloudera.com/downloads/cdh/5-14-0.html . install it in VMWARE without installing os in WMWARE. 4. Download Eclipse for Map Reduce pro