Big Data and Analytics Lab

List of Experiments / Activities

1. BIG DATA AND ANALYTICS LAB
2. 1Downloading and installing Hadoop; Understanding different Hadoop modes. Startup scripts, Configuration files.
3. 2Implement the following file management tasks in Hadoop: i. Adding files and directories ii. Retrieving files iii. Deleting files Hint: A typical Hadoop workflow creates data files (such as log files) elsewhere and copies them into HDFS using one of the above command line utilities
4. 3Implement of Matrix Multiplication with Hadoop Map Reduce
5. 4Write a Map Reduce program that mines weather data. Hint: Weather sensors collecting data every hour at many locations across the globe gather a large volume of log data, which is a good candidate for analysis with Map Reduce, since it is semi structured and record-oriented
6. 5Run a basic Word Count Map Reduce program to understand Map Reduce Paradigm. 6. Implementation of K-means clustering using Map Reduce
7. 7Installation of Hive along with practice examples.
8. 8Installation of HBase, Installing thrift along with Practice examples
9. 9Patrice importing and exporting data from various data bases .
10. 10Write PIG Commands: Write Pig Latin scripts sort, group, join, project, and filter your data.
11. 11Run the Pig Latin Scripts to find Word Count .
12. 12Run the Pig Latin Scripts to find a max temp for each and every year.
13. Note: The Instructor may add/delete/modify/tune experiments