Introduction
Several companies have invested heavily in Big Data in recent years. This increase in the use of big data analytics has resulted in a high demand for trained big data professionals.. Although there has been much debate about the usefulness of this expense, there is a clear increase in jobs in Big Data. Here's what a quick search says:
Given the strong increase in demand, big data has become a lucrative area to boost your skills. Despite this, if you are someone like me, you need a good overview and understanding of the practical benefits before learning something in a more formal way, you will probably have a hard time finding structured resources like I did long ago.
There are many technologies and terminologies associated with Big Data, that can act as an additional hindrance to get started. Names like Hadoop, MapReduce, Spark, MongoDB, Hive require some getting used to! After receiving an overwhelming response in my previous post on the best YouTube videos on machine learning, deep learning, neural networks and observe the lack of structured resources, The solution was simple! Here's another YouTube special for Big Data wannabes: Just my take on diving into Big Data!!
Disclaimer: We do NOT intend to promote any brand or service through this post.. The videos listed in this post focus solely on their relevance / useful to the audience.
Who is expected to benefit the most from watching these videos?
I have written this post with the Big Data beginner fraternity in mind. Therefore, this post is best suited for candidates who want to start their career in big data analytics. If you are already a professional with experience in big data, it is possible that this post is not what you are looking for. Despite this, can still consume “inspiration” of the TED talks listed below.
The structure of this post is designed to provide a complete description of the various technologies used in Big Data Analytics. The TED talks shown at the beginning are meant to add a pinch of inspiration to your learning journey.. These talks offer you to imagine an exciting world driven by numbers, big data technologies and analytics.
TED talks on Big Data
1. Introduction to Big Data by Hilary Mason, Bitly's Chief Data Scientist
Duration: 11:30 min
Summary: In this short video, Hilary talks about the rise of big data and how it will affect our work environment. It also highlights the small but significant changes that big data brings., including CPU, data and algorithms. Later, examine the profile of a data scientist in your style. Highlights big data applications and their use in our day to day.
2. Big Data, Small World: Kirk Borne en TEDxGeorgeMasonU
Duration: 22:00 min
Summary: The doctor. Kirk Borne begins by talking about his journey to become a data scientist. Later, covers some of the best applied ideas behind data mining and how it can be applied to our daily lives. He also talks about the ‘small world phenomenon’ and the 'separation of 6 degrees'. Later, reveals some surprising big data statistics that ensure the future world will be data-driven.
3. Kenneth Sugar: Big data is better data
Duration: 16:00 min
Summary: Kenneth is heavily focused on using available data at the granular level. Every byte of data has something to reveal, all you need is an engineer to find out. He believes that, with the amount of information available, we can find answers to all the questions that used to be hard to think about. Data has made us more powerful. Data can be our greatest power if we dispose of it intuitively.
4. What to do with all this Big Data?
Duration: 12:29 min
Summary: Susan believes ‘We are not passive consumers of data and technology. Rather, we shape data and give it meaning.‘. In this short video, shares his perspective on the rise of big data and the different alternatives to use the data for its optimal use. Data does not create meaning, we do. Data provides us with a vast ocean of information that must be churned to extract useful information.
5. How to Find the Worst Place to Park in New York City Using Big Data?
Duration: 11:53 min
Summary: The title says it all. Speaker uses statistics and visualization to infer the worst place to park in New York. Made sure not to miss any important information, so it captured all the important variables in its graphical representations. If at any time you wanted to see data usage in real time, not to be missed.
Get to know the Big Data terminologies
I highly recommend these YouTube videos to people who are new to big data analytics.. Watch these quick videos (~ 3 minutes) give you a clear overview of the different big data technologies and the relationships between them.
1. What is HBase? Duration – 3 minutes
2. What is Hadoop? Duration – 3:12 min
3. What is MapReduce? Duration – 2:39 min
4. What is HDFS? Duration – 2:51 min
5. What is Flume? Duration – 2:59 min
6. What is PIG? Duration – 3:01 minutes
7. What is Hive? Duration – 2:52 min
8. What is Avro? Duration – 3:00 min
9. What is Oozie? Duration – 2:28 min
10. What is Zookeeper? Duration – 3:26 minutes
10 tutorials on Big Data analysis
1. Hadoop crash course workshop
Duration – 55:32 minutes
Summary: As the name suggests, this video covers all about Hadoop and the related concept in less than an hour. The speaker begins with a quick introduction to Hadoop, followed by a detailed explanation of the Hadoop ecosystem and distribution, HDFS. Later, Explain multiple Hadoop components like Mapreduce, Yarn, Complexion using some interesting stories. In conclusion, wrap up this crash course by revealing some of the not-so-popular but super-useful ways to access data.
2. Fundamentals of MapReduce
Duration – 32:03 minutes
Summary: This is a complete tutorial to learn the basics of MapReduce. This tutorial series is divided into 5 parts, each of which covers a specific MapReduce module. This introductory video on MapReduce provides a detailed description of its relevance, associated job opportunities, applications and use. As you browse the following parts, will cover the essential arguments of MapReduce. Check out the Next section while you're there!!
3. Enable R in Hadoop
Duration – 40:25 minutes
Summary: This tutorial teaches you the knowledge of hadoop integration with R. Speaker follows a step-by-step procedure for installing Hadoop in R. Concepts like RHadoop have been discussed, RHive and several associated R libraries. At the same time, also looks at the varied use of R and how R programming has evolved over the years.
4. Introduction to deep learning in Hadoop
Duration – 41: 14mins
Summary: The speaker wonderfully explains the concept of deep learning using hadoop. Deep learning is one of the most talked about topics in the data science community. Scientists and researchers are working hard to discover new patterns using deep learning. The concept of deep learning has been explained simplistically in this video. In addition, issues such as deep belief networks have been discussed, the Hadoop implementation / YARN.
5. Introduction to Apache Cassandra
Duration – 1:15:06 time
Summary: I have found very few videos about Apache Cassandra, but this makes up for everything. Here is a complete introduction to Apache Cassandra from scratch. The rise of Apache Cassandra is drawing the attention of companies and professionals everywhere. In this video, the speaker explains the algorithms used, its essential characteristics, benefits and concept / cause behind the launch of Apache Cassandra ~ 6 years ago.
6. Introduction to PIG
Duration – 30:56 minutes
Summary: This is a complete tutorial to learn about PIG. In this tutorial, the instructor begins by providing an overview of Pig followed by the comparison between Pig and SQL. Since both are very similar, makes an interesting comparison. It also explains about the use of Pig latin. Especially this, In addition, the basic steps of Pig installation have been illustrated..
7. An overview of Apache Spark
Duration – 1:06:14 time
Summary: This tutorial aptly justifies its title by teaching about Spark technology and how it can help shape the world.. The guide begins with a quick review of mapreduce followed by spark and the advantage of using this technology. The speaker has wonderfully explained these concepts.
8. Introduction to Hive and HiveQL
Duration – 1:06:19 time
Summary: Hive is built on top of hadoop to provide management, queries and data analysis. This tutorial analyzes the architecture of the hive, hive operations and other associated functions. This tutorial not only enriches you with theoretical knowledge, but also shows the practical aspect and demonstrates the same in the terminal.
9. Introduction to NoSQL
Duration – 54:51 minutes
Summary: This is one of the best videos I have found on NoSQL databases. You will find an introduction to NoSQL databases along with all the other essential knowledge of this concept that you should have. This tutorial covers the application, the advantages, the disadvantages, compatibility, the use, the features and other essential features of NoSQL. I will recommend this video to everyone.
10. MongoDB Tutorial for Beginners
Duration – 4:34:47 time
Summary: If at any time you longed to learn MongoDB, here you have the complete resource. This tutorial comprehensively covers all aspects of MongoDB and NoSQL databases. Despite this, seems to be quite long (> 4 hours), you can see these tutorials in the breaks. A prior knowledge of Javascript would be advantageous to learn MongoDB through this tutorial. This tutorial begins with an introduction to NoSQL databases followed by an explanation of mongodb, how to run mongodb queries, node.js, advanced data processing and method to learn mongodb on ubuntu in the cloud.
Alternative resource: MongoDB Course on Udacity
Final notes
If you have watched the videos listed above, you will already be equipped with essential Big Data items. In this post, I have featured the most helpful YouTube videos and TED talks I found on the internet. The videos listed are intended to develop your big data basics and facilitate your learning path.
If you want to get the maximum benefits from these videos, I would insist on taking notes and getting your hands dirty while watching these videos. In case I missed any important video, feel free to mention it in the comment section below.
