Hadoop@SG

[chewren123]

Have you wondered how Google or Facebook handle all their data? All these Big Data !

Yes, now you can also create it too. With Hadoop.

Hadoop has generated remarkable buzz and excitement in recent years.

Hadoop, an open-source, distributed programming framework relies on parallel processing to store and analyze tremendous amounts of structured and unstructured data.


Unfortunately, after googling for days, I could not find any Singapore group who comes together to share and contribute.

Whether you are a beginner, or hiding in the closet of experience, do come out to share and contribute. We aim to create our very first Hadoop.

Please help and spread the word. Kum Sia.

For a start, do join : Hadoop @ SG


What is Hadoop ?

 

[chewren123]

Every day, we create 2.5 quintillion bytes of data — so much that 90% of the data in the world today has been created in the last two years alone

 

[NSforSG]

besides R, what are the languages that we need to know?

 

[chewren123]

besides R, what are the languages that we need to know?

R is not an absolute requirement

I may prefer Python. You may not. It's a matter of preference

Most of the scripting languages like php, python, perl, ruby bash is good.

On most linux distros used to setup hadoop clusters, python, bash, ruby, perl... are already installed but nothing will prevent to roll up your own execution environment for your favorite scripting or compiled programming language.

The difference between java and scripting language, it is "Heart Beat of child nodes will not be sent to the parent nodes when we are using scripting languages".

Though Java code is most common, any programming language can be used.

 

[AnimeNewbie]

I am a C++ and .NET programmer. And Hadoop does not support native and .NET, rite? I have to use Java which I do not have experience.

 

[chewren123]

I am a C++ and .NET programmer. And Hadoop does not support native and .NET, rite? I have to use Java which I do not have experience.

You may wish to read : Creating .NET-based Mappers and Reducers for Hadoop with JNBridgePro | Javalobby

 

[NSforSG]

R is not an absolute requirement

I may prefer Python. You may not. It's a matter of preference

Most of the scripting languages like php, python, perl, ruby bash is good.

On most linux distros used to setup hadoop clusters, python, bash, ruby, perl... are already installed but nothing will prevent to roll up your own execution environment for your favorite scripting or compiled programming language.

The difference between java and scripting language, it is "Heart Beat of child nodes will not be sent to the parent nodes when we are using scripting languages".

Though Java code is most common, any programming language can be used.

i see. look like i need to read up more about Hadoop first!

 

[chewren123]

Learning is a continuous journey

 

[chewren123]

See the monster

https://www.facebook.com/media/set/?set=a.413861008733426.1073741827.370923816360479&type=1