hadoopified.wordpress.com
Hadoopified | Almost everything Hadoop!Almost everything Hadoop!
http://hadoopified.wordpress.com/
Almost everything Hadoop!
http://hadoopified.wordpress.com/
TODAY'S RATING
>1,000,000
Date Range
HIGHEST TRAFFIC ON
Friday
LOAD TIME
3.1 seconds
16x16
32x32
PAGES IN
THIS WEBSITE
12
SSL
EXTERNAL LINKS
11
SITE IP
192.0.78.13
LOAD TIME
3.109 sec
SCORE
6.2
Hadoopified | Almost everything Hadoop! | hadoopified.wordpress.com Reviews
https://hadoopified.wordpress.com
Almost everything Hadoop!
hadoopified.wordpress.com
HDFS – Data Sampler | Hadoopified
https://hadoopified.wordpress.com/2011/06/28/hdfs-data-sampler
HDFS – Data Sampler. Asymp; 2 Comments. The idea is not to generate a truly random sample, but to read ONLY a few partitions. Hadoop.util.data;. Orgapache.hadoop.conf.Configuration;. Orgapache.hadoop.fs.FileStatus;. Orgapache.hadoop.fs.FileSystem;. Orgapache.hadoop.fs.FileUtil;. Orgapache.hadoop.fs.Path;. Date Mar 9, 2011. Desc This function returns Path array based on the sampling percentage. Desired. For eg, for 450-way HDFS file if a 10% sample is required,. Path[] paths = listPaths(fs, path);. FileSy...
Data Export from Hadoop MapReduce to Database | Hadoopified
https://hadoopified.wordpress.com/2012/03/28/data-export-from-hadoop-mapreduce-to-database
Data Export from Hadoop MapReduce to Database. Asymp; Leave a comment. With Hadoop and loading aggregated summary data into the OLAP engines. A task could be slow due to bad memory, disk or other hardware issues (or simply due to handling more data compared to other Map or Reduce tasks). And Hadoop tries to have a node that is free perform the work for a task that is slow (compared to the rest of the tasks). Here is a good description of Speculative Execution from Yahoo Developer Network Blog. There coul...
Snappy compression with Pig and native MapReduce | Hadoopified
https://hadoopified.wordpress.com/2012/01/24/snappy-compression-with-pig
Snappy compression with Pig and native MapReduce. Asymp; 8 Comments. Assuming you have installed Hadoop on your cluster, if not please follow http:/ code.google.com/p/hadoop-snappy/. This is the machine config of my cluster nodes, though the steps that follow could be followed with your installation/machine configs. Pkommireddi@pkommireddi-wsl:/tools/hadoop/pig-0.9.1/lib$ uname -a Linux pkommireddi-wsl 2.6.32-37-generic #81-Ubuntu SMP Fri Dec 2 20:32:42 UTC 2011 x86 64 GNU/Linux. This should get you goin...
prash1784 | Hadoopified
https://hadoopified.wordpress.com/author/prash1784
Parquet – columnar storage for Hadoop. Asymp; 3 Comments. Parquet is a columnar storage format for Hadoop that uses the concept of repetition/definition levels borrowed from. It provides efficient encoding and compression schemes, the efficiency being improved due to application of aforementioned on a per-column basis (compression is better as column values would all be the same type, encoding is better as values within a column could often be the same and repeated). Writing a Parquet file. PigSchemaStri...
Parquet – columnar storage for Hadoop | Hadoopified
https://hadoopified.wordpress.com/2013/10/18/parquet-columnar-storage-hadoop
Parquet – columnar storage for Hadoop. Asymp; 3 Comments. Parquet is a columnar storage format for Hadoop that uses the concept of repetition/definition levels borrowed from. It provides efficient encoding and compression schemes, the efficiency being improved due to application of aforementioned on a per-column basis (compression is better as column values would all be the same type, encoding is better as values within a column could often be the same and repeated). Writing a Parquet file. PigSchemaStri...
TOTAL PAGES IN THIS WEBSITE
12
2014 was great, 2015 will be SPARKling! | HadooPI
https://hadoopi.wordpress.com/2014/12/31/2014-in-review
A french hadooper in London. 2014 was great, 2015 will be SPARKling! Only 15 posts written so far and more than 70K viewers from 119 countries! A great year is almost ending, let’s celebrate 2015 with a giant SPARKling fireworks. The WordPress.com stats helper monkeys prepared a 2014 annual report for my Hadoopi blog. Thanks to all of you, and see you guys next year for more fun around Hadoop and big data! Here’s an excerpt:. Click here to see the complete report. Spark: Use Spark-SQL on SQL Developer.
Spark: Use Spark-SQL on SQL Developer | HadooPI
https://hadoopi.wordpress.com/2014/10/25/use-spark-sql-on-sql-developer
A french hadooper in London. Spark: Use Spark-SQL on SQL Developer. I’m describing here how I set SQL Developer to connect / query my Spark cluster. I made it work on my local environment below:. Ubuntu precise 64 bits (1 master, 2 slaves). Hadoop Hortonworks 2.4.0.2.1.5.0-695. Hive version 0.13.0.2.1.5.0-695, metastore hosted on MySQL database. Spark 1.1.0 prebuilt for Hadoop 2.4. SQL Developer 4.0.3.16. Note that I’ve successfully tested same setup on a 20 nodes cluster on AWS (EMR). Website. Note ...
Spark / Hadoop: Processing GDELT data using Hadoop InputFormat and SparkSQL | HadooPI
https://hadoopi.wordpress.com/2014/09/24/spark-hadoop-processing-gdelt-data-using-hadoop-inputformat-and-sparksql
A french hadooper in London. Spark / Hadoop: Processing GDELT data using Hadoop InputFormat and SparkSQL. A quick overview of GDELT. GDELT Project monitors the world’s broadcast, print, and web news from nearly every corner of every country in over 100 languages and identifies the people, locations, organisations, counts, themes, sources, and events driving our global society every second of every day, creating a free open platform for computing on the entire world. Read data from Spark shell. GDELT Data...
Spark: Connect Tableau Desktop to SparkSQL | HadooPI
https://hadoopi.wordpress.com/2014/12/31/spark-connect-tableau-desktop-to-sparksql
A french hadooper in London. Spark: Connect Tableau Desktop to SparkSQL. Last (but not least) post of 2014, and a new Hacking challenge. Based on the work I’ve done on SQLDeveloper ( https:/ hadoopi.wordpress.com/2014/10/25/use-spark-sql-on-sql-developer/. I was wondering how to connect Tableau Desktop to my SparkSQL cluster. Create a Hive Table. That contains around 60’000 documented reports of unidentified flying object. My Hive table is as follows. Col name data type comment - - - - - - - - - - - - - ...
TOTAL LINKS TO THIS WEBSITE
11
Hadoop Help
Monday, April 18, 2011. Http:/ www.umiacs.umd.edu/ jimmylin/publications/Lin etal MAPREDUCE2011.pdf. Friday, April 8, 2011. I have been using hadoop since long time. Following are my desired features that I want from Hadoop next build. 2 Map reduce cron job. 3 Easy interface for multiple output stream from reducer (It can be possible with current version but it is little difficult). 4 built in encryption function while passing data from mapper to reducer. Hadoop, hive, pig, mapreduce cronjob. Hadoop, hiv...
hadoophive.com
Hadoop Hosting - Hadoop Hosting Open Source Tech
Core Java 100% Reference. Core Java 100% Reference. July 23, 2015. Orgspringframework.stereotype Annotation uses? July 23, 2015. February 14, 2015. February 14, 2015. How to retrieve Data from Collection Variable? Here is the example to insert the data into List Collection variable and also how to retrive data from Collection variable. Continue reading →. February 12, 2015. IS-A a Relation TypeCating. Class B extends A{. System.out.println(“Hello”);. Return new B();. B b=new B().test();. November 11, 2014.
Hadoopi | A french hadooper in London
A french hadooper in London. Welcome to this blog around hadoop and Big-data. The aim of this blog is not to provide you with official documentation (you will find plenty of official websites for that purpose), but rather to share with other developers my knowledge around Hadoop. Spark: Connect Tableau Desktop to SparkSQL. 2014 was great, 2015 will be SPARKling! Spark: Use Spark-SQL on SQL Developer. Spark / Hadoop: Processing GDELT data using Hadoop InputFormat and SparkSQL. Top Posts and Pages.
hadoopifi.com
Hadoopified | Almost everything Hadoop!
Parquet – columnar storage for Hadoop. Asymp; 3 Comments. Parquet is a columnar storage format for Hadoop that uses the concept of repetition/definition levels borrowed from. It provides efficient encoding and compression schemes, the efficiency being improved due to application of aforementioned on a per-column basis (compression is better as column values would all be the same type, encoding is better as values within a column could often be the same and repeated). Writing a Parquet file. PigSchemaStri...
Hadoop illuminated -- Open Source Hadoop Book
Open Source Hadoop Book. Hadoop illuminated' is the open source book about Apache Hadoop. It aims to make Hadoop knowledge accessible to a wider audience, not just to the highly technical. The book is a 'living book' - we will keep updating it to cover the fast evolving Hadoop eco system. Checkout these chapters : Hadoop use cases. Publicly available Big Data sets. The book is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Unported License. Same as MIT Open Courseware. I must...
Cloudera | Home
We are updating the site for Strata Conference Hadoop World 2012. For details on the conference, go to:. Hadoop and Big Data. For Your Use Case. Palo Alto, CA 94306. Hadoop and the Hadoop elephant logo are trademarks of the Apache Software Foundation.
Cloudera | Home
We are updating the site for Strata Conference Hadoop World 2012. For details on the conference, go to:. Hadoop and Big Data. For Your Use Case. Palo Alto, CA 94306. Hadoop and the Hadoop elephant logo are trademarks of the Apache Software Foundation.
Cloudera | Home
We are updating the site for Strata Conference Hadoop World 2012. For details on the conference, go to:. Hadoop and Big Data. For Your Use Case. Palo Alto, CA 94306. Hadoop and the Hadoop elephant logo are trademarks of the Apache Software Foundation.
Hover
This user has not enabled any redirections. Hover lets you easily create simple ways to access your digital life.
SOCIAL ENGAGEMENT