Today I presented on big data anti-patterns to an audience at JavaOne. It was live-streamed (no pressure Alex) and I’m hoping the video will be publicly available shortly; if so I’ll update this post with a link.
The presentation covered seven anti-patterns ranging from fairly high-level ones (such as “you don’t have big data”) to ones that were more in the weeds (approximate counting), and covering tools such as Hadoop, Cassandra and Kafka.
Thanks to everyone who attended - I had a lot of fun presenting, and I’m looking forward to giving more talks in the future.
Here’s a link to the slides of the talk: http://www.slideshare.net/grepalex/avoiding-big-data-antipatterns
About the author
Alex Holmes works on tough big-data problems. He is a software engineer, author, speaker, and blogger specializing in large-scale Hadoop projects. He is the author of Hadoop in Practice, a book published by Manning Publications. He has presented multiple times at JavaOne, and is a JavaOne Rock Star.
RECENT BLOG POSTS
Configuring memory for MapReduce running on YARN
This post examines the various memory configuration settings for your MapReduce job.
Big data anti-patterns presentation
Details on the presentation I have at JavaOne in 2015 on big data antipatterns.
Understanding how Parquet integrates with Avro, Thrift and Protocol Buffers
Parquet offers integration with a number of object models, and this post shows how Parquet supports various object models.
Using Oozie 4.4.0 with Hadoop 2.2
Patching Oozie's build so that you can create a package targetting Hadoop 2.2.0.
Hadoop in Practice, Second Edition
A sneak peek at what's coming in the second edition of my book.