Real time analytics for Big Data - a Twitter case study

Learn how to build a Twitter-like analytics system, designed to meet real time needs, in a simple way. Using frameworks such as Spring Social, Active In-Memory Data Grid for Big Data event processing, and NoSQL database.

Hadoop's batch-oriented processing is sufficient for many use cases, especially where the frequency of data reporting doesn't need to be up-to-the-minute. However, batch processing isn't always adequate, particularly when serving online needs such as mobile and web clients, or markets with real-time changing conditions such as finance and advertising.
In the same way that Hadoop was born out of large-scale web applications, a new class of scalable frameworks and platforms for handling streaming or real time analysis and processing is born to handle the needs of large-scale location-aware mobile, social and sensor use. Do we want to limit ourselves to just these use cases?
Facebook, Twitter and Google have been pioneers in that arena and recently launched new analytics services designed to meet the real time needs.
In this session we will Review the common patterns and architecture that drive these platforms and learn how to build a Twitter-like analytics system in a simple way using frameworks such as Spring Social, Active In-Memroy Data Grid for Big Data event processing, and NoSQL database such as Cassandra or Hbase for handling the managing the historical data.

Nati is the CTO and Founder of GigaSpaces. He is responsible for defining the technology roadmap and the direction of GigaSpaces' products. Nati is also a thought leader in Cloud computing and is the founder of the Israeli cloud.org consortium. He has 15 years of experience with distributed computing and known as an industry expert in building large scale deployments. As a software visionary and industry leader, Mr. Shalom is a frequent presenter at industry conferences. Nati holds a B.Sc. in Electrical Engineering from Coventry University, UK