I had the privilege to sit down with a couple Hortonworks solution engineers and discuss a potential Hadoop solution in our environment. During that time, I learned an interesting strategy for handling data in Kafka. Our environment uses MSMQ for queueing. What we do is add items to a queue, and then consumers pop items…