Thursday, April 25, 2013

Big Data Product Leadership

        I think there is lack of leadership in the big data space who can say "This is how you are going to analyze data in your system and this is what you are going to use". There is a lack of a company like Apple who can say that "This the way smart phones should be and here's my product iPhone".

        I am seeing companies all around me which wants to enter the big data and big data analytics market because its a huge untapped market. No clear market leader exists and its a fast growing segment. Companies are recognizing the value of data and performing analytics to gain value from data to gain competitive advantage.

       Why are the companies trying to sell analytics solution not able to choose a segment like fraud detection? I am unable to understand why fraud detection agencies have to use ten tools to have an application running? Why is there no single solution for complete analytical solution in market? The solution should do model generation (Run repeated regression analysis with various parameters automatically, run k-mean clustering, run APRIORI and such), model validation and real time data incorporation that can solve all the problems of a fraud detection system. As a fraud detection application architect, I just want to go to one tool which will allow me to automatically generate models (smart) and suck in data what will keep on validating the models on regular basis and define rules for making real time decisions per transaction to determine if it is fraud or genuine.