The rapid maturation of application infrastructure technologies and a continued dramatic decline in the cost of semiconductor technologies are paving the way for mainstream use of in-memory computing (IMC).
Gartner says that, although the key in-memory data grid (IMDG) market is small, it is likely to grow fast and to reach $1-billion by 2016.
“The relentless declines in DRAM and NAND flash memory prices, the advent of solid-state drive technology and the maturation of specific software platforms have enabled IMC to become more affordable and impactful for IT organisations,” says Massimo Pezzini, VP and Gartner fellow.
Until recently, only the most technologically-savvy organisations – for example, in vertical markets like financial trading, telecommunications, military and defence, online entertainment and logistics – could cope with the high cost and complexity of adopting IMC. But IMC technology is now more affordable and more proven.
“Organisations that do not consider adopting in-memory application infrastructure technologies risk being out-innovated by competitors that are early mainstream users of these capabilities,” says Pezzini.
IMC is an emerging paradigm enabling user organisations to develop applications that run advanced queries or perform complex transactions on very large datasets at least one order of magnitude faster – and in a more scalable way – than when using conventional architectures.
It achieves this by storing application data in a computer’s main DRAM, rather than on electromagnetic disks, and without compromising the availability, consistency and integrity of that data.
In-memory-enabling application infrastructure technologies consist of in-memory database management systems, in-memory data grids, high-performance messaging infrastructures, complex-event processing platforms, in-memory analytics and in-memory application servers. These technologies are being used to address a wide variety of application scenarios requiring a combination of speed of execution, scalability and insightful analytics.
IMC provides opportunities to change the way in which organisations support business requirements. It completes batch processes that would otherwise take hours in minutes or even seconds, enabling processes to be delivered to clients, suppliers, citizens or patients as realtime cloud services.
IMC can also be used to detect correlations and patterns to help pinpoint emerging opportunities and threats as things happen, across millions of events, in the blink of an eye.
The rapid penetration of IMC and its likely adoption by at least 35% of midsize and large organisations through 2015 (up from less than 10% in 2012) will be determined by factors such as expanding demand for realtime analytics for ever larger volumes of fast-changing data, growing requirements for 24/7 operations driven by globalisation, and the increasing availability of IMC-enabled packaged business applications.
However, several issues, such as a lack of standards, the scarcity of skills, relative architectural complexity, security concerns, and monitoring and management challenges, will need to be addressed for IMC to achieve mainstream adoption.
Although the IMC application infrastructure market is in flux and fragmented, with more than 50 software vendors, growing adoption will continue to drive established vendors and start-ups to invest in IMC technologies.
“Vendors that don’t have an established presence in the IMC market, or those looking to expand their IMC offering, will acquire small players with advanced technology or an established presence in the market, which will lead to market consolidation,” says Pezzini.
“During the next two to three years, IMC will become a key element in the strategy of organisations focused on improving effectiveness and business growth. Organisations looking for cost containment and efficiency will also increasingly embrace IMC,” he adds.
Gartner says that, although the key in-memory data grid (IMDG) market is small, it is likely to grow fast and to reach $1-billion by 2016.
“The relentless declines in DRAM and NAND flash memory prices, the advent of solid-state drive technology and the maturation of specific software platforms have enabled IMC to become more affordable and impactful for IT organisations,” says Massimo Pezzini, VP and Gartner fellow.
Until recently, only the most technologically-savvy organisations – for example, in vertical markets like financial trading, telecommunications, military and defence, online entertainment and logistics – could cope with the high cost and complexity of adopting IMC. But IMC technology is now more affordable and more proven.
“Organisations that do not consider adopting in-memory application infrastructure technologies risk being out-innovated by competitors that are early mainstream users of these capabilities,” says Pezzini.
IMC is an emerging paradigm enabling user organisations to develop applications that run advanced queries or perform complex transactions on very large datasets at least one order of magnitude faster – and in a more scalable way – than when using conventional architectures.
It achieves this by storing application data in a computer’s main DRAM, rather than on electromagnetic disks, and without compromising the availability, consistency and integrity of that data.
In-memory-enabling application infrastructure technologies consist of in-memory database management systems, in-memory data grids, high-performance messaging infrastructures, complex-event processing platforms, in-memory analytics and in-memory application servers. These technologies are being used to address a wide variety of application scenarios requiring a combination of speed of execution, scalability and insightful analytics.
IMC provides opportunities to change the way in which organisations support business requirements. It completes batch processes that would otherwise take hours in minutes or even seconds, enabling processes to be delivered to clients, suppliers, citizens or patients as realtime cloud services.
IMC can also be used to detect correlations and patterns to help pinpoint emerging opportunities and threats as things happen, across millions of events, in the blink of an eye.
The rapid penetration of IMC and its likely adoption by at least 35% of midsize and large organisations through 2015 (up from less than 10% in 2012) will be determined by factors such as expanding demand for realtime analytics for ever larger volumes of fast-changing data, growing requirements for 24/7 operations driven by globalisation, and the increasing availability of IMC-enabled packaged business applications.
However, several issues, such as a lack of standards, the scarcity of skills, relative architectural complexity, security concerns, and monitoring and management challenges, will need to be addressed for IMC to achieve mainstream adoption.
Although the IMC application infrastructure market is in flux and fragmented, with more than 50 software vendors, growing adoption will continue to drive established vendors and start-ups to invest in IMC technologies.
“Vendors that don’t have an established presence in the IMC market, or those looking to expand their IMC offering, will acquire small players with advanced technology or an established presence in the market, which will lead to market consolidation,” says Pezzini.
“During the next two to three years, IMC will become a key element in the strategy of organisations focused on improving effectiveness and business growth. Organisations looking for cost containment and efficiency will also increasingly embrace IMC,” he adds.