Evolution of analytics technology
Analytics has been on a long journey. In many ways, this can be viewed through the lens of the humans engaging with it. From its origins in academic journals and early business intelligence frameworks, cloud and AI technologies have torn down the barriers that once kept analytics reserved for the technically skilled. Now, anyone with a curious mind and a laptop can dive into data.
But even as the influence of new innovations changes our role, there is still a role. The exponential rise of AI makes us more important than ever; and analytics experts are the most crucial stewards of all as we wrestle with the huge potential and risks of a new era.
Read on as we explore the lessons and themes that can be drawn from the early days of business intelligence, the role of emerging technologies in democratizing data and analytics – and where it is going next.
First conceptual
business intelligence framework
published
Published in an IBM journal by Hans-Peter Luhn, the first formal definition of BI set its early conceptual foundations, initially focusing on automatic document processing. Luhn foreshadowed many of the capabilities we take for granted today, including real-time information access, pattern recognition and machine learning applications. The framework was the first step on the path to modern analytics.
Birth of relational databases
Edgar F. Codd, an IBM computer scientist, publishes ‘A Relational Model of Data for Large Shared Banks’. The paper introduced a new way to model data, cross-linking tables and allowing for querying of any content within a database to efficiently utilize disk space. This served as a pivotal moment in computer science that revolutionized how data is structured, accessed and managed, leading to the widespread adoption of the relational databases that underpin much of today's digital infrastructure.
Howard Dresner coins modern usage of ‘Business Intelligence’
A research analyst at Gartner, Dresner described BI as an ‘umbrella term’ for data-driven decision making and analytics concepts, to differentiate from earlier IT-centric terms. It became synonymous with attempts to use data as a strategic asset within the enterprise and ultimately, empower data consumers with increased access while improving the accuracy and speed of business decisions.
OLAP launches multi-dimensional analytics
More than 20 years after his publication on relational databases, Edgar Codd invented Online Analytical Processing (OLAP), which represented significant advances in the field of BI. OLAP democratized access to data analytics by using a multidimensional data model. This enabled business users – rather than just IT professionals – to conduct their own analysis using complex calculation and trend analysis without the need for advanced technical skills.
The dawn of Qlik
On January 1, 1993, Bjorn Berg and Staffen Gestrelius founded QuikTech. It’s early mission was to trigger a foundational shift in how organizations could harness data for strategic advantage. That dream became a reality with launch of their founding product – QUIKView – which stood for Quality, Understanding, Interaction and Knowledge. The early platform was all about developing a user-centric approach to data analysis, giving people a more intuitive and interactive option compared to traditional BI tools. Both the company and product would soon change names, with QuikTech becoming QlikTech, and Quikview becoming QlikView.
Qlik patents its "Associative" technology
The first iteration of Qlik’s product, released in 1994, included its in-memory associative technology – formally known as Associative Query Logic (AQL). Unlike the OLAP systems that relied on predefined schemas, limiting flexibility and quick implementation, this innovation took a different approach to data analytics. Instead, it enabled dynamic and automatic associations between data fields based on shared names. Qlik patented this technology in 1994, which represented a significant step in simplifying data structures and allowed for deeper exploration and discovery of insights
Natural language principles developed
The turn of the millennium saw another instance when academia influenced the world of analytics. This time, it was the publication of ‘Building Natural Language Generation Systems’ (NLG), co-authored by Professor Ehud Reiter and others, which represented a landmark in the field of Natural Language Generation. Considered a foundational text in the field of NLG, it is critical as a work that informed later developments around AI-led user interactions and the democratization of analytics platforms.
Big Data, and 'The Three Vs, go mainstream
NASA scientists first used the term ‘Big Data’ in 1997 research papers describing the visualization and processing challenges associated with large datasets. Five years later, Gartner analyst Doug Laney distinguished ‘Big Data’ by introducing the three Vs: volume, velocity, and variety. This became the foundation for big data and launching research into big data solutions to solve processing and visualization challenges associated with large data sets.
QlikView 7 breaks down Big Data challenges
The release of QlikView 7 marked a key milestone in the company’s evolution, evolving from a single-user desktop tool to a server-based web platform. This allowed it to support larger datasets often associated with Big Data, as well as simultaneous access by multiple users. By expanding access to those in various locations and using different devices, this significant change enhanced user collaboration throughout the organization, one of the most pervasive challenges of enterprise analytics at the time.
AWS launched cloud-based computing
The evolution of cloud-based computing took the benefits of the web platform further. It reduced the toll of data analytics on business infrastructure and the IT teams that manage it, while removing geographical and accessibility restrictions. This drove the rise of a much more mobile, global workforce. Amazon Web Services helped propel organizations’ ability to harness data analytics by cutting out the needs to make significant investments in physical IT infrastructure.
IBM Watson defeats humans on Jeopardy!
Watson showcased the potential of AI in complex natural language processing and understanding capabilities when it defeated Ken Jennings and Brad Rutter in the gameshow Jeopardy!. The result kickstarted the AI Renaissance, sparking widespread curiosity about machine learning and opening up possibilities for AI applications in business.
Gartner formally introduces the concept of data
discovery
In their annual “Magic Quadrant for Business Intelligence and Analytics Platforms" report, Gartner formally recognized data discovery as a key trend in business intelligence. The introduction of data discovery by Gartner marked a significant turning point in the BI and analytics industry, shifting focus towards more user-friendly, self-service tools and paving the way for the modern, data-driven business landscape we see today.
Qlik Sense powers real-
time decisions
The launch of Qlik Sense set a new standard for modern analytics platforms, combining self-service capabilities with robust governance. It build on the AQL foundation with other advanced technologies such as associative indexing, intuitive design and collaborative functionalities, with the focal aim of empowering users across various roles to make informed decisions based on real-time data. Two years later, Qlik Sense Cloud was released, designed to further increase accessibility for individual users and enable virtual collaboration within small teams.
The inevitable rise of augmented analytics
A team at Google Brain introduced the Transformer architecture in their paper: "Attention is All You Need." This architecture revolutionized natural language processing (NLP) by allowing models to process sequences of data in parallel rather than sequentially. The Transformer became foundational for subsequent models like Google’s BERT and Open AI’s GPT, leading to significant improvements in tasks such as translation, summarization and text generation. This evolution has not only transformed how organizations leverage data but also set new standards for the user experience in BI tools.
Insight Advisor brings NLG capabilities to Qlik Sense
Augmented analytics came to Qlik Sense with the introduction of Insight Advisor. The combination took data accessibility to a new level, enabling users to ask questions in natural language and receive instant visualizations and insights. This functionality continued to evolve with Qlik Sense, with further product enhancements to align with the speed of machine learning and AI development.
Qlik Sense gets
SaaS-y
As enterprises looked to scale their data infrastructure and set the foundations for AI, Qlik Sense SaaS – leveraging AWS cloud infrastructure – marked a significant evolution from the previous cloud-based product. The advanced analytics features, improved scalability and collaborative user experience supported adoption in larger businesses and were designed to help users leverage data more effectively.
Qlik brings
Machine Learning to analytics teams
With the acquisition of Big Squid, the democratization of data became the democratization of machine learning. The integration of its automated machine learning (AutoML) solution enhanced Qlik’s augmented analytics capabilities and provided opportunities for data users to apply machine learning models to business challenges without requiring extensive data science expertise.
AI Goes Mainstream with ChatGPT
The launch of Open AI’s ChatGPT was a watershed moment for the perception of AI. As a conversational model capable of understanding and generating human-like text, it marked the popularization of Generative AI (GenAI). With over 100 million monthly users within two months of launch, it became the fastest-growing consumer application in history. The rapid uptake showcased its accessibility and appeal, drawing massive attention from executives seeking to incorporate conversational AI capabilities into their business, with analytics and BI seen as an early win opportunity.
Building a strong data foundation
for AI
Despite the innovation potential sparked by GenAI, the responses it produced are based on public data, which prompted questions over their origins and validity. Qlik’s strategic acquisitions of Talend – and Attunity in 2019 – represented an attempt to solve this problem. It highlighted the increasing attention on the importance of a solid data foundation for organizations pursuing AI innovation, to ensure that business users only base decisions on trusted, high-quality data.
Qlik Answer and Kyndicc
Qlik brought GenAI to enterprise data management and analytics via the acquisition of Kyndi, a company specializing in Natural Language Processing and AI-driven insights from unstructured data. Six months later, Qlik Answers was designed to provide businesses with instant insights derived from structured and unstructured data across an organization, delivered via a self-service GenAI interface. Qlik Answers mark the latest chapter in the story of empowering data business consumers of data, equipping them with fast, reliable access to information while ensuring transparency in AI-driven responses.
& Beyond
Want to learn more about the evolution of analytics?
Our companion guide dives deeper into this journey, reflecting on the key moments that have informed industry direction to date, where the latest innovations in cloud and AI are transforming enterprise data, and where it might take us next.
Download the guide to understand how the future of analytics can drive value for your business.