Hear from the AI Council at Qlik Connect, which takes place on June 3-5 in Orlando, Florida. Register today and save $100!
THE

Evolution of analytics technology

Analytics has been on a long journey. In many ways, this can be viewed through the lens of the humans engaging with it. From its origins in academic journals and early business intelligence frameworks, cloud and AI technologies have torn down the barriers that once kept analytics reserved for the technically skilled. Now, anyone with a curious mind and a laptop can dive into data.

But even as the influence of new innovations changes our role, there is still a role. The exponential rise of AI makes us more important than ever; and analytics experts are the most crucial stewards of all as we wrestle with the huge potential and risks of a new era.

Read on as we explore the lessons and themes that can be drawn from the early days of business intelligence, the role of emerging technologies in democratizing data and analytics – and where it is going next.

First conceptual
business intelligence framework
published

Published in an IBM journal by Hans-Peter Luhn, the first formal definition of BI set its early conceptual foundations, initially focusing on automatic document processing. Luhn foreshadowed many of the capabilities we take for granted today, including real-time information access, pattern recognition and machine learning applications. The framework was the first step on the path to modern analytics.

Birth of relational databases

Edgar F. Codd, an IBM computer scientist, publishes ‘A Relational Model of Data for Large Shared Banks’. The paper introduced a new way to model data, cross-linking tables and allowing for querying of any content within a database to efficiently utilize disk space. This served as a pivotal moment in computer science that revolutionized how data is structured, accessed and managed, leading to the widespread adoption of the relational databases that underpin much of today's digital infrastructure.

Howard Dresner coins modern usage of ‘Business Intelligence’

A research analyst at Gartner, Dresner described BI as an ‘umbrella term’ for data-driven decision making and analytics concepts, to differentiate from earlier IT-centric terms. It became synonymous with attempts to use data as a strategic asset within the enterprise and ultimately, empower data consumers with increased access while improving the accuracy and speed of business decisions.

OLAP launches multi-dimensional analytics

More than 20 years after his publication on relational databases, Edgar Codd invented Online Analytical Processing (OLAP), which represented significant advances in the field of BI. OLAP democratized access to data analytics by using a multidimensional data model. This enabled business users – rather than just IT professionals – to conduct their own analysis using complex calculation and trend analysis without the need for advanced technical skills.

The dawn of Qlik

On January 1, 1993, Bjorn Berg and Staffen Gestrelius founded QuikTech. It’s early mission was to trigger a foundational shift in how organizations could harness data for strategic advantage. That dream became a reality with launch of their founding product – QUIKView – which stood for Quality, Understanding, Interaction and Knowledge. The early platform was all about developing a user-centric approach to data analysis, giving people a more intuitive and interactive option compared to traditional BI tools. Both the company and product would soon change names, with QuikTech becoming QlikTech, and Quikview becoming QlikView.

Qlik patents its "Associative" technology

The first iteration of Qlik’s product, released in 1994, included its in-memory associative technology – formally known as Associative Query Logic (AQL). Unlike the OLAP systems that relied on predefined schemas, limiting flexibility and quick implementation, this innovation took a different approach to data analytics. Instead, it enabled dynamic and automatic associations between data fields based on shared names. Qlik patented this technology in 1994, which represented a significant step in simplifying data structures and allowed for deeper exploration and discovery of insights

Natural language principles developed

The turn of the millennium saw another instance when academia influenced the world of analytics. This time, it was the publication of ‘Building Natural Language Generation Systems’ (NLG), co-authored by Professor Ehud Reiter and others, which represented a landmark in the field of Natural Language Generation. Considered a foundational text in the field of NLG, it is critical as a work that informed later developments around AI-led user interactions and the democratization of analytics platforms.

Big Data, and 'The Three Vs, go mainstream

NASA scientists first used the term ‘Big Data’ in 1997 research papers describing the visualization and processing challenges associated with large datasets. Five years later, Gartner analyst Doug Laney distinguished ‘Big Data’ by introducing the three Vs: volume, velocity, and variety. This became the foundation for big data and launching research into big data solutions to solve processing and visualization challenges associated with large data sets.

QlikView 7 breaks down Big Data challenges

The release of QlikView 7 marked a key milestone in the company’s evolution, evolving from a single-user desktop tool to a server-based web platform. This allowed it to support larger datasets often associated with Big Data, as well as simultaneous access by multiple users. By expanding access to those in various locations and using different devices, this significant change enhanced user collaboration throughout the organization, one of the most pervasive challenges of enterprise analytics at the time.

AWS launched cloud-based computing

The evolution of cloud-based computing took the benefits of the web platform further. It reduced the toll of data analytics on business infrastructure and the IT teams that manage it, while removing geographical and accessibility restrictions. This drove the rise of a much more mobile, global workforce. Amazon Web Services helped propel organizations’ ability to harness data analytics by cutting out the needs to make significant investments in physical IT infrastructure.

IBM Watson defeats humans on Jeopardy!

Watson showcased the potential of AI in complex natural language processing and understanding capabilities when it defeated Ken Jennings and Brad Rutter in the gameshow Jeopardy!. The result kickstarted the AI Renaissance, sparking widespread curiosity about machine learning and opening up possibilities for AI applications in business.

Gartner formally introduces the concept of data
discovery

In their annual “Magic Quadrant for Business Intelligence and Analytics Platforms" report, Gartner formally recognized data discovery as a key trend in business intelligence. The introduction of data discovery by Gartner marked a significant turning point in the BI and analytics industry, shifting focus towards more user-friendly, self-service tools and paving the way for the modern, data-driven business landscape we see today.

Qlik Sense powers real-
time decisions

The launch of Qlik Sense set a new standard for modern analytics platforms, combining self-service capabilities with robust governance. It build on the AQL foundation with other advanced technologies such as associative indexing, intuitive design and collaborative functionalities, with the focal aim of empowering users across various roles to make informed decisions based on real-time data. Two years later, Qlik Sense Cloud was released, designed to further increase accessibility for individual users and enable virtual collaboration within small teams.

The inevitable rise of augmented analytics

A team at Google Brain introduced the Transformer architecture in their paper: "Attention is All You Need." This architecture revolutionized natural language processing (NLP) by allowing models to process sequences of data in parallel rather than sequentially. The Transformer became foundational for subsequent models like Google’s BERT and Open AI’s GPT, leading to significant improvements in tasks such as translation, summarization and text generation. This evolution has not only transformed how organizations leverage data but also set new standards for the user experience in BI tools.

Insight Advisor brings NLG capabilities to Qlik Sense

Augmented analytics came to Qlik Sense with the introduction of Insight Advisor. The combination took data accessibility to a new level, enabling users to ask questions in natural language and receive instant visualizations and insights. This functionality continued to evolve with Qlik Sense, with further product enhancements to align with the speed of machine learning and AI development.

Qlik Sense gets
SaaS-y

As enterprises looked to scale their data infrastructure and set the foundations for AI, Qlik Sense SaaS – leveraging AWS cloud infrastructure – marked a significant evolution from the previous cloud-based product. The advanced analytics features, improved scalability and collaborative user experience supported adoption in larger businesses and were designed to help users leverage data more effectively.

Qlik brings
Machine Learning to analytics teams

With the acquisition of Big Squid, the democratization of data became the democratization of machine learning. The integration of its automated machine learning (AutoML) solution enhanced Qlik’s augmented analytics capabilities and provided opportunities for data users to apply machine learning models to business challenges without requiring extensive data science expertise.

AI Goes Mainstream with ChatGPT

The launch of Open AI’s ChatGPT was a watershed moment for the perception of AI. As a conversational model capable of understanding and generating human-like text, it marked the popularization of Generative AI (GenAI). With over 100 million monthly users within two months of launch, it became the fastest-growing consumer application in history. The rapid uptake showcased its accessibility and appeal, drawing massive attention from executives seeking to incorporate conversational AI capabilities into their business, with analytics and BI seen as an early win opportunity.

Building a strong data foundation
for AI

Despite the innovation potential sparked by GenAI, the responses it produced are based on public data, which prompted questions over their origins and validity. Qlik’s strategic acquisitions of Talend – and Attunity in 2019 – represented an attempt to solve this problem. It highlighted the increasing attention on the importance of a solid data foundation for organizations pursuing AI innovation, to ensure that business users only base decisions on trusted, high-quality data.

Qlik Answer and Kyndicc

Qlik brought GenAI to enterprise data management and analytics via the acquisition of Kyndi, a company specializing in Natural Language Processing and AI-driven insights from unstructured data. Six months later, Qlik Answers was designed to provide businesses with instant insights derived from structured and unstructured data across an organization, delivered via a self-service GenAI interface. Qlik Answers mark the latest chapter in the story of empowering data business consumers of data, equipping them with fast, reliable access to information while ensuring transparency in AI-driven responses.

& Beyond

Want to learn more about the evolution of analytics?

Our companion guide dives deeper into this journey, reflecting on the key moments that have informed industry direction to date, where the latest innovations in cloud and AI are transforming enterprise data, and where it might take us next.

Download the guide to understand how the future of analytics can drive value for your business.

VISIONARY VOICES
Download the whitepaper

What role do we humans play in a data landscape increasingly driven by AI? From data scientist to business analyst, get to know the story of analytics, where you fit in and where it can take you next.

This guide includes:

  • A reflection on the journey of analytics technology so far
  • Where AI is creating new roles, democratizing data and improving human decision-making
  • How AI and emerging technologies will further transform how humans engage with data

Download now and find out how to maximize the value of data – and the role of human decision-making – in line with AI-powered disruption.

Welcome to the analytics revolution

You’re ready to enter a new era of data analytics. Wherever AI takes us, there will always be a role for you.

Click the link below to find out what it might be. We’ve also sent an extra copy to your inbox.