ⓘ Agile Business Intelligence


ⓘ Agile Business Intelligence

Agile Business Intelligence refers to the use of Agile software development for BI projects to reduce the time it takes for traditional BI to show value to the organization, and to help in quickly adapting to changing business needs. Agile BI enables the BI team and managers to make better business decisions, and to start doing this more quickly.


1. Agile BI

Agile Business Intelligence BI refers to the use of the agile software development methodology for BI projects to reduce the time-to-value of traditional BI and helps in quickly adapting to changing business needs. Agile BI enables the BI team and managers to make better business decisions. Agile methodology works on the iterative principle; this provides the new features of software to the end users sooner than the traditional waterfall process which delivers only the final product. With Agile the requirements and design phases overlap with development, thus reducing the development cycles for faster delivery. It promotes adaptive planning, evolutionary development and delivery, a time-boxed iterative approach, and encourages rapid and flexible response to change. Agile BI encourages business users and IT professionals to think about their data differently and it characterized by low Total Cost of Change TCC. With agile BI, the focus is not on solving every BI problem at once but rather on delivering pieces of BI functionality in manageable chunks via shorter development cycles and documenting each cycle as it happens. Many companies fail to deliver right information to the right business managers at the right time.


1.1. Agile BI Definition

Agile BI is a continual process and not a onetime implementation. Managers and leaders need accurate and quick information about the company and business intelligence provides the data they need. Agile BI enables rapid development using the agile methodology. Agile techniques are a great way to promote development of BI applications, such as dashboards, scorecards, reports and analytic applications.

"Forrester Research defines agile BI as an approach that combines processes, methodologies, tools and technologies, while incorporating organizational structure, in order to help strategic, tactical and operational decision-makers be more flexible and more responsive to ever-changing business and regulatory requirements". According to the research by the Aberdeen Group, organizations with the most highly agile BI implementations are more likely to have processes in place for ensuring that business needs are being met. Success of Agile BI implementation also heavily depends on the end user participation and "frequent collaboration between IT and the business".


2. Key Performance Criteria

Aberdeen’s Maturity Class Framework uses three key performance criteria to distinguish the Best-in-class in the industry:

  • Availability of timely management information – IT should be able to provide the right and accurate information in timely manner to the business managers to make sound business decisions." This performance metric captures the frequency with which business users receive their information they need in the timeframe they need it”.
  • Average time required to create a new dashboard – This metric considers the time required to access any new or updated information and it measures the total elapsed time required to create a new dashboard.
  • Average time required to add a column to an existing report – Sometimes new columns need to be added to an existing report to see the required information. "If that information cannot be obtained within the time required to support the decision at hand, the information has no material value. This metric measure the total elapsed time required to modify an existing report by adding a column".


3. Five Steps To Agile BI

Bruni in her article 5 Steps To Agile BI outlines the five elements that promote an Agile BI enterprise environment.

  • Agile Project Management Methodology – continuous planning and execution. Planning is done at the beginning of each cycle, rather than one time at the beginning of the project as in traditional projects. In Agile project, scope can be changed any time during the development phase.
  • Cloud & Agile BI – Many organizations are implementing cloud technology now as it is the cheaper alternative to store and transfer data. Companies who are in their initial stages of implementing Agile BI should consider the Cloud technology as cloud services can now support BI and ETL software to be provisioned in the cloud.
  • Agile Development Methodology –" need for an agile, iterative process that speeds the time to market of BI requests by shortening development cycles”.
  • Agile Infrastructure – the system should have virtualization and horizontal scaling capability. This gives flexibility to easily modify the infrastructure and could also maintain near-real-time BI more easily than the standard Extract, transform, load ETL model.
  • IT Organization & Agile BI – To achieve agility and maximum effectiveness, the IT team should interact with the business, but also address the business problems and should have a strong and cohesive team.

4.1. Twelve Agile Principles Process

1. Our highest priority is to satisfy the customer through early and continuous delivery of valuable software.

2. Welcome changing requirements, even late in development. Agile processes harness change for the customers competitive advantage.

3. Deliver working software frequently, from a couple of weeks to a couple of months, with a preference to the shorter timescale.

4. Working software is the primary measure of progress.


4.2. Twelve Agile Principles People

5. Agile processes promote sustainable development. The sponsors, developers, and users should be able to maintain a constant pace indefinitely.

6. Business people and developers must work together daily throughout the project.

7. Build projects around motivated individuals. Give them the environment and support they need, and trust them to get the job done.


4.3. Twelve Agile Principles Other

8. The most efficient and effective method of conveying information is face-to-face conversation.

9. At regular intervals, the team reflects on how to become more effective, then tunes and adjusts its behavior.

10. Continuous attention to technical excellence and good design enhances agility.

11. Simplicity-the art of maximizing the amount of work not done-is essential.

12. The best architectures, requirements, and designs emerge from self-organizing teams.


5. BI model and its characteristic goals

Kernochan, in his two-year study of organization’s BI process came up with the below model and its characteristic goals:

  • Data aggregation - scope
  • Information analysis - analyzability
  • Information targeting - fit
  • Information delivery - timeliness
  • Data entry - accuracy
  • Data consolidation - consistency

5.1. BI model and its characteristic goals Common Issues

Kernochan’s study found these common issues with the current BI processes:

  • 75% of new key information sources that surface on the Web are not passed on to users within the year agility
  • 50% of data is inconsistent consistency
  • 60% of the time, users cant do immediate online analysis of data they receive analyzability
  • 20% of data has error in it accuracy
  • It isnt possible to do a cross-database query on 70% of company data scope
  • 65% of the time, executives dont receive the data they need fit
  • It typically takes 7 days to get data to the end user timeliness

The result concluded that the adding of agility to existing business intelligence will minimize problems. Organizations are slowly trying to move the entire organization processes to agile methodology and development. Agile BI will play a big part in company’s success as it "emphasizes integration with agile development and innovation".


6. Improving Business Intelligence Agility

There are couple of factors that influence the success of Business Intelligence Agility.

Data Entry

20% of data is inaccurate and about 50% is inconsistent and these numbers increases with new type of data. Processes need to be re-evaluated and corrected to minimize data entry errors.


6.1. Improving Business Intelligence Agility Data Entry

20% of data is inaccurate and about 50% is inconsistent and these numbers increases with new type of data. Processes need to be re-evaluated and corrected to minimize data entry errors.


6.2. Improving Business Intelligence Agility Data Consolidation

Often companies have multiple data stores and data is scattered across multiple data stores. "Agility theory emphasizes auto-discovery of each new data source, and automated upgrade of metadata repositories to automatically accommodate the new information".


6.3. Improving Business Intelligence Agility Data Aggregation

Is a process in which information from many data stores is pulled and displayed in a summary report. Online analytical processing OLAP is a simple type of data aggregation tools which is commonly used.


6.4. Improving Business Intelligence Agility Information Delivery

One of the key principal of Agile BI is to deliver the right data at the right time to the right individual. Historical data should also be maintained for comparing the current performance with the past.


6.5. Improving Business Intelligence Agility Information Analysis

One of the largest benefits of Agile BI is in improving the decision-making of its users. Real Agile BI should focus on analysis tools that make an operational process or new product development better. The Agile BI approach will save company money, time, and resources that would otherwise be needed to build a traditional data warehouse using the Waterfall methodology.


7. Agile BI Checklist

  • Select either a business stakeholder or technical liaisons to represent the business
  • Initiate iterative development process
  • Identify and prioritize appropriate user stories or requirements to address during an initial project
  • A team of developers and business representatives should be assembled to work together
  • Assess various Agile BI delivery tools that can integrate with your existing data warehouse and BI environment

8. Advantages of using Agile BI

Agile BI drives its users to self-serve BI. It offers organizations flexibility in terms of delivery, user adoption, and ROI.

Faster to Deliver

Using Agile methodology, the product is delivered in shorter development cycles with multiple iterations. Each iteration is a working software and can be deployed to production.

Increased User Acceptance

In an Agile development environment, IT and business work together often in the same room refining the business needs in each iteration. "This increases user adoption by focusing on the frequently changing needs of the non-technical business user, leading to high end-user engagement, and resulting in higher user adoption rates".

Increased ROI

Organizations can achieve increased rate-of-return ROI due to shorter development cycles. This minimizes the IT resources and time while delivering working, relevant reports to end-users.


9. Agile BI Best Practices

  • Data validation and verification should be completed for each development iteration.
  • Iterations should be time-boxed.
  • Any change that will be deployed to production should be thoroughly tested in regression environment.
  • Validate the BI Architecture and get approval on the proof of concept.
  • Have a formal change control; this will minimize the risk as all changes have to be approved before it goes into production.
  • Start with the business information needs to provide context for scope.
  • Use flow charts or diagram to explain the BI process along with some documentation.
  • Stress on data discovery through the requirements and design phase.
  • Use the Agile process of incremental and iterative development and deployment.
  • A program charter should be created, which will set the stakeholder expectations on how Agile BI system will work.
  • Design. Quantellia white paper, December 2008 Rob Rich: Agile Decision Making: Improving Business Results with Analytics TM Forum, November 2011 Why Google
  • the process. The benefits of using business processes include improved customer satisfaction and improved agility for reacting to rapid market change
  • Raytheon Intelligence Information and Services RIIS or IIS is a business unit of Raytheon Company headquartered in Dulles, Virginia. IIS specializes
  • Agility PR Solutions formerly MediaMiser is a provider of media monitoring and analysis software and professional services for public relations and
  • search - based applications and content analysis Agile application Agile development Business Intelligence 2.0 BI 2.0 Enterprise Search Search oriented
  • and adapt, encompassing Agile Evolutionary and Lean approaches, as well as many others. Operations management area of business that is concerned with
  • Brain as a Business Model - European Financial Review Risk Management Asset Liability Management Financial Darwinism Agility Agility is the most decisive
  • Bespoke application development Agile Consulting Agile consulting and programme management Business Intelligence Analytics Enterprise level data
  • Globes Online, Israel business news. Retrieved 2015 - 06 - 01. CoolaData Retrieved 1 June 2015. About CoolaData CoolaData Agile Behavioral Analytics

Users also searched:

business intelligence best practices,