Aequor Group
  • Home

Wednesday, 2 March 2016

Best Practices For BI/DW Project Planning

 Aequor Technologies     02:59     Aequor, Big Data, IT solutions     No comments   

BI Application & Data Warehouse Project Planning should be done perfectly from all aspects: technically, resource-wise and from a business perspective. It is key to a project’s successful execution and completion.

So here is what you should do.

1. For Data Sourcing

Ensure you have all the data that is needed to compile measurements and to answer the driving business questions. For that matter, focus on these 4 things:

i. Identify data sources in the early planning stages so that all the data you might need, is readily available.
ii. Develop an understanding of how you will integrate the different data sources from, let’s say, multiple internal systems and external repositories.
iii. Ensure timeliness and consider all the cost-related constraints. You should consider how frequently you can collect data from the aforementioned sources. Also, consider the cost of refreshing your data from external data sources. In case you are using social media as a data source, more frequent updates may be required. 
iv. If cost becomes a limiting factor, as would be the case with social media data, you can consider sampling smaller data sets more frequently rather than collecting large amounts of data. Larger data sets may give you more accurate social media measures; however, well designed sampling techniques can still give useful information.

2. For BI/Data Warehouse Resources

You need a team with the capability to handle cross-organizational interactions and a deep understanding of the business issues for strengthening relationships with business users. Moreover, they should know the best ways to work with others and communicate more effectively both in writing and in business meetings and presentations. The challenges become even more pronounced as the DW/BI system evolves into a standard component of the IT environment, thus weakening the connection to the business. 

3. When Dealing With Big Data

Historically, Business Intelligence (BI) was practiced using established practices and tools, including dimensional modeling, extraction transformation and load (ETL), ad hoc reporting and dashboards. These techniques required that a data warehouse or at least a data mart is able to support management reporting that was not generally available from transaction processing systems. 

Today, we have to tap into a broader array of information captured in big data. Here are some essential characteristics to keep in mind as you develop a strategy for big data analysis.

Big data does not completely come from sales, inventory or human resources systems. It is generally a varied mixture of data sourced from application log files, machine sensor data, and social media.

1. Descriptive statistics. It is especially useful with big data sets when you partition the data and compare different groups. Most BI practitioners are familiar with this technique wherein calculations such as mean, median, and standard deviation are commonly used to describe a population. So when you get the data from Application log, you can find the average time spent in your Web application prior to the sale and not just calculate the average dollar value of a sales transaction from a sales data

2. Grouping your customers. Now normally you would do that by sales region but that is not the most informative way to organize and analyze your data. In lieu, you should think of clustering. This machine learning technique is used to identify subsets of data with similar characteristics. For example, clustering might help you identify different groups of customers based on the time spent in your Web application and the amount of their sales transaction.

3. Last you can explore big data sets and testing hypotheses to complement the types of analysis you do with your traditional BI systems.
Once you have identified a group of customers, you can also analyze their navigation patterns on the site.  Since they spend a significant amount of time on your site, you can reasonably hypothesize whether they are interested in making a purchase or not. 

4. Dealing with Big Data Types

• For large volumes, deploy enough commodity servers and storage along with a distributed file system, like the Hadoop File System (HDFS), and you can collect petabytes of data. 
• If you do not need to store the data for too long, you can take advantage of public clouds like Amazon AWS, Microsoft Azure and Rackspace, but watch out for long term storage costs.
• If you have rapidly changing data consider using a real time big data analytics tool like Storm. 


Traditional BI is not dead yet and will not be anytime soon. It is here to stay as long as the business fundamentals are the same.  So the management reporting based on data from transaction processing systems will remain useful. However, big data shall introduce new ways of understanding business operations that complement existing management reporting systems.
 

  • Share This:  
  •  Facebook
  •  Twitter
  •  Google+
  •  Stumble
  •  Digg

Related Posts:

  • Aequor Healthcare Services Announces Acquisition of Locum Connections, LLC Aequor Healthcare Services, a Certified Joint Commission, healthcare staffing and solutions company, today announced the acquisition of Locum Con… Read More
  • Aequor To Attend Bio-IT World Conference & Expo 2015 At BOOTH #235, you may visit Aequor in the Bio-IT World Conference & Expo 2015 i.e. scheduled for April 21-23 in Sea Port World Trade Center, … Read More
  • Best Practices For BI/DW Project Planning BI Application & Data Warehouse Project Planning should be done perfectly from all aspects: technically, resource-wise and from a business persp… Read More
  • Demand for SaaS To Surge in 2016: Critical Things Businesses Should Know Before Adopting SaaS Apps !-- /* Font Definitions */ @font-face {font-family:"Courier New"; panose-1:2 7 3 9 2 2 5 2 4 4; mso-font-charset:0; mso-generic-font-family:aut… Read More
  • Aequor Healthcare Services, LLC Announces Acquisition of TheraStaff, LLC effective September 12, 2016. !-- /* Font Definitions */ @font-face {font-family:Arial; panose-1:2 11 6 4 2 2 2 2 2 4; mso-font-charset:0; mso-generic-font-famil… Read More
Newer Post Older Post Home

0 comments:

Post a Comment

Popular Posts

  • 20 Inspiring Customer Service Quotes
    If you are a successful service provider, you probably know what a customer wants. And this knowledge you need to persevere every day. We ...
  • The Role of IT Organizations Is Changing - Top Changes That Are Anticipated!
    From past many years, IT organizations were structured to play the traditional role of keeping corporate information accessible and safe, ...
  • Aequor Wins CIO Review Certificate of Recognition
    For being the Top 20 Most Promising Pharma and Life Sciences Consulting providers, Aequor has been awarded the CIO Review Certificate of ...
  • Top 5 Things to Look For When Outsourcing Managed Infrastructure Services
    Cost- and value-driven nature of IT infrastructure dictates that your outsource partner gives you the most flexible and custom solution th...
  • Customer Experience: How it is Related to Business Value?
    Customer experience is a major driver of future revenue. This “thing” or this “term” is so important these days that in the 2005 book, Ret...
  • Top Technologies Business Should Focus on in 2015
    Having worked in the tech industry for close to two decades, Aequor best understands how enterprises willing to run at the speed of chang...
  • Top 5 Critical Things To Look for When Choosing An Outsourcing Partner
    One must make an informed decision when choosing and/or appointing an outsourcing partner for IT/ BPO services. It am be time-taking but p...
  • Aequor Healthcare Services, LLC Announces Acquisition of TheraStaff, LLC effective September 12, 2016.
    The company will be part of the wholly owned Allied company Therapy Staff, LLC.- This acquisition will enable Therapy S...
  • Best Practices For BI/DW Project Planning
    BI Application & Data Warehouse Project Planning should be done perfectly from all aspects: technically, resource-wise and from a busi...
  • You’re just the nurse. How important could you be?
      I spent an entire year of my life defending the intelligence of the nursing profession. The number of people that actually believe we are ...

Blog Archive

  • March (1)
  • June (1)
  • July (1)
  • June (1)
  • March (1)
  • November (1)
  • March (1)
  • February (2)
  • August (2)
  • July (2)
  • June (2)
  • May (5)
  • April (3)

Copyright © 2025 Aequor Group