How large the Data Warehouse market will grow nobody knows yet. But for sure it is still growing fast, and currently is estimated at 4,5 billion dollar per year (IDC).

1. Why Do Data Warehouse Projects Run Into Scope Creep?

To quote Bill Inmon (guru and author of several great books on Data Warehousing) "Traditional projects start with requirements and end with data. Data Warehousing projects start with data and end with requirements." As soon as the project gets under way, users will find new applications, and with it will come new requests for data. Interestingly, these projects often are justified by moving Q&R work away from the 'data people'. What we've seen is that the first thing that happens as soon as the project delivers is that more requests for special queries are submitted to these same 'data people'. This may appear to undermine the initial business case but actually signals the onset of value creation from the DWH project.

2. Star Schema Versus Entity Relation Model?

There has been enormous debate in the community about the merits of different data models. At the risk of over simplifying: ER models tend to have better performance (processing time) for the end user, and are often perceived as "easier" to understand by end users. Drawbacks are that ER models require more disk space, and, because of the intrinsic redundancy in the data, have consistency problems from a maintenance perspective. Having said this, the practice seems to be that often some combination of the two is unavoidable in the practical setting, despite preferences (ER or Star) of the chief architects. Overall, Star models seem to have gained the most ground.

3. The Importance of a Data Warehouse Business Case

Much has been written about the business case for a Data Warehouse. What goes in to a good business case? IT savings are ubiquitous in DWH business cases. The important point is to not limit this to 'pure' savings, but to connect to primary business processes as much as possible. As an example, faster turnaround cycles for list selections are fine (when quantified in hourly rates), but it is even better if the revenue from more customer acquisitions that follow from these selections can be tied in. Not only will the relation to revenue growth rather than savings make for a more balanced business case, more important is the intrinsic business buy-in that results from a direct connection to the company bottom line. These days, changes in legislation (in particular Sarbanes-Oxley) play a major role in justifying business cases. This may be either through a higher company valuation for its transparent information gathering, or, less sleepless night for the CEO, which is of course priceless...

4. Why Do Data Warehouse Projects 'Never' Go Wrong?

Actually, Data Warehouse projects do sometimes fail. But, they fail so rarely, that it is actually very hard to believe... Especially after having talked to so many disgruntled end-users. And there are many ways a Data Warehouse project can go wrong. Delivering on time, data administration issues, and unavoidable data quality issues in feeding systems. Corporate politics (see Tip 7) are probably the best explanation for this phenomenon of near 100% success rates on DWH projects. In my experience, the reason why a failure or 'semi-failure' can go unnoticed is either because senior management is not aware, or, let's say "unmotivated" to talk about misspending of company funds. As a result, not enough is learned. Maybe we as consultants have a stake in this as well, as this assures the industry plenty of ongoing business... J

5. What is Different About Warehousing Web Data?

Kimball & Merz (2000): "Although this clickstream data in many cases is raw and unvarnished, it has the potential of providing unprecedented detail about every gesture made by every human being using the Web medium". The subatomic nature of clickstream data poses unique challenges. There are fewer built in feedback mechanisms to ensure data quality, compared to other data streams. The relation between user mouse clicks and server log records is not as tight as in "traditional" transaction processing due to technical issues like proxy servers and caching. Because of these differences, IT people need to adapt to the web process flow, rather than having the process adapt to IT needs as is common for most other DWH interfaces.

6. Which Data Should Be loaded In The Data Warehouse?

The data that enter the DWH ultimately determine its place in the organization. A "let's load all data, to be safe"-attitude is a sure fire way to derail your DWH project. Choices as to what should and should not be included need to be made early on, to keep the project manageable. After proven success of the delivered, deployed, and profitably exploited DWH, there always will be funding somewhere to include previously ignored interfaces. Given the anticipated lifecycle of the DWH, it makes perfect sense to consciously exclude certain sources. The choice as to what data to include needs to be driven by business considerations, and in particular reference to the company bottom line. If it can't be shown how data will be put to use profitably, they stay out! See also tip #3.

7. Data Warehousing & Company Politics

Data Warehouses have an impact on the company bottom line. Hence, they are likely candidates for turf battles, and are also at risk of becoming "small change" in budget allocation negotiations. None of these considerations benefit corporate long term goals. Managing a DWH project is hard enough as it is, and budget issues shouldn't make it any harder than it already is. Because DWH investments are in the present and revenues lie in the future, it is even more important to secure funding through a sound business case and buy-in from the appropriate (high) management level. See also Tip #3. Access to data means power, and talking about power is one of the greatest management taboos, still around. Sensitive as they are, even budgets are more readily discussed...

8. Data Warehouse Projects Traps

Some commonly recurring 'roadblocks' on the path to timely delivery of a Data Warehouse project:

• ETL processes have eaten up so much time (and still need "babysitters"), that little if any time is left to develop applications needed to exploit the DWH
• Some data are needed, but turn out not to be unavailable, or not in a timely fashion
• Maintenance required for tuning, indexing, and backup and recovery is severely underestimated
• Different ways of calculating the same phenomenon lead to different results, and nobody is able to conclusively explain the difference(s)
• The data that is loaded (and recombined) turn out to contain previously unknown inconsistencies in the source systems, the 'classic' data quality issues that trip DWH projects
• Metadata were lacking, and developers spend inordinate amounts of time finding out what a field really 'means'

9. DWH Hardware and Software Go Hand in Hand

In Data Warehousing, it is not about hardware, and not Shipping Boxes For Your Packaging Needs
One needs to appropriately pack the goods with the right shipping boxes. There are lots to choose from, and you can either purchase this from the shipping company that will ship the goods for you, or you can purchase this from other stores. You can try checking out the Internet for such retailers, as there are now many who have online stores where you can order online – this would make your purchasing a lot easier.You can check www.uline.com for a list of their products. They have shipping boxes available as their easy-fold mailers, bulk cargo containers, heavy-duty boxes, corrugated boxes, computer boxes, and many more. They also have corrugated pads for your shipping needs as well, especially for goods, which need partitions, & buffers to give it more protection while in transit.Also, there is this website at www.packagingsupplies.com, and you can click on the ‘Boxes’ category to get a list of their shipping cartons. For example, they have these white corrugated mailers that is somewhat formal than the usual brownish colored boxes. These white ones, when used as shipping boxes or containers, will provide a more me) for the end user, and are often perceived as "easier" to understand by end users. Drawbacks are that ER models require more disk space, and, because of the intrinsic redundancy in the data, have consistency problems from a maintenance perspective. Having said this, the practice seems to be that often some combination of the two is unavoidable in the practical setting, despite preferences (ER or Star) of the chief architects. Overall, Star models seem to have gained the most ground.

3. The Importance of a Data Warehouse Business Case

Much has been written about the business case for a Data Warehouse. What goes in to a good business case? IT savings are ubiquitous in DWH business cases. The important point is to not limit this to 'pure' savings, but to connect to primary business processes as much as possible. As an example, faster turnaround cycles for list selections are fine (when quantified in hourly rates), but it is even better if the revenue from more customer acquisitions that follow from these selections can be tied in. Not only will the relation to revenue growth rather than savings make for a more balanced business case, more important is the intrinsic business buy-in that results from a direct connection to the company bottom line. These days, changes in legislation (in particular Sarbanes-Oxley) play a major role in justifying business cases. This may be either through a higher company valuation for its transparent information gathering, or, less sleepless night for the CEO, which is of course priceless...

4. Why Do Data Warehouse Projects 'Never' Go Wrong?

Actually, Data Warehouse projects do sometimes fail. But, they fail so rarely, that it is actually very hard to believe... Especially after having talked to so many disgruntled end-users. And there are many ways a Data Warehouse project can go wrong. Delivering on time, data administration issues, and unavoidable data quality issues in feeding systems. Corporate politics (see Tip 7) are probably the best explanation for this phenomenon of near 100% success rates on DWH projects. In my experience, the reason why a failure or 'semi-failure' can go unnoticed is either because senior management is not aware, or, let's say "unmotivated" to talk about misspending of company funds. As a result, not enough is learned. Maybe we as consultants have a stake in this as well, as this assures the industry plenty of ongoing business... J

5. What is Different About Warehousing Web Data?

Kimball & Merz (2000): "Although this clickstream data in many cases is raw and unvarnished, it has the potential of providing unprecedented detail about every gesture made by every human being using the Web medium". The subatomic nature of clickstream data poses unique challenges. There are fewer built in feedback mechanisms to ensure data quality, compared to other data streams. The relation between user mouse clicks and server log records is not as tight as in "traditional" transaction processing due to technical issues like proxy servers and caching. Because of these differences, IT people need to adapt to the web process flow, rather than having the process adapt to IT needs as is common for most other DWH interfaces.

6. Which Data Should Be loaded In The Data Warehouse?

The data that enter the DWH ultimately determine its place in the organization. A "let's load all data, to be safe"-attitude is a sure fire way to derail your DWH project. Choices as to what should and should not be included need to be made early on, to keep the project manageable. After proven success of the delivered, deployed, and profitably exploited DWH, there always will be funding somewhere to include previously ignored interfaces. Given the anticipated lifecycle of the DWH, it makes perfect sense to consciously exclude certain sources. The choice as to what data to include needs to be driven by business considerations, and in particular reference to the company bottom line. If it can't be shown how data will be put to use profitably, they stay out! See also tip #3.

7. Data Warehousing & Company Politics

Data Warehouses have an impact on the company bottom line. Hence, they are likely candidates for turf battles, and are also at risk of becoming "small change" in budget allocation negotiations. None of these considerations benefit corporate long term goals. Managing a DWH project is hard enough as it is, and budget issues shouldn't make it any harder than it already is. Because DWH investments are in the present and revenues lie in the future, it is even more important to secure funding through a sound business case and buy-in from the appropriate (high) management level. See also Tip #3. Access to data means power, and talking about power is one of the greatest management taboos, still around. Sensitive as they are, even budgets are more readily discussed...

8. Data Warehouse Projects Traps

Some commonly recurring 'roadblocks' on the path to timely delivery of a Data Warehouse project:

• ETL processes have eaten up so much time (and still need "babysitters"), that little if any time is left to develop applications needed to exploit the DWH
• Some data are needed, but turn out not to be unavailable, or not in a timely fashion
• Maintenance required for tuning, indexing, and backup and recovery is severely underestimated
• Different ways of calculating the same phenomenon lead to different results, and nobody is able to conclusively explain the difference(s)
• The data that is loaded (and recombined) turn out to contain previously unknown inconsistencies in the source systems, the 'classic' data quality issues that trip DWH projects
• Metadata were lacking, and developers spend inordinate amounts of time finding out what a field really 'means'

9. DWH Hardware and Software Go Hand in Hand

In Data Warehousing, it is not about hardware, and not 2007 Thoughts on Starting a Mobile Oil Change Business
For those of us who love cars and are mechanically inclined starting a small business, which has to do with auto-maintenance, makes a lot of sense. Many folks would love to own their own business as part of their American Dream. The question is what type of business can we see ourselves enjoying and excelling at and how on Earth would we come up with the $500,000 to $1,000,000 to start an Auto Maintenance Shop? Even renting a bay and buying all the equipment can be costly and run $100,000 to $250,000.This is why many just starting out consider running a mobile oil change business instead. By running a mobile oil change business you delete the need for an expensive shop and can rent a small industrial space to park the equipment and store the bulk oil and waste oil for pickup. Starting a Mobile Oil Change Business sounds rather easy and everyone owns a car and there are many fleets of vehicles out there too that need preventative maintenance care such as oil changes. Getting business should be fairly easy right?Indeed, there are certainly a lot of cars out there and they all need oil changes however there are issues, suc for the CEO, which is of course priceless...

4. Why Do Data Warehouse Projects 'Never' Go Wrong?

Actually, Data Warehouse projects do sometimes fail. But, they fail so rarely, that it is actually very hard to believe... Especially after having talked to so many disgruntled end-users. And there are many ways a Data Warehouse project can go wrong. Delivering on time, data administration issues, and unavoidable data quality issues in feeding systems. Corporate politics (see Tip 7) are probably the best explanation for this phenomenon of near 100% success rates on DWH projects. In my experience, the reason why a failure or 'semi-failure' can go unnoticed is either because senior management is not aware, or, let's say "unmotivated" to talk about misspending of company funds. As a result, not enough is learned. Maybe we as consultants have a stake in this as well, as this assures the industry plenty of ongoing business... J

5. What is Different About Warehousing Web Data?

Kimball & Merz (2000): "Although this clickstream data in many cases is raw and unvarnished, it has the potential of providing unprecedented detail about every gesture made by every human being using the Web medium". The subatomic nature of clickstream data poses unique challenges. There are fewer built in feedback mechanisms to ensure data quality, compared to other data streams. The relation between user mouse clicks and server log records is not as tight as in "traditional" transaction processing due to technical issues like proxy servers and caching. Because of these differences, IT people need to adapt to the web process flow, rather than having the process adapt to IT needs as is common for most other DWH interfaces.

6. Which Data Should Be loaded In The Data Warehouse?

The data that enter the DWH ultimately determine its place in the organization. A "let's load all data, to be safe"-attitude is a sure fire way to derail your DWH project. Choices as to what should and should not be included need to be made early on, to keep the project manageable. After proven success of the delivered, deployed, and profitably exploited DWH, there always will be funding somewhere to include previously ignored interfaces. Given the anticipated lifecycle of the DWH, it makes perfect sense to consciously exclude certain sources. The choice as to what data to include needs to be driven by business considerations, and in particular reference to the company bottom line. If it can't be shown how data will be put to use profitably, they stay out! See also tip #3.

7. Data Warehousing & Company Politics

Data Warehouses have an impact on the company bottom line. Hence, they are likely candidates for turf battles, and are also at risk of becoming "small change" in budget allocation negotiations. None of these considerations benefit corporate long term goals. Managing a DWH project is hard enough as it is, and budget issues shouldn't make it any harder than it already is. Because DWH investments are in the present and revenues lie in the future, it is even more important to secure funding through a sound business case and buy-in from the appropriate (high) management level. See also Tip #3. Access to data means power, and talking about power is one of the greatest management taboos, still around. Sensitive as they are, even budgets are more readily discussed...

8. Data Warehouse Projects Traps

Some commonly recurring 'roadblocks' on the path to timely delivery of a Data Warehouse project:

• ETL processes have eaten up so much time (and still need "babysitters"), that little if any time is left to develop applications needed to exploit the DWH
• Some data are needed, but turn out not to be unavailable, or not in a timely fashion
• Maintenance required for tuning, indexing, and backup and recovery is severely underestimated
• Different ways of calculating the same phenomenon lead to different results, and nobody is able to conclusively explain the difference(s)
• The data that is loaded (and recombined) turn out to contain previously unknown inconsistencies in the source systems, the 'classic' data quality issues that trip DWH projects
• Metadata were lacking, and developers spend inordinate amounts of time finding out what a field really 'means'

9. DWH Hardware and Software Go Hand in Hand

In Data Warehousing, it is not about hardware, and not Using Influence To Get What You Want
The Law of Social Proof. The Law of Authority. The Law of Contrast. Do these terms mean anything to you? They will in a moment!You won't find these laws in your country's Constitution or legal writings, but whether you realize it or not they affect your life every day. That's because these laws are being used to influence your thoughts and actions all the time, without your even realizing it.We all know, of course, that the advertising industry is constantly "pushing our buttons" --- that's how they persuade us to buy the goods and services they are selling. We accept that. Sometimes we are aware of the tactics and consciously decide whether or not to respond, but for most of the time we're oblivious to them. We simply react, and very often with the desired response --- THEIR desired response!These laws are psychological laws, and they work because we human beings are remarkably predictable. We may be different from each other in our personalities, our backgrounds, our belief systems, our characters and other ways, but our basic human psychological responses are surprisingly similar.So advertisers and othessing due to technical issues like proxy servers and caching. Because of these differences, IT people need to adapt to the web process flow, rather than having the process adapt to IT needs as is common for most other DWH interfaces.

6. Which Data Should Be loaded In The Data Warehouse?

The data that enter the DWH ultimately determine its place in the organization. A "let's load all data, to be safe"-attitude is a sure fire way to derail your DWH project. Choices as to what should and should not be included need to be made early on, to keep the project manageable. After proven success of the delivered, deployed, and profitably exploited DWH, there always will be funding somewhere to include previously ignored interfaces. Given the anticipated lifecycle of the DWH, it makes perfect sense to consciously exclude certain sources. The choice as to what data to include needs to be driven by business considerations, and in particular reference to the company bottom line. If it can't be shown how data will be put to use profitably, they stay out! See also tip #3.

7. Data Warehousing & Company Politics

Data Warehouses have an impact on the company bottom line. Hence, they are likely candidates for turf battles, and are also at risk of becoming "small change" in budget allocation negotiations. None of these considerations benefit corporate long term goals. Managing a DWH project is hard enough as it is, and budget issues shouldn't make it any harder than it already is. Because DWH investments are in the present and revenues lie in the future, it is even more important to secure funding through a sound business case and buy-in from the appropriate (high) management level. See also Tip #3. Access to data means power, and talking about power is one of the greatest management taboos, still around. Sensitive as they are, even budgets are more readily discussed...

8. Data Warehouse Projects Traps

Some commonly recurring 'roadblocks' on the path to timely delivery of a Data Warehouse project:

• ETL processes have eaten up so much time (and still need "babysitters"), that little if any time is left to develop applications needed to exploit the DWH
• Some data are needed, but turn out not to be unavailable, or not in a timely fashion
• Maintenance required for tuning, indexing, and backup and recovery is severely underestimated
• Different ways of calculating the same phenomenon lead to different results, and nobody is able to conclusively explain the difference(s)
• The data that is loaded (and recombined) turn out to contain previously unknown inconsistencies in the source systems, the 'classic' data quality issues that trip DWH projects
• Metadata were lacking, and developers spend inordinate amounts of time finding out what a field really 'means'

9. DWH Hardware and Software Go Hand in Hand

In Data Warehousing, it is not about hardware, and not Procurement Definition
Procurement can be defined as the purchase of merchandise or services at the optimum possible total cost in the correct amount and quality. These good and services are also purchased at the correct time and location for the express gain or use of government, company, business, or individuals by signing a contract.The process of acquisition of goods or services required as raw material (direct procurement) or for operational purposes (indirect procurement) for a company or a person can be called procurement. The procurement process not only involves the purchasing of commodities but also quality and quantity checks. Usually, suppliers are listed and pre-determined by the procuring company. This makes the process smoother, promoting a good business relationship between the buyer and the supplier.The synonyms for procurement, which are gain, purchase, buy, and acquire, can throw light on the meaning of procurement. The process of procurement may differ from company to company, and a government institution may have a slightly different procurement process compared to a private company.Procurement can also be simply ds. Because DWH investments are in the present and revenues lie in the future, it is even more important to secure funding through a sound business case and buy-in from the appropriate (high) management level. See also Tip #3. Access to data means power, and talking about power is one of the greatest management taboos, still around. Sensitive as they are, even budgets are more readily discussed...

8. Data Warehouse Projects Traps

Some commonly recurring 'roadblocks' on the path to timely delivery of a Data Warehouse project:

• ETL processes have eaten up so much time (and still need "babysitters"), that little if any time is left to develop applications needed to exploit the DWH
• Some data are needed, but turn out not to be unavailable, or not in a timely fashion
• Maintenance required for tuning, indexing, and backup and recovery is severely underestimated
• Different ways of calculating the same phenomenon lead to different results, and nobody is able to conclusively explain the difference(s)
• The data that is loaded (and recombined) turn out to contain previously unknown inconsistencies in the source systems, the 'classic' data quality issues that trip DWH projects
• Metadata were lacking, and developers spend inordinate amounts of time finding out what a field really 'means'

9. DWH Hardware and Software Go Hand in Hand

In Data Warehousing, it is not about hardware, and not about software: it is about the perfect integration of these two. Those who begin their project from either end, will pay dearly for this mistake. Reasons are:

· in terms of price/performance, new, pre-integrated hardware-software combinations are taking the lead

· from a project management perspective, you never want to be caught between vendors when a proposed solution doesn't work as expected

· database tuning and indexing is very important and a hugely complex job, necessarily left to specialists (in-house trained)

10. Performance is Key

Although I don't often find technology factors to be this important, in Data Warehouse acceptance, no other factor will be as important as performance. As size increases over time, this factor becomes even more important. There are three reasons for this:

1. performance has a huge impact on the development speed (initial load is always very time consuming), and hence the overall maturity of the DWH at delivery time
2. performance can make or break end-user acceptance, in particular the predictability of performance
3. performance has a tremendous impact on end user productivity, the ultimate driver of the business pay-off

Source Data Warehousing - Tom's Ten Data Tips

HTTP = HTML link (for blogs, profiles,phorums):
<a href="http://www.caseupon.com/article/2572/caseupon-Data-Warehousing--Toms-Ten-Data-Tips.html">Data Warehousing - Tom's Ten Data Tips</a>

BB link (for phorums):
[url=http://www.caseupon.com/article/2572/caseupon-Data-Warehousing--Toms-Ten-Data-Tips.html]Data Warehousing - Tom's Ten Data Tips[/url]

Related Articles:

Are You Safe? The Truth About Portable Appliance Testing

Electrical Safety Rogue Traders. There are many companies out there who do not carry out the testing correctly. They do not check the plugs or fuse ratings for appliances. All standard plug tops should be checked to ensure they are wired correctly, the terminals are secure, the fuse rating is correct and the general condition is ok. On moulded plugs the fuse rating should always be checked. On numerous occasions we have been called out to re-test another so called specialists work.

Cotton Voyage - Fibre 2 Fashion

Cotton has sustained its position as the most versatile fiber in the world, even after nearly eighty centuries. None of the other fiber has such characteristics to obtain amicable results which cotton has. Cotton has several uses and a thousand faces, it is well known for its usefulness, look, presentation and above all the comfort it gives. It generates millions of employment as it moves from yarn to final products.

Non-profit Charities

Charity is possibly the best way to support the downtrodden. These days there are several non-profit charitable institutions across the globe that are working in different areas with an objective to help people in need and work for their development. Helping with the rehabilitation of victims of natural disasters, child education, and women empowerment are some of the different responsibilities taken up by these organizations. These charities mainly depend on donations by the well-to-do section of society and government grants in order to function and continue with their social service.

Bookmark it: