Obstacles to EVM

Obstacles, real or imagined, stop many programs and organizations from implementing EVM. Table 19 describes 11 common concerns about EVM implementation and discusses the basis of each one.

Table 19: Eleven Common Concerns about EVM
Scroll to the right to view full table.
Concern Basis for concern
  1. EVM is too expensive to implement.
  • It is expensive to implement EVM when no formal EVM system is in place. Some companies spend $1 million to $2 million to put a good system in place, including efforts such as performing an initial assessment, developing an implementation plan, creating compliance documentation, implementing hardware and software, establishing good cost, scheduling, and reporting systems, conducting training, and doing certification preparation.
  • Many companies already have some elements in place and can get certified with less effort. Even so, most of the time this is a significant investment that can translate instead into several hundred thousand dollars. Something as simple as a spreadsheet workbook with worksheets for the plan and time-stamped snapshots of status to date can serve as an effective EVM function for smaller projects.
  • On the other hand, companies that do establish a good EVM system realize better program management decision making and have fewer cost and schedule overruns and potentially greater repeat business. It is hard to measure what those gains amount to, but some experts have noted that the return on investment is reasonable. The smaller the company, the more difficult EVM is to implement because upfront costs may be prohibitive with their need to maintain adequate cash flow to manage the business.
  • Another perspective is that although an EVM system is expensive to implement, not having one may cost an organization future work because of the inability to compete with others that have a system in place.’The cost of not getting potential business is also expensive. Balancing must be done to implement what is required in a manner that is sensitive to the corporate bottom line, taking into account the long-term effects and consequences of the implementation decision.
  1. EVM is not useful for short-term, small-dollar projects.
  • A certain amount of judgment must be applied to determine the viability and utility of a full-blown EVM system for short-term or small-dollar projects. Because typical EVM reporting is monthly, a program of 6 months or less cannot use trends (at least three data points) effectively; it would be half way completed before any trending could be adequately used, and then corrective action would take another data point or two to realize. Weekly reporting would impose significantly higher resource demands and costs that might not be acceptable for small-dollar contracts.
  • Even on shorter, less costly projects, a well-structured, planned, and executed program is desirable. In some cases, for every large and high visibility program there are 10 to 20 small programs. Failure of these small programs to execute on time or within costs is as unacceptable as on large projects even though the relative impact is smaller. Several small programs can add up to a substantial loss of money and can result in the loss of larger projects or future awards if a pattern of overruns is evident.
  • EVM can be tailored and ingrained into the culture to ensure that program cost and schedule goals are met for smaller or shorter projects; smaller projects will benefit from having the work scope defined by a WBS and having a detailed plan and schedule for accomplishing the work. Small-dollar projects still need to have a baseline in place to manage changes and variances and risk management plans to address issues.
  • On the corporate side, losing money is not an acceptable option, even if the program’s visibility is lower. Poor performance on a smaller program can damage a company’s reputation just as much as poor performance on a large, highly visible program. Although a full EVM system is not required for small, short-term projects, the need to apply the fundamentals of EVM may still pertain. EVM is a good, practical program management tool.
  1. EVM practices go above and beyond basic program management practices.
  • Our experts noted program managers who claim that they have been successfully managing their projects for years without EVM. Yet, when pressed to say how they ensure that cost and schedule goals are met, and how they manage their baselines along with changes, they inevitably resort to EVM by other means.
  • The biggest difference for successful program managers is the formality and rigor of EVM. Our experts noted that program managers who do not use a formal EVM system generally do so because they are not required to. Those who are forced to use formal EVM practices often do so grudgingly but warm up to it over time. Those who have been using formal EVM for years often do not know how they got by without it in the past.
  • A second difference between formal EVM practices and basic program management practices is the uniformity of data and formatting of information that makes it possible to draw comparisons against other like projects. Successful program managers who do not use a formal EVM system invariably have their ‘own system’ that works for them and does much of the same things as a formal system. Unfortunately, it is difficult to compare their systems to other projects, to do analysis, or to validate the data for good decision making. How much management visibility these systems have for timely decision making is debatable. In many companies, this would hinder the company with respect to problem identification and corrective actions, and limit management and executive visibility into projects.
  • The rigor and discipline of a formal EVM system can ensure a certain continuity and consistency that are useful, notwithstanding the availability and turnover of knowledgeable personnel. When staff leave the job for an extended time, the structure of the system makes it possible for another person to take over for those who left. The new staff may not have the personal knowledge of the specific program, schedule, or EVM data, but understand enough about EVM to know how to interpret the data and evaluate the processes (planning, budgeting, executing, controlling, change control) because of this disciplined structure.
  • EVM practices go beyond the basics and have greater rigor and formality. This ensures uniform practices that are auditable (or verifiable) and consistent with other entities for relative comparison and benchmarking. Without this formality, it would be much more difficult to draw industry standard benchmarks and comparisons for improvement and guidance.
  1. EVM is merely a government reporting requirement.
  • One benefit of a formal EVM system in government reporting is that the end-product occurs after organizing, planning, authorizing, executing, change management, analysis, and controlling are completed. The reports give management as well as government a view into the health of a program to make sure taxpayer money is being used judiciously.
  • While it makes for program visibility for the government, it is primarily intended as a systematic approach to help manage a program. Reports are only as good as the data and the processes that support them; EVM serves more as a set of mandated government program management tools with reporting as a by-product.
  1. Reports are a key product of EVM.
  • It would be short sighted to focus on reporting without recognizing the need for other subsets of an EVM system to provide reliable and auditable data. What comes out is a byproduct of what goes in and how well it is maintained.
  • EVM reporting is intended to provide reliable information for timely decision making to maximize the probability of successfully executing a program. It is a program management ‘process tool set’ that helps ensure that proven management techniques are used to run projects.
  • Where EVM is institutionalized, management uses reports to identify significant variances and drill down into areas of exception (management by exception) for corrective actions and decision making. When EVM is ingrained, reports are anticipated and discussed by senior management.
  1. EVM is a financial management tool.
  • EVM is best viewed as an enhancement to traditional financial management. EVM requirements came about largely to reduce the high percentage of cost and schedule overruns that ended up delivering to the government a product that was technically inferior.
  • EVM enhances the traditional financial management tool by adding visibility of actual performance for budgeted tasks. This dimension of information coupled with the traditional planned budget versus actual costs allows for better forecasting of final costs, as well as early warning of performance variances for timely decision making and corrective actions.
  • Because EVM is a more accurate mechanism for predicting costs than the traditional financial models, it is more reliable for determining funding requirements and use.
  1. EVM data are backward looking and too old to be useful.
  • Some metrics produced by an EVM system are backward looking and show performance to date, both cumulative and by period. They can help identify past trends that can be used to predict costs and schedule performance, along with the final cost of a program.
  • Presenting standard graphics is a best practice for reporting EVM trends and status to senior management.
  • Using EVM, management has the ability to make timely decisions and adjustments as needed to affect the final outcome of a program.
  1. Variances EVM reveals are bad and should always be avoided.
  • Variances are expected because programs rarely perform exactly to plan. Variances are neither good nor bad but simply a measure of how much actual performance has varied from the plan.
  • Variance thresholds quantify an acceptable range of deviation. Variances that exceed a threshold are worthy of further inspection to determine the best course of action to minimize any negative impacts to cost and schedule objectives.
  • Variances can indicate one or more of the following: how well the program was planned, how well changes to the baseline plan are being implemented, how much planned and unplanned change has occurred since inception, and how well the program is being executed.
  1. No one cares about EVM data.
  • If line managers and the program manager ignore EVM data, they may not achieve cost and schedule goals. EVM data help them make the necessary midcourse adjustments based on timely and accurate program status data.
  1. EVM does not help with managing a program.
  • As noted in the previous nine items’especially 3, 7, 8, and 9’when managing a program, it is important to identify and manage resources to ensure that over- or under-allocations do not exist. EVM helps identify these conditions.
  • It helps identify and manage program risks and funding requirements to ensure that funding shortfalls do not surprise the program manager.
  1. My program is using Agile software development and we do not need EVM to manage the program.
  • Agile development emphasizes working software over detailed documentation, but a program still needs to develop data to report program status and performance metrics.
  • Many software-intensive programs also have other elements, such as hardware and program support, which also need to be tracked with performance metrics and should be managed with EVM.
Source: GAO. | GAO-20-195G

To overcome some of these obstacles and have an effective EVM system, strong leadership from the top is necessary to create a shared vision of success that brings together areas often stove-piped by organizational boundaries. Senior management should set an expectation that reliable and high-quality data are key to managing a successful program. Senior management should also show an active interest in program status so that their staff knows that they are accountable and that results matter. Accordingly, stakeholders need to take an interest in and empower those doing the work, and ensure that corporate practices are in place that allow them to accurately gauge how a program is doing. Leadership must require information sharing in an open, honest, and timely fashion so it can provide resources and expertise immediately when problems begin to arise.

Additionally, agencies should set forth policies that clearly define and require disciplined program management practices for EVM planning and execution. The focus should be on integrating cost, schedule, and technical performance data so that objective program progress can be measured and deviations from the baseline acted upon quickly. Moreover, the policies should also address the importance of continuous training in cost estimating, EVM, scheduling, and risk and uncertainty analysis that will provide the organization with high-performing and accountable people who are experienced in these essential disciplines. Training should be provided and enforced for all program personnel needing such training, not just those with program management responsibilities. Program managers and staff need to be able to interpret and validate EVM data to effectively manage deliverables, costs, and schedules. In addition, oversight personnel and decision-makers need to understand EVM terms and analysis products in order to ask the right questions, obtain performance views into the program, and make sound investment decisions.