Your cart is currently empty!
Timothy R. Brock, CPT, PhD
This article was originally published in Performance Improvement, vol. 58, no. 10, November/December 2019.
Has human performance technology (HPT) strayed from its charter or stayed true to it? This three-part article will offer an argument that we have and offer a map to navigate back to our founding charter. This first article will review the HPT charter that Gilbert established for our profession to establish a shared understanding of our charter and review Gilbertโs eclectic-paradox warning and why it matters. This article sets the stage for the two articles that will follow.
Roger Kaufman wrote a short, thought-provoking article entitled โHPT and PI at the Crossroadsโ (2019). He made two points. One was that everybody seems to be jumping on the performance improvement bandwagon to help people work faster, cheaper, and better. The danger, Kaufman asserts, is a focus on individuals doing their jobs right rather than on doing the right jobs. To illustrate this point, Kaufman reminds us that the crew of the Titanic was doing a superb job of arranging deck chairs while the ship sailed into iceberg-infested waters. This leads to Kaufmanโs second point. Everyone jumping on the human performance technology (HPT) bandwagon is focusing on how to improve individual performance (i.e., moving deck chairs with great skill). This is not enough. They must also align what people do with why they are doing it as part of the larger system (i.e., moving deck chairs and safe transatlantic passage). The crossroads, Kaufman argues, is the necessity to ensure that true HPT aligns the what with the why.
How is HPT doing as a profession standing at this crossroads? Is it more focused on arranging deck chairs than navigating safely to a defined destination? What is the why for what HPT practitioners are supposed to do? The HPT profession claims it is driven by principles and not models. The International Society for Performance Improvement (ISPI) website states that HPT is about its 10 Standards ofย Performance Improvement (2018) and not one model or one solution (e.g., training). The why is defined by ISPIโs first and last standards. The first standard is to focus on results or outcomes, and the last standard is to evaluate whether the intervention has achieved those results and impact. Results and impact are organizational (or system) why standards. Although these two standards are clear and clearly linked, it seems HPT practitioners are falling prey to the deck-chair syndrome.
To answer this larger why question from Kaufman, a short refresher about the why of the HPT professionโs conception is appropriate. It seems that the original why for the HPT profession was defined by Thomas Gilbert as โto engineer worthy performance.โ
GILBERTโS ENGINEERING WORTHY PERFORMANCE
The genesis of the HPT profession began in the mind of Thomas Gilbert when his book titled Human Competence: Engineering Worthy Performance was published in 1978 (as well as a tribute edition published in 1996.) For those who are new to the HPT/performance improvement (PI) profession or unaware of who Gilbert is, Gilbert is considered the father of our profession, or at least one of the earliest pioneers of our performance improvement profession
(Van Tiem, Moseley, & Dessinger, 2012). What Gilbert wrote 40 years ago remains relevant today. Our professionโs genealogy begins with Thomas Gilbert and other genetic contributors including Skinner, Markle, Rummler, Kaufman, and others (Van Tiem et al., 2012).
Gilbertโs book title directly links human competence (the what) to engineering worthy performance (the why). Yet, Gilbertโs name is usually first associated with his behavior engineering model (BEM). The BEM is a means to an end that includes both human behavior and organizational support (or the system). Both are about the what. Rarely does โengineering worthy performanceโ enter the conversation except as a reference to Gilbertโs book title. I found one source that, in classifying the work of early performance improvement leaders, used โwor- thy performanceโ to classify Gilbertโs work (Van Tiem et al., 2012). Gilbert is much more than his BEM. He answers the why question before introducing the BEM what.
WHAT IS THE FUNDAMENTAL PURPOSE OF PERFORMANCE ENGINEERING?
Have we strayed from our why? Is our profession heading toward a Titanic end where what we do is no different from what others do to improve human performance? Yet, asking or starting with the why question is not unique to the HPT profession. What makes HPT relevant? The aim of performance engineering is โa fundamentally economic purposeโ (Gilbert, 1996, p. 11). Stolovitch and Keeps (2006) assert that โHPT is bottomline and measurement conscious, imbuing it with ongoing relevanceโ (p. xvi). They also wrote that Gilbert often stated that HPTโs central focus is โvalued accomplishment, meaning verifiable results that far exceed their costsโ (p. xvi). Swanson echoes this sentiment by stating that โunless performance improvement expenditures contribute to the viability and profitability of an organization, those expenditures will almost certainly be cut back or eliminatedโ (2007, p. 17).
Why is HPT Principles-Driven?
Gilbert (1996) was committed to principles-driven practices derived from science. Being principles-driven remains important for us today. ISPIโs first four standards for performance improvement are the foundational, results-focused principles of practice for everything we do. Principles help guide HPT practices to address the why question.
Definitions of Principles, Standards, and Code of Ethics
First, it is important to establish a shared meaning of three common HPT terms used by practically every HPT authorโprinciples, standards, and code of ethics. Too many authors and practitioners make the false assumption of shared meaning.
In the Handbook of Human Performance Technology, a foundational publication of the HPTโs professional society, ISPI, Mueller states that the HPT practitionerโs work is โfirmly grounded in a set of fundamental principles and a code of ethicsโ (2006, p. 1). In 2002, ISPI crafted and codified four fundamental principles and six process phases into the 10 Standards of Performance Improvement.
These 10 standards are the foundation of HPT as it is practiced today. These standards also establish the criterion to earn the competency-based CPT credential. The four fundamental principles and code of ethics guide how competent HPT practitioners apply the systematic process standards and their underlying practices to achieve performance results (Hale, 2007). These standards must also remain current to reflect the current, real-world practice of competent HPT practitioners to remain relevant. There- fore, ISPI revised these 10 standards in 2013 and should do so again in 2023.
How Do Principles Help the HPT Profession?
Pershing (2006) states that HPT is eclectic whereas Brethower (2008) uses the term interdisciplinary because what the HPT practitioner does crosses over into manyย other disciplines. Because we are so eclectic and interdisciplinary, we cannot take a one-size-fits-all approach with one model or theory. Our profession realized long ago the necessity for having standards to bring stability to what we do (Barnum, 1980). They help prevent our profession from becoming what Gilbert called โa messy jumble of eclectic ideasโ (2006, p. xxxiii). ISPI established the 10 standards for serious HPT practitioners based on proven, repeatable work that distinguishes them from individuals who follow the latest fads and canards.
We must have aligned principles to drive what we do and how we do it to satisfy the why we are doing it. These principles must also spring from roots grounded in science, as advocated by Gilbert (1996), to establish an evidence-based foundation. Being principles driven means there is no one right way to apply our practices and tools. Theories and models percolating from HPT practitioners as they create their own ways to apply the 10 standards are numerous, situational, adaptable, and helpful. Pershing (2006) argues that HPT practitioners are adding eclectic and interdisciplinary theories and models that they create or adapt from other fields (e.g., organization development, human resources, change management, Six Sigma, instructional design, and technology, lean manufacturing, etc.) that require HPT practitioners to partner with these professionals and integrate their discipline within our 10 standards.
Principles ChallengesโThe Pershing Paradox
This can be an overwhelming challenge to someโactually, more than some. The challenge is due to something I call the Pershing Paradox. Pershing stated that, on the one hand, โdrawing upon the principles and theories of numerous academic disciplines and other fields contributes to a lack of clarity for HPTโ (2006, p. 29). On the other hand, Pershing (2006) asserts there is a benefit of having an eclectic and interdisciplinary profession. It allows HPT practitioners to apply their 10 standards through the lens of other disciplinary perspectives to learn from them and expand the HPT professionโs capabilities. How can the HPT practitioner assimilate new and helpful principles and practices without adding to this lack of HPT clarity? A better question is How can we integrate new perspectives that can improve both our HPT clarity and our worthy performance potential?
This paradoxical dilemma of trying to manipulate a multitude of possible permutations to create a clarity of perspective is often missed by students learning HPT and struggling HPT practitioners who are not familiar with the HPT literature. Even worse, too many times it is not uncommon to witness emerging HPT practitioners and seasoned practitioners who should know better (the latter based on research by Leigh, 2014) as they try to force a favorite or familiar โroundโ model or theory into a โsquareโ situation that lets them crank out a comfortable, business-as-usual solution without much thought or reflection about evidence suggesting otherwise.
Many HPT practitioners excel with one phase of the six process phases of HPT. Unfortunately, they are hit-and-miss with the four foundational principles that influence how to apply these six process phases. Brethower (2008) correctly asserts that projects that do not include all four principle standards are not HPT projects. HPT practitioners may limit their work scope to one or more of the systematic process standards, but the four foundational principle standards are not negotiable. Why is that? To answer this, we must look at the 10 Standards of Performance Improvement.
ISPIโS 10 STANDARDS OF PERFORMANCE IMPROVEMENT
Table 1 lists ISPIโs 10 Standards of Performance Improvement used by HPT practitioners and certified performance technologists (CPTs) around the world (International Society for Performance Improvement,ย 2018). As already noted, the first four principle standards influence the six systematic process standards. (For those unfamiliar with, or who would benefit from a refresher of these 10 standards, the following URL provides a detailed description of each standard and the Code of Ethics: ispi.org/ISPI/Get_Certified/CPT_Certification/CPT_Standards/ISPI/Credentials/CPT_
Certification/CPT_Standards.aspx.)
GILBERTโS THREE-EDGED RULER PRINCIPLES
Even more, these 10 ISPI standards are rooted in three fundamental operating principles from science that Gilbert called a three-edged rulerโparsimony, elegance, and utility (Gilbert, 1996). Dean (1996) wrote that Gilbert would always explain these three principles before talking about his work. Gilbert (1996) does the same in the first three pages of his book. Table 2 lists these three-edged ruler principles and what Gilbert meant by each one.
Therefore, HPT practitioners should always begin by ensuring their work is based on performance improvement principles and process standards that measure up to Gilbertโs three-edged ruler principles to engineer worthy performance. ISPIโs response is its 10 HPT standards.
Why are these principles-driven standards critical to our success? The โshould-beโ state of the HPT profession requires a situational approach, whereby the HPT practitioner is guided by the four-principles standards and the code of ethics to address a multitude of proven practices across a full spectrum of disciplines as the evidence dictates. Then again, HPT cannot be all things to all people. That is why there is a standard principle to address this (i.e., partnering). Maybe the HPT profession should โstick to the knittingโ of what makes it unique (Peters & Waterman, 1982). This brings us back to the earlier question about what makes us relevant and unique. It is why we do what we doโengineer worthy performance.
WHAT IS ENGINEERING WORTHY PERFORMANCE?
Because Gilbert coined this phrase in his book to define our profession, letโs review what he meant by each term.
Definitions of Engineering, Performance, and Worthy Engineering
Engineering methods are the opposite of scientific methods. Engineers use whatever methodology will get them precisely to where they want to get to. They start with an end in mind and focus on results. Scientists, however, follow their methodology to wherever it leads (at least they are supposed to do it this way). The methods that engineers adopt to improve engineering results come from the โnew knowledge that science creates and by arranging existing knowledge into simpler and more powerful systemsโ (Gilbert, 1996, p. 4). Therefore, engineering is a logical and pragmatic extension of science and applies Gilbertโs three-edged ruler principles. This is a reason we assert that HPT is rooted in science, to equip us to engineer worthy performance. However, we are not โscience-based,โ as some suggest.
Performance
Gilbert (1996) described performance as the consequence of improved human behavior. We want to engineer valuable performance that is a consequence of behavior. Behavior is an integral part of the performance. Behavior is a means to arrive at performance. How do we decide which behavior to change? Gilbert stated that we should not change behavior unless someone places a value on the consequences of that behavior. Performance is possible without value, but it is wasted effort. Gilbert even created what he called a shortcut to represent this relationship. The shortcut is represented by an equation where performance (P) is what you get when a behavior (B) leads to a consequence (C), or P = B โ C. Gilbert later changed consequence to accomplishment (A), or P = B โ A.
Accomplishments as units of measure
Gilbert preferred to use the term accomplishment for the consequence of changed behavior because this term is associated with value. Gilbert (2006) believed outputs or results are not necessarily associated with value because they can be irrelevant or undesired or worse. To engineer performance, we must have โquantifiable measures of performance, not of behaviorโ (Gilbert, 1996, p. 70). What do performance measures look like? Table 3 lists the three accomplishment-measurement categories that Gilbert identified. Gilbertโs measures are similar to the accomplishment measures defined by analysis, measurement, and evaluation experts, who refer to them as units of performance, business impact measures, or key performance indicators. These are the organizational measures we want to engineer human performance to improve.
It is important to remember that performance is not behavior. Similarly, โperformance is not system design, capability, motivation, competence, or expertise,โ which are considered performance variables (Swanson, 2007, p. 27). A stakeholder must attach value to a performance accomplishment (Addison, Haig, & Kearney, 2009; Gilbert, 1996; Pershing, 2006; Stolovitch & Keeps, 2016; Swanson, 2007). Gilbert was clear on this when he wrote, โWhen we set about to engineer performance, we should view it in a context of valueโ (1996, p. 17). Stakeholders routinely ask, โso what?โ when you have changed workplace behaviors. They want to see an improved accomplishment measure that they value. Addison, Haig, and Kearny (2009) speak to this when they define performance as โactivity plus results plus value.โ An HPT task force added, โpeople working within a systemโ as another variable to the performance definition (Pershing, 2006, p. 38). However, if people are working within a system to achieve a result, but the result is not valued, then so what? As Gilbert (1996) originally stated, HPT is about engineering valuable performance. After all, if no one values the accomplishment, why are we spending money for it? As Swanson puts it, โPerformance improvement cannot occur in a vacuumโ (2007, p. 81).
Worthy
Gilbert goes one step further than engineering valuable performance. That next step is to engineer worthy performance where the value of the performance result achieved exceeds the cost of improving the antecedent behavior (Gilbert, 1996). The higher the value when compared to the cost, the higher the worth. Gilbert (1996) stated that those who are competent create value greater than the cost of their behavior (ergo, the title of his book, Humanย Competence: Engineering Worthy Performance). In other words, competent people are known by their valuable and worthy performance. Therefore, competent performance improvement programs, projects, and initiatives are known by their valuable (i.e., improved units of performance or business measures) and worthy (aka benefit-cost ratio (BCR) or return-on-investment (ROI) results that are the consequence (or accomplishment) of improved human competence.
In addition, when comparing a scientist to an engineer,ย Gilbert stated a second key difference. An engineer โsees knowledge as a costly means that should be applied efficiently, if the costs are not to distract from the valuable endsโ (1996, p. 4). Gilbert was clear to include costs as an engineering variable when something is being improved because efficiency is as important as effectiveness. Gilbert was clear about why he chose the term engineering when he wrote that โengineering is always a system to manipulate thingsโ (1996, p. 7). What we manipulate (or influence) is human behavior.
Gilbert was concerned about both the costs and the benefits of performance-engineering efforts. The costs represent how efficient the HPT practitioner was in engineering a valuable accomplishment. The benefits represent how effective the HPT practitioner was in engineering a valuable accomplishment. To be clear, for those who approve and fund performance improvement initiatives, โvalue equals moneyโ (Phillips & Phillips, 2018, p. 217.) More about that appears further along.
Telenomics, the Forgotten Termย
Gilbert even coined a term, telenomics, to cement the case that his focus included both effectiveness and efficiency. The term combines two Greek words that mean the โlawsโ (nomos) of โendsโ (teleos)โ (Gilbert, 1996, p. 10). Telenomics represents Gilbertโs performance engineering system that involves three phases studying, measuring, and engineering human competenceโ (1996, p. 10).
Gilbert argues that a purpose of engineering systems is economic (see Table 4) where worth is fundamentally the ratio of the effectiveness (accomplishments) and efficiency (costs) of the engineered performance (1996, p. 106).
Worthy Performance Formula
To calculate this effectiveness/efficiency ratio, Gilbert created a formula (see Figure 1) in which the numerator is the effectiveness value (i.e., accomplishments or results) and the denominator is the cost (i.e., of the behavior). It defines human competence as a function of worthy performance and implies that worthy performance is a function of the value of the accomplishments divided by the cost of the behavior. The numerator is the accomplishment value (how effective the performance engineering effort was to create valued accomplishments). The denominator is the cost of the changed behavior (how efficient the performance engineering effort was to deliver valued accomplishments) (Gilbert, 1996; Phillips & Phillips, 2018). This is simple math. Getting the cost numbers and monetizing the numerator are the challenges.
What Do These Definitions Tell Us?
Based on these three definitions (engineering, performance, and worthy), it seems that Gilbert argued that improved performance resulting from changed human behavior must deliver value beyond the resulting accomplishments. The value must also exceed the cost of achieving the resulting accomplishment to be considered wor- thy. This is the HPT practitionerโs true-north compass heading that helps navigate safe passage to the destination defined at ISPI standards 1 and 6โvalued and worthy performance.
How does the HPT profession stay aligned to Gilbertโs true north to focus on engineering worthy performance as Gilbert defined it? Even more, has the HPT profession stayed on course, or has it drifted away from the worthy standard Gilbert established as foundational to the purpose of HPT? In his tribute to Gilbert, Dean (1996) argues that a lot of Gilbertโs work has been eclipsed by the passing of time from the more recent work of others whoย use Gilbertโs work as the starting point for their ownย ย (p. 10).
Hasย Gilbertโs work been eclipsed and, if so, is that a positive? A good starting source for an answer is the Handbook of Human Performance Technology: Principles, Practices, Potential (aka the HPT Handbook) that was published by ISPI.
When Gilbert wrote the Foreword to the first edition of the HPT Handbook, he emphasized the technology element of the term HPT. He stated that technology โis a system that applies the best techniques and sciences to a subject matterโ and that โscience is at the base of technologyโ (2006, p. xxxiii). Gilbert then discussed five characteristics of science that are foundational for our profession to claim that our engineering (aka HPT) standards are rooted in science (2006, p. xxxiv). They are summarized in Table 4. (Note: In the first edition of the book, Gilbertโs original Foreword included two characteristics of science that were not included in the second and third editions. Those two characteristics were โScience Depends on Observation, Not Hearsayโ and โScience Is Guided by Evidence.โ These two characteristics were not included in Table 4 to reflect Gilbertโs revised list of characteristics.)
Interestingly, Gilbert included economic measures to monetize quantity, quality, and cost (QQC) variation measures that we first saw in Table 3. In this context, a performance variation is a difference between the baseline and post-intervention QQC measures (i.e., accomplishments). The economic measures include the costs associated with changing human behavior to produce valued accomplishments. These three measurement characteristics include the variables of the worthy performance calculation (i.e., QQC business benefits that are the consequence of improved human behavior and the costs to achieve them).
How important was this to Gilbert? A book title is carefully crafted to represent the thesis of the entire book. In other words, if you were asked to summarize a book in a few words, what would you say? Why not start with the book title? Why did Gilbert write his book? He wrote it to explain his system to engineer improved human competence and worthy performance. Gilbert goes on to write: โThe system this book describes is based on three theorems summarizing my major assumptions about the nature of human competenceโ (1996, p. 15).
GILBERTโS THEOREMS OF ENGINEERING WORTHY PERFORMANCE
It is common to read that Gilbert had three theorems.ย ย ย It seems he had one core theorem and three corollary theorems.
Core Theorem: Human Competence Is a Function of Worthy Performance
Gilbert (1996) stated that his core theorem was critical because it accomplishes two things. First, it defines worthy performance and human competence. Second, it makes the case that it is important to distinguish between behaviors and accomplishments. Gilbert was clear when he wrote that โcompetent people are those who can create valuable results without using excessively costly behaviorโ (1996, p.17). His first theorem defines human competence as โa function of worthy performanceโ (1996, p. 18). Gilbert expressed this theorem as a formula (see Figure 1). Gilbert argued that this theorem โis the key toa system of engineering human performanceโ (1996, p. 18) and that his other three theorems come from this one. This first theorem has three economic corollary theorems to produce meaningful performance measures.
First Economic Corollary: Worth Reflects the Ratio Between Accomplishment, Value, and Costs
The first economic corollary focuses on worthy performance by asserting there is a difference between measures of accomplishment and measures of behavior. Only accomplishment measures โcan be converted into a dollar returnโ (Gilbert, 1996, p. 22) and have direct value. People invest in getting accomplishments. Behavior change costs money. Worth reflects the ratio between the expected cost of the investment to improve an accomplishment (value) and the cost of the changed behavior required to achieve those accomplishments. A positive BCR is when the ratio between the accomplishment value (i.e., benefit) and behavior costs exceeds 1.
Second Economic Corollary: Measuring Accomplishments Precedes Measuring Behaviors
Gilbertโs second economic corollary (aka measurement theorem) is about the potential to improve performance. Gilbert states, โWe have no need to measure behavior until we have measured accomplishmentโ (1996, p. 23). This measurement theorem establishes the foundation for engineering worthy performance. Before we consider the cost of an investment to improve behavior, we must first consider the potential value of the return on the accomplishment measure. This is where Gilbert talks about his potential for performance (PIP), which is an opportunity measure that establishes the criterion for valued performance. Engineering worthy performance begins with determining the opportunity potential from improving accomplishments of typical performance to the
performance of exemplars (if exemplars exist). Gilbert defined exemplary performance as โthe most sustained worthy performance that we can reasonably expect to attainโ (1996, p. 45). The greater the difference between typical and exemplar performance, the greater the PIP. It determines the current level of performance and the potential opportunity for improvement.
Gilbert distinguishes PIP as a measure of human potential against an IQ test. The IQ test focuses on behaviors and views of those with the highest scores as having the greatest potential. PIP, however, focuses on performance and views the greatest potential to those with the lowest scores. PIP does something about this potential where the IQ test does nothing. Gilbert makes a compelling statement that he takes a humanistic view that โsees people for what they can do, and not for their limitationsโ so they can โimprove their conditionโ (1996, p. 70). Gilbert states that the worthy performance used as accomplishment measures involve โquality, quantity (or productivity), and costโ (1996, p. 45) (see Table 3). What is missing is the economic value of this potential to improve performance. To do this, Gilbert argues we must translate this potential performance measure into what he calls โstakesโ where โstakes are the money value of realizing the PIPโ (1996, p. 32).
Third Economic Corollary: Valued Performance Is a Result of Behavior and Environment
The third economic corollary, which introduces his behavior engineering model, has two parts. The first part asserts that when behavior measures are expressed as numbers (quantitative measures), they are often misleading indices of performance. There are special circumstances where this is not true, but they are the exception, not the norm. Gilbert makes the point that most test scores are misleading measures of behavior unless they are linked to accomplishment measures that occur in the workplace. A linear correlation using test scores and workplace performance measures does that. It also allows us to forecast an estimated BCR or ROI (i.e., worthy performance).
The second part states, โIt is frequently useful to quantify measures of accomplishment, and these measures should have economic correlativesโ (Gilbert, 1996, p. 24). Gilbertโs point is that there are many behaviors that contribute to failed or improved performance, but only some matter or make a difference. Rather than compile a list of behaviors to change, focus on the ones that someone says have value because they matter. As Gilbert put it, โMeasures of accomplishment have no real validity until they reflect value to someone, and the dollar currency is one excellent way to express this valueโ (1996, p. 25). How do we know someone values something? When they are willing to pay for it and expect a positive return on their investment. It starts with value. We value the accomplishments of behavior, not the behavior. Behavior is one condition of performance. The second variable is environmental support. This is where Gilbertโs behavior engineering model enters the scene.ย It was developed as a diagnostic tool to โorder our thinking about how we can alter performance through changes in behaviorโ (Gilbert, 1996, p.83). Three are environmental (information, instrumentation, and motivation), and three are behavioral (knowledge, capacity, and motives). The model does not tell us how to engineer worthy performance.
Gilbert expressed his behavior engineering model as an economical equation where worthy performance equals value (accomplishments) divided by costs. These costs include the cost for the improved behavior plus environmental support costs and the costs for the management system. Despite these cost variables, Gilbertโs point from the beginning is that โa small investment in behavior can yield great returns in accomplishmentโ (1996, p. 88).
Why Did Gilbert Use the Term Leisurely Theorems?
Gilbert referred to his theorems as โleisurely theorems.โ Gilbert explains that the term leisure is from a historical French word meaning permission, as in when people have permission to break away from mundane work, freeing them to get other things done in the same amount of time. Leisure represents the opportunity to get more done before it is too late. Who does not value the time and opportunity to get more done? The product of leisure is time and opportunity.
Gilbert helps us understand what he means when he writes, โOpportunities with time to pursue them mean nothing. And time, dead in our hands, affording no opportunities, has even less valueโ (1996, p. 11). Gilbert asserts that leisure is โthe worthy aim of a system of performance engineering, and the one I consider to be its true purposeโ (1996, p. 11). Put in different words that emphasize the main title of his book, โThe very purpose of competent human performance, then, is leisure itself โ (Gilbert, 1996, p. 26). We can consider worthy performance as improving leisure, where opportunity is defined as desired accomplishments involving hard or soft business measures. Because the meaning of the term leisure has come to mean something different than time and opportunity, Gilbert uses the term human capital to mean the product of time and opportunity. As Gilbert puts it, โThe beginning pointย of performance engineering is, therefore, human potential; its endpoint is the increase of human capitalโ (1996, p. 12). Increasing human capital, then, is the purpose of performance engineering and its starting point.
Why is this important? Gilbert states that, if we view performance engineering using a teleonomic perspective, โall values are derived from the ultimate worth inherent in human capitalโ (1996, p. 313). Human capital, therefore, is about valued and worthy organizational results (Gilbert, 1996; Phillips & Phillips, 2015). If you do not know what Gilbert means by human capital, you cannot understand his meaning for value or the context of his three leisurely theorems. If you do not know or understand how Gilbert defines human capital, you cannot know or understand what he means by engineering worthy performance. It is a human-centric perspective. It is about the economics of increasing leisure results (accomplishments) that add value to the business while simultaneously minimizing the costs (money) to increase the more productive leisure time and opportunity (Gilbert, 1996).
STATE OF THE HPT PROFESSION
Between the 14 years since Gilbert first published his Humanย Competence book in 1978 and when he wrote the Foreword for the first HPT Handbook in 1992, he made sure to include measurement as a foundational principle that included economic measures required to calculate worthy performance. Did Gilbertโs worthy performance cornerstone stand the test of time when the third edition of the HPT Handbook was published in 2006, another 14 years later?
The Foreword to the third edition, written by Stolovitch and Keeps, who were the editors of the first two HPT Handbook editions, states that HPT โis a professional field of study and application, the purpose of which is to engineer systems that allow people and organizations to perform in ways that they and all stakeholders valueโ (2016,ย p. xiii). This definition of HPT includes the terms engineer, perform, and value (p. xiii). A term not included is worthy. Yet, the first two of the six reasons they list in explaining why they conclude that HPT is a valuable, wor- thy, and enduring practice rather than a fad is because of HPTโs โconcern with bottom-line results and Return on Investment (ROI) issuesโ and โthe high stakes of high investmentsโ (Stolovitch & Keeps, 2016, p. xvi). The term investment is important because it implies a positive return. Otherwise, it is a cost. Investments imply a return. Everyone wants their 401(k) to be an investment rather than a cost. HPT practitioners must pay as much attention to the costs of changing behavior as they do their valuedย accomplishments to remain relevant (Stolovitch & Keeps, 2016).
To summarize, using Gilbertโs definitions, especially his human competence/worthy performance equation, โIf human competence resides in behavior, then to set about to engineer human competence means that we must manipulate human behavior since engineering is always a system of manipulating thingsโ (Gilbert, 1996, p. 7). Why do we manipulate behaviors? To achieve worthy performance. That is our ultimate challenge.
Back to the Pershing Paradox
Two comments by Pershing mentioned previously indicate that Pershing framed this challenge (either intentionally or unintentionally) as a paradox. This paradox is a consequence of adding the principles, theories, and practices of other disciplines and fields. Pershing (2006) asserts that we have become an eclectic, elastic profession. How- ever, we risk losing the clarity of why we existโto engineer worthy performance.
Even more, the elasticity of this eclectic profession continues to grow as it continues to partner with established and emerging professions and disciplines (e.g., organizational development, human resources, instructional design, lean manufacturing, Six Sigma, etc.) that are also focused on delivering solutions to improve human and organizational performance (Pershing, 2006, p. 29.) The risk to this path is that HPT may become a hodgepodge profession trying to be all things to all people to gain acceptance as a real profession. Instead, HPT practitioners should advocate what makes the profession unique in order to attract like-minded professionals from other disciplines to integrate the HPT standards into their own because HPT offers something missing from their performance improvement frameworks. It is not about arranging deck chairs.
CONCLUSION
Now is an excellent time to reconsider Gilbertโs admonition on this subject: โAlthough eclectic systems may sometimes be useful, they seldom have the simplicity and never the elegance that I have held as criteria for success. โฆ But eclectic systems do have one sensible quality that all who offer ideas might envy. They know there is more than one way to look at the worldโ (Gilbert, 1996, p. 5). Part 2 of this article will do this by exploring how the work of Gilbert and principles for design thinking from the field of innovation provide a different way to view a performance improvement need or opportunity and to do so with a renewed level of simplicity and elegance that enables a return to the state of clarity required to engineer worthy performance.
References
Addison, R., Haig, C., & Kearney, L. (2009). Performance architecture: The art and science of improving organizations. San Francisco, CA: Pfeiffer.
Barnum, T.M. (1980). Imperative: We must have standards!ย Performance Improvement, 19(2), 2.
Brethower, D.M. (2008). Historical background for HPT certification standard 2, take a systems view, part 1.ย Performance Improvement,ย 47(7), 7. 10.1002/pfi.183
Dean, P. (1996). Foreword. In Human competence: Engineering worthy performance (Tribute ed.). Silver Spring, MD: International Society for Performance Improvement.
Gilbert, T.F. (1996; 1978 Tribute ed.). Human competence: Engineering worthy performance. Silver Spring, MD: International Society for Performance Improvement.
Gilbert, T.F. (2006). Foreword. In J.A. Pershing (Ed.), Handbook of human performance technology: Principles, practices, potential (pp. xxxiโxxxv). San Francisco, CA: Pfeiffer.
Hale, J. (2007). The performance consultantโs fieldbook: Tools and techniques for improving organizations and people (2nd ed.). San Francisco, CA: Pfeiffer.
International Society for Performance Improvement. (2018). What is performance improvement?Retrieved from https:// www.ispi.org/ISPI/Our_Society/About_ISPI/Performance_ Improvement/ISPI/About_ISPI/What_is_Performance_ Improvement.aspx?hkey=dc6249a4-7449-48fd-a2d5-99583 a124580
Kaufman, R. (2019, March). HPT and PI at the crossroads.ย PerformanceXpress (ISPI newsletter).
Leigh, H.N. (2014). The road taken: A between and within subjects study of intervention by performance improvement professionals. DAI-A 76/04โฌ, Dissertation Abstracts International. ProQuest Dissertations & Theses Full Text, Ann Arbor.
Mueller, M. (2006). Foundations of human performance technology. In J.A. Pershing (Ed.), Handbook of human performance technology: Principles, practices, potential (3rd ed.). San Francisco, CA: Pfeiffer.
Pershing, J.A. (2006). Human performance technology fundamentals. In J.A. Pershing (Ed.), Handbook of human performance technology: Principles, practices, potential (3rd ed.). San Francisco, CA: Pfeiffer.
Peters, T.J., & Waterman, R.H., Jr. (1982). In search of excellence: Lessons from Americaโs best-run companies. New York, NY: Warner Books.
Phillips, P.P., & Phillips, J J. (2015). Making human capital analytics work: Measuring the ROI of human capital processes and outcomes. New York. NY: McGraw-Hill Education.
Phillips, J.J., & Phillips, P.P. (2016a). Handbook of training evaluation and measurement methods (4th ed.). New York, NY: Gulf Publishing Company.
Phillips, P.P., & Phillips, J.J. (2016b). Real world training evaluation: Navigating common constraints for exceptional results. Alexandria, VA: ATD Press.
Phillips, J.J., & Phillips, P.P. (2017). The business case for learning: Using design thinking to deliver business results and increase the investment in talent development. West Chester, PA, and Alexandria, VA: HRDQ and ATD.
Phillips, J.J. and Phillips, P.P. (2018). The value of innovation: knowing, proving, and showing the value of innovation and creativity. Hoboken, NJ, John Wiley & Sons.
Stolovitch, H.D., & Keeps, E.J. (2006). Foreword. In J.A. Pershing (Ed.), Handbook of human performance technology: Principles, practices, potential (3rd ed.). San Francisco, CA: Pfeiffer.
Swanson, R.A. (2007). Analysis for improving performance: Tools for diagnosing organizations and documenting workplace expertise (2nd ed.). San Francisco, CA: Berrett-Koehler.
Van Tiem, D.M., Moseley, J.L., & Dessinger, J.C. (2012). Fundamentals of performance improvement: Optimizing results through people, process, and organizations (3rd ed.). San Francisco, CA: Pfeiffer.
About the Author
TIMOTHY R. BROCK, CPT, PhD, CRP, is the director of consulting services for ROI Institute, Inc., the leading source of ROI competency building, implementation support, networking, and research. He helps organizations implement the ROI Methodology at more than 6,000 organizations in more than 60 countries. He serves on the results-based management faculty at the United Nations System Staff College (Turin, Italy)ย and the Training and Performance improvement faculty at Capella University (Minneapolis, Minnesota). He earned his PhD in Education from Capella University with a specialization in Training and Performance Improvement. His journal article, โPerformance Analytics: The Missing Big Data Link Between Learning Analytics and Business Analytics,โ appeared in the August 2017 (Volume 56, Issue 7) Performance Improvement Journal published by the International Society for Performance Improvement (ISPI). He may be reached at Tim@roiinstitute.net
Jennifer Wingate is the Communication and Research Manager at ROI Institute. Jennifer is skilled in managing all marketing and public relations campaigns and brand messaging. Before joining ROI Institute, she was a marketing professional working for companies like Encompass Health and Bradley Arant Boult Cummings for over fifteen years. She assisted Encompass Health with the national re-brand in 2019.
Jennifer is a University of Alabama in Birmingham graduate with a degree in communications management and mass communications. She enjoys spending time with her husband and puppies and hunting for antiques in her spare time.
Jennifer can be reached at jennifer@roiinstitute.net
Klaas Toes MSc, is President Global Business Development and Director, ROI Institute-Europe, and boasts over 30 years of hands-on experience in shaping human capital strategies, leadership, change, and sales for diverse businesses and governmental agencies. A prominent learning economist, Klaas emphasizes the importance of concrete data when determining business impact and ROI.
Klaas founded ROI Institute-Europe in 1998 enabling him to support the measurement and evaluation of tangible and financial values of learning for individuals and organizations. This venture was instrumental in laying the groundwork for people analytics in Europe.
By 2012, Klaas published De Waarde van Leren. As a well-respected voice in his domain, Klaas often shares insights via lectures and keynotes on various subjects including people analytics, business alignment, and ROI. In 2024 Klaas was co author of The Return On Investment for Training and Performance Improvement programs.
In 2016, Klaas’s expertise earned him a pivotal role as the European Council Director for People Analytics at The Conference Board, a position he held till 2021. He’s not just a thought leader but a successful entrepreneur in the fields of HR and Learning & Development, with his ventures impacting organizations on a global scale.
Andy Vance is Director of Client Relationships and IT Manager for ROI Institute. In his role asย Director of Client Relationships, Andy generates sales, implements marketing strategies, and maintains connections with clients and participants. In his IT Manager role, Andy maintains ROI Instituteโs technology infrastructure, produces virtual events, designing and updating webpages, and ensures online security.
Andy is a graduate of Phoenix Online University and has a Practical Project Manager certification. Andy also is a Glenwood Junior Board member a non profit dedicated to the support of adults and children with autism.
In his spare time, he enjoys hiking, camping, swimming, and building models.
Andy can be reached at andy@roiinstitute.net.
Hope Nicholas is the Director of Publications for ROI Institute.ย In this role she coordinates all publications, including books, articles, and case studies.ย Hope has significant experience with transcription, editing, proofreading, and project planning.ย Additionally, she contributes to multiple research and business development projects by facilitating communications and developing a wide variety of documents.
Hope is a graduate of the University of Akron and has over 15 years of experience working the field of healthcare administration and documentation. In her spare time, she enjoys painting, golfing, and playing tennis with friends and family.
Hope can be reached at hope@roiinstitute.net.
Tim Brock,ย Ph.D., a senior consultant at ROI Institute, facilitates ROI Certification and ROI workshops and provides ROI consulting services. Tim leads ROI Instituteโs weekly live virtual group coaching sessions that support individuals working toward earning the Certified ROI Professionalยฎ (CRP) credential. He is also an invited presenter at multiple international conferences and has also authored chapters on the ROI Methodology in several books.
Tim is a retired Air Force field grade officer, having served in both the enlisted and officer ranks, serving as a nuclear weapons maintenance crew chief and a missile combat crew commander for both the Titan II and Minuteman II intercontinental ballistic missile weapon systems. During his later career at Lockheed Martin, Tim led their science of learning and performance improvement team as a human performance system engineer and architect. He has experience in the education profession as a K-12 private school principal, a college director of education, and associate professor. Tim earned his Ph.D. from Capella University in education with a specialization in training and performance improvement.
Tim enjoys spending time with his three grown children and three young grandchildren. He and his wife enjoy taking extended cruises to relax, read, and see the world.
Caroline Hubble is Vice President of Consulting Services with ROI Institute. She manages the implementation of complex program evaluation projects, including conducting research and evaluation studies in various areas such as leadership development, process improvement strategies, and program implementation. In previous roles, she managed evaluation, analytics, reporting, and operations for business line and enterprise-wide HR departments. Her operational, project, and relationship management expertise is noted for significantly contributing to improved business practices.
Caroline holds a BA in Psychology from Rollins College and received her Masters of Science in Organizational Development in May 2013. Her publications include: ASTD Handbook of Measuring and Evaluating Training, Chapter 4: Using Surveys and Questionnaires. ASTD 2010; Measuring ROI in Learning & Development: Case Studies from Global Organizations, Chapter 4 (co-authored). ASTD 2012โ Offering Money for School Pays Off, (co-authored) Chief Learning Officer Magazine, June 2012.
When not focused on evaluation efforts, she enjoys spending time on her small farm in the mountains of North Carolina, raising Savannah and Egyptian Mau cats, following NASCAR, and capturing memories through photography.
Caroline can be reached at caroline@roiinstitute.net.
Melissa Brown is the Director of Partnerships at ROI Institute. She manages ROI Instituteโs network of more than 70 international partners and associates, as they implement the ROI Methodologyยฎ globally. Melissa also oversees marketing by coordinating and designing marketing campaigns, the layout and design of course materials, research projects, promotional collateral, and other communication resources. Melissa works alongside clients, partners, and associates to ensure quality results. Melissa is a Certified Digital Marketing Professional and American Marketing Association Professional Certified Marketer in Digital Marketing, and she also holds a Qualtrics Platform Essentials Certification.
Melissa earned a bachelorโs degree in Communication and Information Sciences from The University of Alabama and a masterโs degree in Communication from Walden University. She also holds a teaching license in secondary language arts. Melissa and her family enjoy traveling, watching and playing sports, and spending time outdoors.
Melissa can be reached at melissa@roiinstitute.net.
Kylie McLeod manages research, assessment, and communication at ROI Institute. She develops data collection instruments, collects, and analyzes data, writes final evaluation reports, manages research projects, coordinates the communication process, and directs the ROI Institute Awards Program. She also edits ROI Institute books and articles, develops promotional and marketing materials, and assists with the proposal creation process. She served as editor, production manager, and coordinator of the book, Value for Money: How to Show the Value for Money for All Types of Projects and Programs In Governments, Nongovernmental Organizations, Nonprofits, and Businesses (Wiley, 2020).
Kylie graduated with a Bachelor’s in Communication and Information Sciences from The University of Alabama in 2015 and a Master of Arts in Journalism from the same institution in 2017. Kylie holds CoreXM and CoreXM Expert certifications from Qualtrics and earned the Certified ROI Practitioner credential in November 2019.
In her free time, Kylie cheers on the Alabama Crimson Tide, enjoys the (mostly) sunny weather in Northwest Florida, and dotes on her dog, Penny.
Kylie can be reached at kylie@roiinstitute.net.
Kylie McLeod manages research, assessment, and communication at ROI Institute. She manages proposals, develops data collection instruments, collects, and analyzes data, writes final evaluation reports, and manages research projects. She has previously edited ROI Institute books and articles and developed promotional and marketing materials. She served as editor, production manager, and coordinator of the book, Value for Money: How to Show the Value for Money for All Types of Projects and Programs In Governments, Nongovernmental Organizations, Nonprofits, and Businesses (Wiley, 2020).
Kylie graduated with a Bachelorโs in Communication and Information Sciences from The University of Alabama in 2015 and a Master of Arts in Journalism from the same institution in 2017. Kylie holds CoreXM and CoreXM Expert certifications from Qualtrics and earned the Certified ROI Professional credential in November 2019.
In her free time, Kylie cheers on the Alabama Crimson Tide, enjoys the (mostly) sunny weather in Northwest Florida, and dotes on her dog, Penny.
Kylie can be reached atย kylie@roiinstitute.net.
Patti P. Phillips, Ph.D., is co-founder and CEO of ROI Institute. She is a driving force in the
global adoption of the ROI Methodologyยฎ and measurement and evaluation to influence organizational change. Her work as an educator, researcher, consultant, and coach supports leaders as they build the capacity to create and deliver value from investments in all types of endeavors. Her work spans private, public, nonprofit, and nongovernmental organizations.
Patti serves as a member of the Board of Trustees of the United Nations Institute for Training and Research and the UN System Staff College faculty in Turin, Italy. Additionally, she is chair of the Institute for Corporate Productivity People Analytics Board; Principal Research Fellow for The Conference Board; board member of the International Federation for Training and Development Organizations; and board chair for the Center for Talent Reporting. In 2015, she was honored by the Association for Talent Development as a Certified Professional in Talent Development Fellow for her contribution to the professionalism of the talent development field.
Patti contributes to various journals and is the author of books on measurement, evaluation, and ROI. CNBC, Euronews, and other news outlets feature her work.
Patti can be reached atย patti@roiinstitute.net
Ann Akins has been associated with ROI Institute for over 23 years.ย While primarily providing financial support for the company, in 2019, she also became the President of ROI expanding her role into the operational areas of the company.ย Prior to joining ROI, Ann was a regional controller for Waste Management with over $250 million in annual revenue.ย She has also led a customer experience center for FIS (a financial services company) with over 1,200 employees.ย This previous experience has helped Ann provide significant financial and operational insights for ROI operations.
Ann has a BS in Accounting from the University of West Alabama and a Masterโs in Business Administration from Mississippi State University.ย An avid University of Alabama sports fan, she enjoys attending UA football games and spending time with her children.
Ann can be reached at ann@roiinstitute.net.
Evan Seidner is a Senior Analyst for ROI Institute. In his role as an analyst, Evan does mixed-methods data analysis for clients. Evan also supports other team members in the evaluation process and implementation processes. In previous roles, he has worked with environmental NGOs in China as well as working for an agribusiness in Tokyo, Japan.
Evan holds a BA in Global Studies with minors in Political Science and East Asian Languages and Cultures from the University of Illinois at Urbana-Champaign and received his MA in International Relations from the American University in Washington, D.C.
In his free time, Evan enjoys learning photography and videography. He is a Japanese film buff, which he watches to help maintain his language skills.
Evan can be reached at evan@roiinstitute.net
Jack J. Phillips, Ph.D., chairman of ROI Institute, is a world-renowned expert on accountability, measurement, and evaluation. Jack provides consulting services for Fortune 500 companies and major global organizations, and regularly consults with clients in manufacturing, service, and government organizations in 70 countries. The author or editor of more than 100 books, he conducts workshops and presents at conferences throughout the world and has received several awards and honors for his work.
Jack has enjoyed almost 30 years of corporate experience in the aerospace, textile, metals, construction materials, and banking industries. He has served as training and development manager at two Fortune 500 firms, as senior human resource officer at two firms, and as president of a regional bank. Also, he served as management professor at a major state university.
Jack has undergraduate degrees in electrical engineering, physics, and mathematics; a masterโs degree in Decision Sciences from Georgia State University; and a Ph.D. in Human Resource Management from the University of Alabama. He has served on the boards of several private businesses, nonprofits, and associations, including the American Society for Training and Development, the National Management Association, and the International Society for Performance Improvement, where he served as president (2012-2013).
Jack can be reached at jack@roiinstitute.net.
Patti P. Phillips, Ph.D., is co-founder and CEO of ROI Institute. She is a driving force in the global adoption of the ROI Methodology and measurement and evaluation to influence organizational change. Her work as an educator, researcher, consultant, and coach supports leaders as they build the capacity to create and deliver value from investments in all types of endeavors. Her work spans private, public, nonprofit, and nongovernmental organizations.
Patti serves as a member of the Board of Trustees of the United Nations Institute for Training and Research (UNITAR) and the UN System Staff College faculty in Turin, Italy. Additionally, she is chair of the Institute for Corporate Productivity (i4cp) People Analytics Board; Principal Research Fellow for The Conference Board; board member of the International Federation for Training and Development Organizations (IFTDO); and board chair for the Center for Talent Reporting (CTR). In 2015, she was honored by the Association for Talent Development as a Certified Professional in Talent Development (CPTD) Fellow for her contribution to the professionalism of the talent development field.
Patti contributes to various journals and is the author of books on measurement, evaluation, and ROI. CNBC, Euronews, and other news outlets feature her work.
Patti can be reached at patti@roiinstitute.net
Hope Nicholas the Director of Publications for the ROI Institute.ย In this role she coordinates all publications, including books, articles, and case studies.ย Hope has significant experience with transcription, editing, proofreading, and project planning.ย Additionally, she contributes to multiple research and business development projects by facilitating communications and developing a wide variety of documents.
Hope is a graduate of the University of Akron and has over 15 years of experience working the field of healthcare administration and documentation. In her spare time, she enjoys painting, golfing, and playing tennis with friends and family.
Hope can be reached atย hope@roiinstitute.net.
Caroline Hubble, M.S.O.D., is Vice President of Consulting Services with ROI Institute, Caroline manages the implementation of complex program evaluation projects, including conducting research and evaluation studies in various areas such as leadership development, process improvement strategies, and program implementation. In previous roles, she managed evaluation, analytics, reporting, and operations for business line and enterprise-wide HR departments. Her operational, project, and relationship management expertise is noted for significantly contributing to improved business practices.
Caroline holds a BA in Psychology from Rollins College and received her Masters of Science in Organizational Development in May 2013. Her publications include: ASTD Handbook of Measuring and Evaluating Training, Chapter 4: Using Surveys and Questionnaires. ASTD 2010; Measuring ROI in Learning & Development: Case Studies from Global Organizations, Chapter 4 (co-authored). ASTD 2012โ Offering Money for School Pays Off, (co-authored) Chief Learning Officer Magazine, June 2012.
When not focused on evaluation efforts, she enjoys spending time on her small farm in the mountains of North Carolina, raising Savannah and Egyptian Mau cats, following NASCAR, and capturing memories through photography.
Caroline can be reached atย caroline@roiinstitute.net.
Jack J. Phillips, Ph.D., chairman of ROI Institute, is a world-renowned expert on accountability, measurement, and evaluation. Jack provides consulting services for Fortune 500 companies and major global organizations, and regularly consults with clients in manufacturing, service, and government organizations in 70 countries. The author or editor of more than 100 books, he conducts workshops and presents at conferences throughout the world and has received several awards and honors for his work.
Jack has enjoyed almost 30 years of corporate experience in the aerospace, textile, metals, construction materials, and banking industries. He has served as training and development manager at two Fortune 500 firms, as senior human resource officer at two firms, and as president of a regional bank. Also, he served as management professor at a major state university.
Jack has undergraduate degrees in electrical engineering, physics, and mathematics; a masterโs degree in Decision Sciences from Georgia State University; and a Ph.D. in Human Resource Management from the University of Alabama. He has served on the boards of several private businesses, nonprofits, and associations, including the American Society for Training and Development, the National Management Association, and the International Society for Performance Improvement, where he served as president (2012-2013).
Jack can be reached atย jack@roiinstitute.net.
Example
MYTH: The monetary value for a measure is difficult to locate or calculate.
REALITY: Most measures that matter have been converted to money.
The Kansas City SWAT team implemented the Outward Mindset program to reduce citizen complaints about the police, a meaยญsure of the quality of their work. The team leader, Chip Huth, and the team knew they could avoid the complaints by being nice guys, but they still had their jobs to do. Measures of productivity were equally important, includยญing confiscating drugs, cash, and guns; serving warrants; and making arrests. As a result of Outward Mindset, they were able to improve proยญductivity and quality. Reducing complaints was an important quality meaยญsure of success. However, according to Chip, โThe Outward Mindset approach did not merely help us reduce complaints, but also helped us account for an unquantifiable reduction in lawsuits, injuries, etc., and an increase in public trust, collaboration, and drug and gun seizures.โ
What else cause the complaints to decrease? The number of missions did not change, and the types of missions didnโt change. There were no policy changes and no high-profile cases in the news. In essence, the team could not think of any other factors and believed that their new Outward Mindset approach had made the difference. According to Chip, the complaints disappeared because of the behaviors from the Outward Mindยญ set, โThe way we responded to the reality of others while executing our work, including some changes in procedures that were born out of our commitment to seeing others, made the complaints disappear.โ
When comparing the monetary benefits of reducing complaints for one year to the cost of preparing this team to use the Outward Mindset, the ROI is 5,724 percent. This is an almost unbelievable ROI, but the process and the data prove it is credible.
Story from Show the Value of What You Do, Chapter 6, Page 97
Example
MYTH: The success of one project rarely influences investing in another project.
REALITY: The best results to continue to invest in are previous successes.
Jessica Kriegel, an organization and talent development consultant at Oracle with expertise in strategic planning, talent management, and leadership development, was particularly focused on intergeneraยญtional understanding. More specifically, she realized that generational labels do not work. The labels arenโt bad. Itโs the associations that society puts on those labels that are bad.
Although labels abound with each generational era, millennials (those born between 1980 and 2000) are the most misunderstood genยญeration. These labels keep individuals, managers, and even organizations from being as successful as they should be. Jessicaโs work at Oracle proยญ vided her with an opportunity to tackle this challenge directly. One projยญect clearly focused on this challenge, and she needed to show its value.1 A product ยญdevelopment team member reached out to the person in charge of the Oracle College Hire Program about their problem with the millennials. The team member suggested that the millennials didnโt unยญderstand the corporate culture, and as a result, there were behavioral and communication issues. This suggestion included a request for a training program to help the millennials acclimate to the company.
Jessica took this project on. She wanted to understand the issue and ensure that the correct program was implemented. She did not want to take on the project on the face value that millennials were the problem, and if we fix them, everything is okay.
Each year, this program develops approximately 100 to 200 new college hires, making this an important program. She examined some of the data that were surrounding the situation. A lack of productivity was reported, along with the excessive turnover of the millennials. Some were leaving soon after employment, which was very expenยญsive. Consequently, the business outcomes of interest were imยญ proved productivity and reduced turnover.
To understand the right solution, Jessica conducted a detailed surยญ vey with the managers and the employees. The surveys indicated that:
Next, Jessica conducted focus groups to examine the problem in more detail, and the focus groups identified areas where improveยญment was needed. The managers:
Meanwhile, the millennials felt they:
With these issues identified, the solution was designed to work with both groups to ensure that they worked productively and effiยญciently together, addressing their individual needs in two different programs (one for the managers and one for the employees). She set out to show the value of her program.
As Jessica conducted the programs, she captured reaction data. The employees felt the program was valuable, and it helped them understand more about their roles in the organization. She measured learning from both groups and found they were learning what they needed to do to be more successful. She measured application to see the extent to which they were working together because of the training. The reports were positive that they were working collaboraยญtively. With the increased collaboration came improvements in retenยญtion and productivity. With these improvements, she took a step to sort out the effects of the program from other influences, converted these measures to money, compared program benefits to the cost of the program, and calculated that the return on investment was 695 percent. The executives were impressed, and she communiยญcated the results to other groups and included a copy of her bestsellยญing book, Unfairly Labeled.
Leveraging the results of Jessicaโs project has made a differenceโ not only for the organization in which she was working at the time, but also for the program participants and the individuals she now reaches through her writing and speaking.
Story from Show the Value of What You Do, Chapter 7, Page 117
Example
MYTH: Data collection to show the success of a project is almost impossible.
REALITY: With planning and effort, data collection becomes feasible and successful.
Zoe Moore has been very determined. She helps organizations deยญvelop their Diversity, Equity & Inclusion (DE&I) strategies by ensuring there is diverse representation in leadership and recurring profesยญsional development focused on DE&I that improves workplace culture and supplier diversity programs to increase opportunities for underยญ resourced businesses. She has garnished attention around the subยญ jects, but still, many leaders ask the question, โSo what? What value do diversity, equity, and inclusion bring?โ
Of course, supplier diversity is important, but that is just the startยญing point. Equity and inclusivity are imperative across the global business of hospitality and are where the real value of Zoeโs work reยญ sides. But how can she demonstrate this value? She needs to collect data about:
This creates a new data collection stream for Zoe. While sheโs worked hard to improve awareness around supplier diversity through representation metrics, the challenge is to make sure that the teams integrate DE&I successfully, and she must collect data along the same five levels of success that form the value chain, with supplier diversity being the beginning point. This situation highlights that the five levels of success, first introduced in Chapter 1, can be examยญined at different times in projects and often from different perspecยญtives. This requires data collection along the value chain to make it work.
Story from Show the Value of What You Do, Chapter 5, Page 83
Example
MYTH: Objectives add little value to the outcomes.
REALITY: Objectives are powerful drivers of success.
Martin Burt, Ph.D., has a lifelong quest to understand and abolish poverty. His inspirational experience in public service includes servยญing as chief of staff for the president of Paraguay, the mayor of Asunยญciรณn (the capital city of Paraguay), and the vice minister of commerce. Martin is the founder and CEO of Fundaciรณn Paraguaya, a nonprofit devoted to promoting social entrepreneurship and economic selfยญ reliance to eliminate poverty worldwide.
Martin has challenged many assumptions about poverty by asking, โWhat if everything we knew about poverty was wrong? What if the legions of policy makers, social scientists, economists, aid workers, charities, and NGOs marching across the globe have been using the wrong strategy and tactics to wage the wrong war against poverty?โ
In his book, Who Owns Poverty?, Martin lays out the frameยญ work necessary to eliminate poverty. The answer to his question, โWho owns poverty?โ is clearโthe people in poverty. They donโt want to be in poverty. But people in poverty are not just persons with lowยญ income labels. They are individuals with joy, generosity, and creativity. They have problemยญ solving and entrepreneurial spirits, and they want to rise out of poverty. They just need help and support to get there, and they will get there if we give them an avenue to do so.
Martin created the Poverty Stoplight program that shows families what they must do to come out of poverty. Itโs not just increasing inยญ come, but itโs tackling a host of issues that altogether contribute to poverty. He developed 50 indicators of poverty, as shown in Table 9. Martin created the stoplight program with clear measures and three phases: red, yellow, and greenโred (a worst ยญcase scenario), yellow (making progress), and green (out of poverty). Along with each indicator, for each phase, the Poverty Stoplight team developed speยญcific measures of success so that all stakeholders, including the famiยญlies in poverty, can see where they are going, and the progress being made. Progress follows the five ยญlevel framework of reaction, learning, application, impact, and ROI.
Martin needs to show the value of the Poverty Stoplight program. He needs to push its evaluation to the ROI level for governments, as they calculate benefitยญ-cost analysis for helping to eliminate poverty. He also needs to calculate the ROI for the companies supporting the program, showing them that this is a good investment for the company and the community. The major foundations involved in the NGOs and the charities donโt need to see ROI, but they all need to see the impact. The impact is getting families out of poverty and reaching the green light on the Poverty Stoplight. Martin needs the Show the Value Process to show the value of what they do.
Story from Show the Value of What You Do, Chapter 4, Page 61
Example
MYTH: The solution to a problem is almost always obvious.
REALITY: The right solution is rarely obvious.
Ginger Luttrell spent 10 years as a software engineer, including conยญ figuration and programming at one of the worldโs largest business software companies. The intent of new systems implementations is to improve output, quality, cost, and time. Over the years of working with these systems implementations, she noticed a problem. When an implementation project would go live, endยญusers, those who worked in the business functional areas or departments, would ask quesยญtions such as:
Interestingly, end-ยญusers received comprehensive training on these systems during projects. Despite this fact, Ginger noticed that they exยญperienced problems and frustrations on the job. As a result, productivยญity, quality, and time savings sufferer rather than improved. The types of problems Ginger was addressing were universal. Additionally, some end-ยญusers would become so frustrated they would leave the company altogether. Ginger also saw that there was no channel for the voice of the end-users to get to the senior executives to address their issues and concerns.
Ginger began to realize a possible solution by addressing the preยญcise business needs identified (productivity, quality, time, cost, and retention). The endยญ-users needed a person who would support them on a routine basis. This person would serve as a mentor, coach, trainer, counselor, and trusted advisor to help them through complex impleยญmentation issues. This person is called a super user. At the same time, super users would help develop the end-ยญusers to become more valuable business team membersโmembers with a broader vision and more complex skill sets, who could offer greater support in their organization.
Ginger realized that the cost of providing super users was much less than the savings that would be generated to make the software system more effective for the organization. She tested her theory in different organizations and was convinced that she had the right solution for the perplexing problem of largeยญscale systems implementation. Eventuยญally, Ginger founded the Super User Network and now spends much of her time preparing and developing super users to perform this essenยญtial role in business departments worldwide.
Story from Show the Value of What You Do, Chapter 3, Page 45
Example
MYTH: Itโs almost impossible to connect most projects to business needs.
REALITY: Essentially, every project can be connected to a business need.
Chip Huth, the new leader of a SWAT team in the Kansas City, Missouri, Police Department, knew what he had to do. Citizen complaints against the team were excessive, averaging about 30โ40 per year. They were also expensive, costing the department an average of $70,000 per complaint just for the investigations. The deputy chief (DC) who appointed Chip was clearโChip needed to โclean upโ the mess. The DC was concerned about optics from the complaints and the many irritations they were causing.
Expectations were vague, and the accepted remedy was potenยญtially a โhouse cleaningโ and subsequent creation of a new team. Chip knew what he was facing. He accepted the assignment because he loved working in teams. Initially, Chip didnโt believe the team could be โfixed.โ Admittedly, Chip was completely self-centered in his thinking and simply loved the thrill of the work. He reassured the DC that he could whip the team into shape (not believing anyone could do so) and initially sought token improvements by addressing problem behaviors.
Unexpectedly, through a series of personal and professional encounยญters, Chip was exposed to a personal improvement process called Outยญ ward Mindset from the Arbinger Institute. Arbingerโs research indicates that people operate at any given time from one of two mindsets: an inยญ ward mindset or an outward mindset. When operating with an inward mindset, you focus only on your own goals and objectives without conยญsidering your impact on others. With an outward mindset, however, you see others as people who matter as much as you do. You consider their needs, challenges, and objectives. And you focus on collective results.
As Chip began applying the Outward Mindset framework to each area of his life, including his leadership responsibilities with the team, it seemed logical that this could impact the team. Although Chip was not certain that the Outward Mindset would deliver fewer complaints or build a better relationship with the community, he was willing to give it a try.
He introduced the team to this process. When they were exposed to it, they responded positively. The team asked Chip to lead them in applying the Outward Mindset skills and framework, in roleยญ modeling the behaviors, and showing them that it works. That was all Chip needed. He had the business measure, citizen complaints at roughly $70,000 each, the right solution, Outward Mindset, and the right people at the right time. He was ready to go.
Story from Show the Value of What You Do, Chapter 2, Page 29
How to Develop Turnover Costs
The first step in monitoring turnover costs is to define and discuss several issues about a cost control system. The key issues are presented here.
Some Costs Are Difficult to Determine
The huge difference that often exists between the cost estimates from HR and the actual turnover cost lies in the indirect or hidden costs category. Where direct costs are usually in the cost accounting system, the hidden costs are almost never considered. However, they can be developed using assumptions and estimation processes.
Fully-Loaded Costs
Using the approach to capturing the fully-loaded costs of turnover, each cost is identified and put into a specific category. Where an estimate is required, the entry is adjusted later. If possible, someone from finance and accounting should review and approve the data. The process should be able to withstand even the closest scrutiny, so organizations must ensure that all costs are included.
Reporting Total Cost
Costs are typically expressed as a percentage of the wages and salaries of the employees in a particular job group. This figure is usually determined after a detailed cost study is conducted. The percentage can be fixed for a group (for example, the sales force) or a specific job (for example, client relationship manager [CRM]).
For example, if a cost study in another industry has concluded that the cost to replace a CRM averages 150 percent of pay, this amount can be a beginning point. If there is some concern about the cost being too high, perhaps a lower number would be appropriate, such as 120 percent or 100 percent. After a figure has been determined, the turnover cost is then reported on statements along with the actual costs.
Morteza Zohrabi, MD, MBB, PMP, CRP, is the lead director in the implementation of countless mega-projects in both public and private sectors for large hospitals, government offices, manufacturers, and universities, to name a few. He is also a Certified Return on Investment Professional, publishing numerous articles and presentations on guaranteed value for money.
With over 20 years of expertise and hundreds of millions of dollars in savings, Morteza has done it all. He has delivered innovative solutions to old-time problems, with a track record of outstanding results, enhancing throughput, capacity, staff/client satisfaction, and shrinking turnaround times.
Through a combination of conventional and modern management techniques, Morteza and his team have revolutionized the management consulting industry by providing state-of-the-art business transformations and distinctively conforming as growth partners, encompassing guaranteed client satisfaction with each endeavor.
Morteza can be reached at morteza.zohrabi@yahoo.com.
Tom has a strong track record of enhancing business and individual performance through learning. He has conducted research and led teams to achieve award-winning results for more than 50 Fortune 500 companies. His strengths include assessing training needs, designing and facilitating learning solutions, and measuring results, including ROI.
At Atkinson Analytics, Tom helps clients achieve better results throughout the learning process, from defining needs to measuring the learning experience, on-job application, and business results. Tom enables individuals to demonstrate value to executives, sustain and enhance performance gains, and target opportunities for increasing return (ROI) on learning investments.
Tom previously worked as a learning director at Fresenius Medical Care and led a team of professionals in delivering an ambitious curriculum of programs and projects, including more than 1,000 sessions of the companyโs keystone leadership development initiative. At Deloitte Consulting, Tom was a specialist master, designing award-winning training and measurement systems for some of Deloitteโs largest clients.
Tom also helps parents of children on the Autism spectrum build meaningful relationships and a foundation for growth and development.
Tom can be reached at tatkinson@atkinsonanalytics.com .
Suzanne Schell, CRP, is the CEO of ROI Institute Canada. Suzanne teaches, consults, and conducts ROI studies primarily focussed on the Healthcare industry.
Suzanne acquired her Certified ROI Professional designation in 2010. She has brought the ROI Methodology to healthcare organizations, hospitals, and healthcare ministries and authorities across Canada, through workshops, consulting, and ROI Certification.
Her workshops and consulting give healthcare professionals, HR professionals, and executives the knowledge and skills to measure impact, value and ROI of initiatives, programs, and projects. Key learnings include developing data collection and analysis strategies to identifying change in behavior and impact, ROI. Answering the questions โ did the investment make a difference, did it deliver the impact expected, and is this the solution moving forward?
Suzanne can be reached at suzanne@roiinstitutecanada.com.
Rana Imran is an HR and OD professional and strategist with 15+ years of experience with multinational corporations in Pakistan and the Middle East region in diverse multicultural and international environments. Rana has worked with telecom, e-commerce, FMCG, education, healthcare, and hospitality industries.
Rana’s expertise is in organization design and development, business transformation strategy, organizational culture, employee engagement, performance management, talent management and development, capability building, leadership development, and measuring program impact.
Rana has delivered more than 36,000 hours of training on behavioral and business skills.
Rana is certified in Hogan Assessment, Global Diversity & Inclusion standards, is an IFC World Bank Certified Trainer, and has received a Measuring Return on Investment Certificate from ATD and ROI Institute. He is Certified Practitioner of Global Leadership Assessment 360 and Working Group Leader for the Global ISO HR Standard development committee TC260.
Rana can be reached at ranaimran.hr@gmail.com.
Burdette (Pete) Fullerton PhD is the founder of Dr. Peteโs Leadership Accelerator, Inc., an Executive Coaching and Return on Investment (ROI) assistance firm. In order to assist community economic development professionals, Pete started up Dr. Peteโs Leadership Accelerator. Pete is a passionate advocate for passing it on and leaving the campsite better than he found it. He values character, trust, and integrity and looks to assist like-minded economic development and chamber of commerce professionals in achieving personal and professional excellence. Pete has been a community economic development professional for over 30 years. In his career, Pete has participated in the completion of projects that have directly invested over $3.5 billion, which currently employ more than 17,000 in Kansas City.
In 2017, Pete earned his Doctorate at the University of Southern Mississippi in Human Capital Development. Pete attended Texas A&M University and received his Bachelor of Arts degree in Political Science and a Master of Public Administration from the University of Missouri. Pete holds certifications as a Certified Economic Developer (CEcD), Certified Return on Investment Professional (CRP), Certified Professional Coach (CPC), and Certified Executive Coach (CEC).
Pete can be reached at pf@drpeteleads.com.
Nader Bechini is passionate about assisting people and organizations improve and maximize their performance and bottom-line results. His life mission is to support others in strengthening their abilities to inspire, influence, and create an impact.
Nader is the director of ROI Institute in the MENA region. He is also a global facilitator with the Association of Talent Development (ATD).For more than 20 years, he led human performance improvement projects, programs, and initiatives, in more than 30 countries in North and South America, Europe, Africa, Australia, and Asia.
Nader has received several awards for his achievements. On three occasions, ROI Institute awarded him for the best international implementation of the ROI Methodology (2015, 2019, and 2020). The Moroccan Society for Human Resource presented him with an award for the best African HR expert in 2019. His articles in learning and development have been translated to Korean, Russian, Chinese, French, Arabic, and Spanish.
Nader facilitates workshops, consults with organizations, and speaks at conferences worldwide. He has been interviewed by several radio and TV programs in Saudi Arabia, Sudan, Tunisia, France, and Algeria.
Nader holds a masterโs degree in marketing from the University of Tunis El Manar, Tunisia.
Nader can be reached at nader@roiinstitute.net.
Matic Kadliฤek is an organizational psychologist and CEO of Video Center, Ltd. He is a sought-after people development consultant to more than 100 companies, building and implementing internal learning centers, e-learning content and platforms, and tools for successful leadership development and skill building, with psychological testing, coaching, succession planning, work environment diagnostics, mentoring, on-boarding, and providing frameworks for credibly measuring the impact of people development programs using the ROI Methodology (ROI Institute, USA). He is one of the first EuroPSY certificate holders for Work & Organizational Psychology in Slovenia. Matic is a dedicated mentor to young psychologists and takes humor seriously.
Matic can be reached at matic.kadlicek@videocenter.si.
Hormazd Mistry, ATD Master Trainerโข, is the founder and CEO of Sarosh Consulting and ROI Institute India. He is the India partner for ROI Institute.
Hormazd is a learning & development professional who has twice received the Most Fabulous Training & Development Leaders (2020 & 2021) award by the World HRD Congress. He has been a part of the L&D community for over 18 years and has worked for multinational organizations like Wipro Ltd., HERE Technologies, IKS Health, leading various L&D teams across geographies.
With a passion for L&D, Hormazd has experience in different roles in various L&D verticals. Over the years, he has delivered over 25,000 hours of training on various topics including but not limited to technical, TTT, leadership, soft skills, customer service, behavioral training, etc., with high business impact.
Hormazd now works with L&D/HR professionals and teams to enable them to deliver high business impact with their solutions. He also helps them in measuring and showcasing the impact & ROI of their programs.
Hormazd can be reached at hormazd@roiinstitute-india.com.
Hashem Othman Hashem is a top-notch ROI specialist, trainer, and consultant with 13 years of experience in measuring the ROI of a wide variety of projects, including HR practices, training, health care, and KPIs. His expertise covers isolation techniques, forecasting ROI studies, training best practices, and designing and implementing training solutions based on their ROI. Hashem also has experience in overseeing career development, setting performance metrics, evaluating project productivity, and helping to create successful long-term initiatives within organizations. He serves as a point person for CEOs, CFOs, and project managers to ensure proper investing of project budgets. Hashem maintains excellent communication, change management, and leadership skills. He is distinguished for his problem resolution abilities and high level of confidentiality. Hashem is equally effective at conducting ROI studies, measuring project impact, and training supervision and delivery.
Hashem earned his Master of Strategic Human Resource Management (MSHR) degree at the University of Wollongong, Australia, and a Bachelor of Applied Physics degree at Muโtah University, Jordan. He achieved the designation of Certified ROI Professional with ROI Institute in July 2017.
Hashem can be reached at h.othman@criticalinnovation.ae.
Beryl Oldham has 30 yearsโ experience in organizational learning and development. Before moving fulltime into consulting in 2013, she held senior generalist HR, organizational development, and learning and development roles in a range of government, local body, and corporate organizations. Her experience spans workforce planning, technical/professional and leadership/management competency frameworks design, performance management systems design and implementation, learning design, training systems management and evaluation, and measuring ROI for human resources, training, and other organizational initiatives.
In addition to being a Certified ROI Professionalยฎ, Beryl also holds AQF certificates in Training Systems Management and Training Evaluation, and the NZQA Certificate in Adult Education and Training (Level Five). She was the 2014 recipient of the NZATD Education Trustโs Learning and Development Practitioner of the Year Award and the ROI Instituteโs 2014 Award of Excellence for Most Innovative Approach to ROI.
Beryl is passionate about measuring results and her company, Complete Learning Solutions, provides learning solutions that cover every aspect of L&D and make a difference by proving the value of capability development in people and organizations. Beryl has been a partner with ROI Institute for nearly 14 years.
Beryl can be reached at beryl.oldham@completelearning.co.nz.
Farzaneh Majed is an ROI Institute Partner and Balanced Scorecard Institute Strategic Partner and Advisory Board Member with over 20 years of successful business development, change management, and innovation experience who has a passion for excellence and thrives on driving change. Her extensive career at the global level has resulted in many successful initiatives being adopted lucratively. She believes in simplifying processes and delivering results through strategic planning and effective execution.
As CEO and Managing Partner of Transform Alliance, Farzaneh is committed to assisting organizations to achieve transformation through the engagement of their people with TA’s alliance partners. Farzaneh is an advocate of Inclusion and Collaboration and owes her success to putting herself in the other person’s shoes, seeing the world from their perspective, and seeking a win-win solution.
Farzaneh is a Key Performance Indicator Professional (KPIP), Balanced Scorecard Master Professional (BSMP), has a Master’s Certificate in Project Management from George Washington University, and an Honours degree in Combined Sciences from the University of Brighton, UK. She established the L&D Division of Informa, was selected as Centre of Excellence for Training among Informa Group, and achieved an innovation award for continuous improvement. Farzaneh is the author of Generation Inclusion.
Farzaneh can be reached at farzaneh-majed@transform-alliance.com.
Colin’s career spans more than 35 years, and he’s still smiling. He began as an information technology (IT) mainframe programmer, growing to run complex international IT projects for corporations in many business areas requiring advanced leadership, cross-cultural stakeholder management skills, and the delivery of quantifiable business value.
Originating from the United Kingdom, he has lived in the United States, the Netherlands, and Singapore at various times and operated in many other countries.
Since 2007, Colin has concentrated on consulting and training, developing several thousand project managers and leaders for corporate clients and educational institutions. In 2014, he completed his ROI impact study to become a Certified ROI Professional (CRP) and partnered his company with ROI Institute through various locations in South-East Asia.
Supported by his dedicated team, Colin conducts ROI consulting projects and courses as well as project management and related subjects. He is a Project Management Professional (PMP), Certified Scrum Master, Certified Product Owner, and holds a master’s degree from Arcadia University, PA. Colin also specializes in dispute resolution and sits on the Principle Panel of the Singapore Mediation Centre where he mediates large quantum business disputes. And, when he has five minutes, Colin organizes the Singapore Filmmakers Network.
Colin can be reached at enquiries@knightgriffin.com.