|
Philosophically, I believe trainers and consultants have done themselves a disservice by assuming responsibility for evaluation. How do we prove ROI or assure transfer of learning to the job? Its not our job and our insisting that it is only contributes to pervasive practice of absolving management of its responsibilities. Yes, we are responsible for the integrity of our work and products; however, the client must share the accountability for results. Therefore, I believed there was a need for a book that focused more on how to collaborate with clients to confirm the need, define the desired outcomes, and measure the results. On those days when my sarcasm is running rampant, Id say managers couldnt recognize performance if it wore a neon sign. Of course this isnt true. What is true is that many managers need help defining, recognizing, communicating, and measuring performance. It is our job to provide the tools and rules that help them. Managers also want help articulating their expectations in ways that are useful to workers. Again, our job is to help them express work requirements in ways that can be used to design curricula and performance support tools, and measure performance. When we do our job well, workers and managers have the measures they require to self-monitor work results. Therefore, I took special care to describe how we might work in partnership with our clients to measure the things that are important and to the level of precision that is useful. On the evangelical side, I like evaluation and want others to share my enthusiasm. I love developing tools that help others gain clarity and self-sufficiency and this is the essence of good training. Yet, Ive been appalled by the lack of understanding of the basics of measurement and the lack of rigor by trainers and instructional designers. Good measurement begins with knowing how to get valid information. In all fairness, the information is hard to come by. My two semesters of statistics in graduate school were useless. Yes, there are a lot of books but it is labor intensive, and sometimes even punishing to extract the principles, rules, and guidelines required to do our jobs well. So I wanted a book that modeled a thinking process based on inquiryask and verify. I tried to look at measurement from the perspective of the clientwe convey technical information and teach others to follow procedures. We explain why people should exhibit some behaviors and not others. I wanted to make explicit that a lot of what we do is driven by beliefs that may not be grounded in facts, and I wanted to provide useful rules for how to get good data and then how to interpret it. I had a lot of help writing the book by people who read it while it was being written. Their comments were valuable. They pushed me to be more specific, to spell out the hows and how tos. They also contributed the stories, real situations of measurement being done well and not so well. I hope you find the stories, tools, and tips clarifying and useful.
|
|
|||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||
|
Significant
Trends To support the need for increased productivity and results, the old marketing mantra, know your customer has taken on new meaning. The ability of organizations to know their customers well enough to predict their needs and future buying habits has spawned sophisticated data mining and tracking systems that analyze demographics, diversity, and a host of other distinguishing characteristics all in the name of user advocacy. These three trends: increasing productivity, taking the most cost-effective path, and user advocacy combined have encouraged increased independence for workers and a renewed focus on results. Causes
of These Trends To reach and maintain profitability today requires increased efficiency. Performance is tied to the individual worker and is significantly affected by the personal stress and information overload so common these days. Productivity may finally be coming into its own, as time becomes a key metric, and letting workers solve problems in the most efficient way enables them to produce the desired results. The key to the three Ps is the creation of multiple paths. That is, creating systems that allow each worker to develop his/her own most efficient route to save time and achieve results. Impact
of These Trends As practitioners, the current work climate presents us with opportunities to visibly link performance to organizational goals. For example, we can build scalable programs that allow participants to self-direct (choose their own path) and eliminate information they already know or do not need in order to get to full productivity more quickly. We can start with the business entity and the customer and use the discipline of HPT in our organizations. If we can relate performance improvement initiatives to business metrics and move from a transaction orientation to a business orientation, we will successfully integrate performance improvement, customers, and the business. We will have helped the client help himself.
|
![]() |
|||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||
|
Assuring
that Change Is Improvement Assuring
that Training Receives Management Support How does performance-based instruction differ from other instruction? Performance-based instruction differs in four major ways. 1. Objectives. 2. Instructional
Methods. 3. Standards
of Achievement. 4. Evaluation.
|
||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||
|
ISPIs games guy and QBInternationals Resident Mad Scientist (aka Director of Research and Development) Sivasailam Thiagi Thiagarajan has created another interactive game designed especially for the readers of PerformanceXpress. As a performance improvement professional, you know all about selecting, designing, and implementing different types of interventions to improve human performance. There are many complex and convoluted models for classifying interventions, but we like the simple three-category system of improving skills and knowledge, improving motivation, and improving the environment. Play the Interventions game by visiting: http://www.thiagi.com/ispi/categorize/html/Interventions.html You will find the three categories listed on the right side of the screen with different statements popping up on the left side. Read each statement and click on the category that is most closely associated with the statement. To add to your excitement, you are operating under a time limit and your scores are continuously displayed. Remember, you can play this addictive game repeatedly. Each time you play, you may see different statements presented in a different sequence. To add more excitement, you can choose a higher difficulty level (which will decrease your available time). Before you know it, you will become so fluent with HPT interventions that everybody will be impressed.
|
![]() |
|||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||
|
As the new Board liaison to the Chapter Partnership Committee (CPC), it is only appropriate that I highlight the global development of our chapters and give praise to the enthusiastic contributions of our CPC members and their Chair, Dan Topf. Our 68 chapters represent diverse regions, languages, and compositions. The use of technology combined with the strategic leadership of our Committee members has increased the level of sophistication in which our chapters communicate, network, and share resources. Within two clicks on the ISPI website, you will find contact information for local chapters, listings of local area events, and highlights of the Chapter Partnership Committee. Several trends emerge. Chapter events are drawing big names. In just a quick skim of current local events, you will find an impressive menu of ISPI Masters sharing their expertise throughout the USA and across the globe. Just think of the HPT power being generated with presentations from Geary Rummler, Eileen Mager, Timm Esque, Harold Stolovitch, Jim Hill, Ruth Clark, Thiagi, Don Tosti (and the list goes on)! ISPI Masters are famous for their commitment and generosity to local chapters in promoting the practice of HPT. And all a local chapter needs to do is ask! Our chapters are becoming increasingly efficient and creative. By holding regional conferences, chapters are able to pool their resources, attract larger audiences for their keynote presenters, and increase the scope of their professional networking. The highly successful EMEA (Europe, Middle East and Africa) conference in the Netherlands was featured in August PerformanceXpress. In October, ISPI chapters in New Jersey, New York, and Pennsylvania will host a North East Regional Conference. These regional events benefit both local members and our International Society. Often, exposure to a regional conference entices new members to attend ISPIs Annual Conference. The networking among our chapters continues to exceed expectations. The positive interaction among Headquarters staff, the ISPI Board of Directors, and the CPC has resulted in the sharing of resources and the reduction of redundancy. Chapters do not have to reinvent the wheel in search of solutions or products. The Committee fosters the sharing of ideas and facilitates the exchange of materials. Currently, the CPC is working diligently on the design of the 2003 Chapter Leaders Workshop. This forum addresses the administrative needs of new and experienced ISPI chapter leaders and fosters the development of lasting relationships. Through engaging presentations and passionate discussions, the participants generate ideas on how chapters may leverage their resources, implement best practices, and clarify local perspectives. For many of us, chapters represent the heart of our Society. Our first encounter with ISPI occurred at a local chapter. We learned about human performance technology as a profession, practiced new techniques, tested new technologies, and developed our skills. During chapter meetings, we expanded our professional network and enjoyed up close and personal encounters with HPT experts. Many of us honed our leadership, organizational, and strategic planning abilities by serving as chapter officers. Our participation at the local level became the springboard for our involvement at the International level. I am pleased to report this evolution remains true today. NOTE: The charter of the Chapter Partnership Committee is to determine the strategic direction, placement, and function of chapters and their resources within the International Society and to recommend to the Board of Directors avenues the Society might pursue. |
|
|||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||
|
Please contact Roger Chevalier, ISPI Director of Information, at rogerc@ispi.org or 707.584.7160 for more information about this opportunity.
|
![]() |
|||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||
|
Keynote
Address Masters
Series Dr. Sink suggests viable alternatives or modifications to the traditional ISD process that make it more efficient, flexible, and appropriate for performance-based, results driven environments. Sink will highlight positive changes in the practice of instructional design and development by exploring how master instructional designers approach the ISD process. Concurrent
Sessions One-day
Workshops The conference and workshops are designed to provide you with new knowledge and insights, a plethora of useful performance tools, and valuable new contacts with experts and peers. For additional information on the conference visit, Performance-Based Instructional Systems Design.
|
![]() |
|||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||
|
Our measurement approach is founded on the earthquake-like shift attributed to Thomas F. Gilbert (1978) that redirected our focus from behavior to the accomplishments, or products, of behavior. Gilbert stressed that it is the accomplishments produced by individuals, groups, or processes that have value in organizations, not merely their behavior. In fact, he continued, behavior is costly. Our goal should be to produce the greatest possible quantity and quality of accomplishments at the lowest cost. A worthy intervention, he said, is one that produces accomplishments more valuable than the cost of the behavior to produce them. This accomplishment-based approachrefined and extended by Harless, Rummler, and otherssets the stage for a simple model that can drive how we measure. If our goal is to produce business or organizational results (sales revenues, cost reductions, profits, etc.), then our front-end analyses should focus first on the individual and group accomplishments that contribute to those results. Once we have identified those valuable accomplishments, and perhaps identified the individuals or groups who produce them most cost-effectively, only then should we drill down to the behaviors that produce them, and finally to the various influences on those behaviors (tools, skills, knowledge, etc.).
Given the above, what can we measure? And how can we relate the effects of our interventions to the results that management values? The answers to these questions should be clearer now. To measure, we look for things to count. This model gives us lots of things to count. It also supports the view that we should begin to measure during the front-end or needs analysis phase, when were first identifying the organizational results, accomplishments, and behavior we want to improve. We can certainly count business results. Thats what managers and accountants already do. We can count dollars in various categories, time to market, numbers of customers who rate our companys service at various levels, etc. This is fairly easy because the business people have already figured a lot of it out. A possible glitch is that they might not always be able to capture the needed data (e.g., sales revenues by individual sales rep for each product). On the other hand, if knowing whether their investments are paying off is important, they might be willing to go the extra mile to capture the needed numbers. We can also count accomplishments. Widgets, calls handled, deadlines met on time, customer or supervisory interactions that meet specific criteriathese are all countable things. For more ideas about how to turn Gilberts requirements into countable units, see Binder (2001). Finally, we should be able to count behavior during training, on the job, or in high-fidelity simulations, using various types of sampling methods. We can count specific behaviors in customer interactions (or simulations), count per minute of correct and incorrect responses on multiple choice tests, and keystrokes per minute using software applications. The key here is to include a time dimension, and to avoid using percentage correctwhich is not a measure of performance but a dimensionless quantity. Once we identify ways to count business results, accomplishments, and behavior, we are well on our way to being able to detect whether, for example, our interventions actually increase desired behavior, produce more or better accomplishments, or ultimately contribute to business results. Does this help? Let me hear from you with comments and questions. References Gilbert, Thomas F. (1978, re-published in 1996). Human competence: Engineering worthy performance. Silver Spring, MD: International Society for Performance Improvement. Related
Reading
|
|
|||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||
|
This is the one important lesson that I learned during my six decades of work as a facilitator: Learning is a social process. You need to interact with other human beings in order to learn efficiently, effectively, and enjoyably. As a trainer or a facilitator, you must require and encourage people-to-people interaction among participants. My preferred learning environment is a face-to-face classroom. However, I have worked with mediated instructional materials of different kinds: print, audiovisual slide sets, video, and computers. With all of these media, I have incorporated people-to-people interaction. Even my self-instructional programmed materials were designed to be used by a team of learners rather than by individuals. I did my first computer-based training program in 1969, using a teletype terminal and punched paper tape. The topic was a magic trick. My latest project involves designing a web-based playground to accompany technical training. We are all migrating to the web. Even if we discount half the hype, there are many compelling reasons why managers, trainers, and participants will increasingly use online learning. Our learners from the Nintendo generation will have no problem embracing the new mode of learning. Decisionmakers are persuaded by spurious economic arguments to jump on the online learning bandwagon. As trainers and facilitators, we are caught in the middle. We cannot fight the trend. Actually, I am excited about going online. Here are the reasons for my excitement and optimism: As long as we focus on the learning part of online learning, we can shift the focus from the technology to learning outcomes. Online learning experts have no clue about instructional design. Unless we jump in and insist on quality of learning outcomes being treated as the most important criterion, we will not have any positive influence on this trend. Electronic technology provides a tool for effective participation. We can encourage and require people-to-people interaction in our online courses. The future trend is toward blended learning. We can blend high-touch learning segments with high-tech approaches. There are as many different types of web-based learning as there are types of face-to-face learning. Online learning does not have to be solitary confinement with textbooks, lectures, and CBT lessons being delivered on the Internet. You can have a variety of collaborative learning approaches. You dont have to invest enormous amounts of money to acquire an infrastructure. You can conduct collaborative learning experiences at zero cost through email and user groups. Lets join the revolution and demonstrate that true interaction goes beyond moving the mouse around. NOTE: Reprinted with permission from QB Internationals online newsletter Play for Performance.
|
|
|||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||
|
Each month, I will highlight three sites connected by a general theme. While far from comprehensive, hopefully these sites will spark readers to look further and expand views about human performance technology (HPT). Please keep in mind that any listing is for informational purposes only and does not indicate an endorsement either by myself or the International Society for Performance Improvement (ISPI). These are the general categories I will use for the sites featured:
The theme for this column is Measurement. Outcomes and opportunities, performance and pride. The work of HPT professionals centers on measurement to assess improvement, analyze gaps, and achieve constructive change. Here are some sites that measure up. E-Klatch HPT@work www.rileyguide.com, created by Margaret F. Dikel, MSLIS, Internet Consultant for Employment, Recruiting, and Career Transition Services, The Riley Guide is a directory of employment and career information sources and services on the Internet. It is primarily intended to provide instruction for job seekers on how to use the Internet to their best advantage, but recruiters and other career service industry professional will find information here to help them also. I-Candy Visual Mathematics is the electronic quarterly of the ISIS-Symmetry (International Society for the Interdisciplinary Study of Symmetry), published by the Mathematical Institute, Belgrade, Yugoslavia. NOTE: Listings above are for informational purposes only, and do not indicate an endorsement either by Todd Packer or ISPI. Todd Packer is an independent consultant providing research, coaching, writing, and training in organizational development, creative problem-solving, and stress management. He seeks to improve performance through dynamic new approaches to research and creativity at work. Please contact Todd with your feedback, comments, and ideas at tp@toddpacker.com. For more information, visit www.toddpacker.com. |
![]() |
|||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||
|
Here are some ideas on how to get started: 1. Answer
peoples questions with a story. 2. Elicit
stories from the group. 3. Use
a metaphor or analogy. 4. Tell
a story to change the groups energy. 5. Tell
a story with your voice and body language. 6. Validate
and transform emotions with a story. 7. Tell
a story to change a groups perspective. 8. Use
a joke or tangent.
|
|
|||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||
|
Below are the names of the participants in this session:
This group saw the next five years of their professional vision as a time for expanding knowledge, translating research into practical applied solutions, and solidly moving toward or achieving certification as an HPT professional. The group admits to an incomplete awareness of all ISPI offerings and that a solution may be just around the corner or 6 clicks away on the website. Roles
for ISPI Assessment Broad
Action Items Reach
Out Reach
In To reach within the organization to explore formal, informal, or ad hoc groups to learn from similar experiences, understand trends and issues affecting various industries and interest groups. Provide or develop tools for members such as a 15 second elevator speech on what HPT and the related certification means, so members can work from a similar script in promoting the value of both ISPI and the HPT certification. Earlier, I mentioned that workshops received high marks as a means for exploring a particular topic in depth. A suggested enhancement is to make the workshops more dynamic in terms of selection process for the conference and linking participants over time to examine the issues in applying the concepts presented. Certify Enable In summary, there seems to be no shortage of ideas. Now the difficult part of framing relevant actions from the information begins. If, as a result of the best imaginable process, the Society can tap the enthusiasm and energy exhibited by this group the future is bright. |
||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||
|
|
![]() |
|||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||
|
||||||||||||||||||||||||||
ISPI is looking for Human Performance Technology (HPT) articles (approximately 500 words and not previously published) for PerformanceXpress that bridge the gap from research to practice (please, no product or service promotion is permitted). Below are a few examples of the article formats that can be used:
In addition to the article, please include a short bio (2-3 lines) and a contact email address. All submissions should be sent to april@ispi.org. Each article will be reviewed by one of ISPIs on-staff HPT experts, and the author will be contacted if it is accepted for publication. If you have any further questions, please contact april@ispi.org.
|
||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||
|
PerformanceXpress (formerly News & Notes and Quick Read) is an ISPI member benefit designed to build community, stimulate discussion, and keep you informed of the Societys activities and events. This newsletter is published monthly and will be emailed to you at the beginning of each month. If you have any questions or comments, please contact April Davis, ISPIs Senior Director of Publications, at april@ispi.org. ISPI
|
|
|||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||