Within the last decade, ROI has become one of the most challenging issues facing, not only the training and development industry, but also the meetings and events industry. In the last two years, the Phillips ROI Methodology has been brought to the meetings and events industry through the help of Meeting Professionals International, the largest association for the meetings profession with more than 19,000 members in 66 chapters and clubs across the USA, Canada, Europe and other countries throughout the world.

The US-based Convention Industry Council recently reported that meetings, conventions, exhibitions, and incentive travel generated $122.31 billion dollars in total direct spending in 2004, making this industry the 29th largest contributor to the gross national product. Considering the size and spend of this industry, meeting professionals everywhere are under pressure to prove the impact their meetings and events are having to their employers, associations, meeting attendees, meeting sponsors, trade show exhibitors and meeting host cities. As long as there is a need and a pressure for accountability and the concept of an investment payoff is desired, ROI calculations will be used to evaluate major investments in meetings and events.

The Best Meetings and Events for ROI Studies

ROI calculations on meetings and events can be done from multiple perspectives such as the meeting organizer, meeting attendee, exhibitor, sponsor, speaker and even the city hosting the meeting. It is most appropriate for associations, non-profit organizations, and government entities to consider these multiple perspectives. For associations, the best meetings and events on which to conduct ROI impact studies are:

Annual conferences from the attendee, exhibitor and sponsor perspectives

Trade shows from the exhibitor perspective

Specialty or in-depth member training or certification programs from the participant perspective

Corporations may also want to consider conducting ROI impact studies from both their own perspective and that of their meeting attendees. For example, a franchise company can calculate the ROI for franchise owners participating in their meetings and events. The best corporate meetings and events on which to conduct ROI impact studies are:

  • User, customer, client, independent agent and franchise owner group conferences
  • Product roll-out meetings and events
  • Marketing events
  • Team-building meetings
  • Management meetings
  • Annual sales kick off meetings
  • Incentive travel programs
  • Trade show booths

Like in the training world, not all programs are candidates for ROI measurement. Only 5 to 10 percent of an organization's meetings and events should even be taken to the ROI level. The best meetings for an ROI study would be linked to the operational goals and/or strategic objectives of the organization or attendee and would incur significant costs and staff/participant time.

Levels of Evaluation Applicable to Meetings and Events

As shown in Table 1, the Kirkpatrick and Phillips levels of evaluation have been slightly expanded to include a level 0 which encompasses meeting statistics and attendee demographics. As some of the ROI junkies out there will recall, Jack Phillips has included a level 0 in his balanced scorecard approach, which is labeled as indicators. This level is particularly relevant to the meetings and events industry in light of contracted hotel room block requirements; budgeted revenues from attendees, exhibitors and sponsorships; anticipated press coverage and procurement's involvement in corporate meetings and events.

Level Measurement Focus
0 Meeting Statistics and Attendee Demographics Measures meeting statistics such as the scope and volume of meeting attendance, marketing efforts, press coverage and budgetary measures and documents attendee demographic information.
1 Reaction & Planned Action Measures participant satisfaction with the meeting and captures planned actions.
2 Learning Measures changes in knowledge, skills, attitudes, opinions, professional contacts, and/or sales leads acquired due to the meeting.
3 Application Measures changes in behavior back in the workplace due to the knowledge, skills, attitudes, opinions, professional contact, and/or sales leads acquired at the meeting.
4 Business Results Measures changes in business-impact variables due to the meeting.
5 Return on Investment Compares meeting benefits to the costs.

Table 1: Levels of Evaluation for Meetings and Events

Source: Phillips, Jack, Breining, Terri, and Myhill, Monica, Measuring Return on Investment for Meetings and Events, meeting Butterworth-Heinemann 2007

For meetings and events, the chain of impact starts at level 0 since the right attendees for which the meeting was designed and planned must first be present at the meeting and participate. Demographic information can help to identify if the right mix of attendees were present at the meeting.

As with training programs, a successful meeting is dependent upon carefully collected needs assessment data. It is best when a meeting or event defines the target audience and their educational and/or networking needs before planning and designing a program. For example, similar employment positions/roles, levels of industry experience, employer types/categories, leadership roles and workplace challenges will predispose attendees for success at a meeting while attendees outside the target audience may find the content challenging and unrelated to their workplace demands. In addition, similar or complementary demographic groups will find networking easier and likely more rewarding.

Level 2 and 3 have also been expanded to include acquisition of and/or a change in attitudes, opinions and professional contacts as a result of the meeting or event. Company wide meetings, sales kick-off meetings and marketing events are often conducted to change the attendee's attitude or opinion about the meeting host or its policies, products or services. Regarding professional contacts, we can all acknowledge that the people we meet and converse with in the hotel bar after hours or, for us women, in line for the restroom, often make the meeting beneficial and of value to us.

Evaluation and ROI Case Studies on Meetings and Events Needed

In late 2006 to early 2007, Meeting Professionals International and the ROI Institute, Inc. will be co-publishing a case study book featuring ROI calculations and evaluation studies conducted on meetings and events.

I bet that many of you may have done evaluation and ROI work on programs that could be considered a meeting or event. A meeting or event would be defined as a gathering of individuals for the purpose of:

  • Delivering and/or communicating educational content, an idea or message
  • Motivating attendees to purchase a product, support an initiative or achieve a goal/objective
  • Networking among participants to initiate relationships or strengthen existing relationships
  • Determining future goals, strategies, policies or actions by an individual, group or organization
  • Achieving an organization's mission, vision or goal

Case studies are sought from a range of industries, countries, meeting types, and evaluation/ROI perspectives. If you are interested in submitting a case study, please let me know.

Help spread the ROI word and methodology to this sister industry!

2006 ASTD, Alexandria, VA. All rights reserved.