Tag Archives: #eval12

The best Ignite presentations are when the presenter stumbles over words [Guest post by Kevin Flora]

Kevin Flora from edmatics.org

Kevin Flora is an evaluator and blogger at edmatics.org who watched, recorded, edited, and uploaded all 56 Ignite sessions from the 2012 AEA conference.

Ignite sessions… a presentation format started by O’Reilly that I thought would never stick around. The more I conduct my own presentations, I feel as though the audience engagement and personal enthusiasm is a direct reflection of my content. If this theory holds true, then the Ignite format should be more prevalent due to its ease of producing laughs and forcing the presenter to stay on top of their information. Essentially, there are 20 slides. Each slide advances automatically every 15 seconds whether the presenter is ready or not. Are you doing the math? Yes, it’s a 5-minute presentation.

The one thing I love about this format is the first-time presenter! When initially signing up, the thought is, “How hard could this be? Five minutes? That’s easy enough.” Well… I have found that it takes just as long to prepare for these 5 minutes as it does a 45-minute presentation, if not longer. Everyone wants to look at notes or the presenter view on the PowerPoint screen, but the best presentations are when the presenter stumbles over words, gets behind (or ahead) on their timing, and forgets why he/she used a particular image in their slide deck. I have heard that the more Ignite presentations an individual does, the less interesting they are to the audience because of the ability to almost perfect the structure. These are meant to be fun, with pictures, stories, and yes… screw-ups once and awhile.

Ignite presentations can be used for multiple purposes. My favorite Ignite session was that of Michael Szanyi at the 2012 American Evaluation Association (AEA) conference. His use of interpretive dance brought the data visualization and reporting topical interest group (DVR TIG) to their feet and moved some to tears. Szanyi produced an unrivaled passion for how his form of art and expression should be used in visualizing data. Szanyi not only memorized his slides, but the timing, movement, and slide descriptions. After seeing his 5-minute production, I saw where the future of Ignite presentations and evaluation was headed. This glimpse of our future was a sight to see. Here is Szanyi’s presentation:

After watching 56 presentations, it is difficult to find a comparison to Szanyi’s performance, so I will mention a couple of other neat ideas. The DVR TIG conducted their entire business meeting with the 5-minute presentation format (watch them all here), milking cows was related to strategic learning (here), and an improv Ignite was attempted (which made for a hilarious 5 minutes. Thank you Chris Lysy). Check out Chris Lysy’s improv Ignite here:

The Ignite format is both interesting and fun… informative, but short… and effectively cultivates an atmosphere conducive to questions, collaboration, and further discussion on certain topics. All 2012 AEA Conference Ignite videos can be found on the AEA YouTube channel.

Connect with Kevin Flora through his blog at www.edmatics.org or @edmatics on Twitter!

Come meet me at #eval12!

Greetings evaluators! Are you attending the American Evaluation Association’s conference in Minneapolis? If so, I hope we can meet. Here’s where I’ll be during the conference:

Wednesday, October 24

Thursday, October 25

Friday, October 26

Saturday, October 27

Conference Tips for Newbie Evaluators

Wear that nametag like a rockstar

Are you getting excited for the American Evaluation Association’s conference next week in Minneapolis?

This week I’m sharing conference tips for newbie evaluators and first-time conference attendees. While many of these ideas will be obvious for experienced evaluators, these ideas won’t be obvious for your coworkers and mentees who are attending one of their first conferences. Please consider sharing these tips, along with your own advice, with the newbie evaluators in your office.

Before the Conference

Here’s what newbie evaluators and first-time conference attendees should do before an evaluation conference:

  • Assess your motivations for attending the conference.  Are you actively job-searching and want to conduct informational interviews during the conference? Are you considering starting your own consulting business and want to chat with independent consultants? Are you trying to meet others with similar interests so you can partner on future projects?
  • Start using Twitter and LinkedIn to meet people and figure out who you want to meet face-to-face at the conference.
  • Pack an extra casual outfit and an extra business outfit. Multi-day conferences tend to get more casual over time; that is, evaluators seem to wear suits the first day, then business casual for a few days, and nice jeans on the last day. Exception: If you’re presenting, save your favorite, nicest outfit for the day you’re presenting.
  • Don’t forget your electronics. It’s easy to buy a replacement toothbrush from the hotel’s convenience store, but nearly impossible to find a replacement charger for your laptop or phone.
  • Bring cash for taxis, tolls, tips, and parking meters. You’ll also need small bills ($1 and $5 bills) for group dinners. (Ever try to split a check between 20 evaluators with 20 different credit cards? It takes longer to pay the bill than eat dinner!) I usually pack $100 in small bills.
  • Find out what you’ll be reimbursed for. For meals: Does your organization use a per diem system or a reimbursement system? For alcohol: Alcohol’s typically not covered. For hotel internet access: Unless you’re working during the conference to meet a client deadline, your organization probably won’t pay that extra $10/day for internet. Instead, scope out the free wifi hotspots in the convention center or conference hotel. For airfare: Is there a limit on your airfare? Will your company reimburse you for baggage fees? For ground transportation: Will your organization reimburse you for taxis to/from the airport, or just shuttle buses? For your timesheet: Will your organization provide a charge code for the entire conference, or just the first few days? It’s not uncommon to work “on your own” on the last day of a conference, especially if it falls on a Saturday.
  • Find out which organizations will be represented at the conference. Even if you’re not job-hunting now, start brainstorming who you’ll want to work with in 5, 10, or 20 years. I like to skim through the back of the conference program.

During the Conference

Here’s what newbie evaluators and first-time conference attendees should do during an evaluation conference:

  • Iron your clothes and hang them in your closet as soon as you check-in to your hotel. Multi-day conferences are exhausting, and you’ll need all the sleep you can get over the next few days. I can’t tell you how many times I’ve overslept and ran to sessions wearing a wrinkled pair of pants…
  • Keep your conference objectives in mind. Take charge and get what you came for! Networking won’t happen unless you initiate it.
  • Don’t work during the conference, even if it means working weekends beforehand to clear your schedule. If you’re presenting, don’t work on your slides during the conference (again, even if it means working weekends beforehand to finalize your presentation). Conference time is precious and is better spent learning and talking.
  • That being said… Make time for self-care. Have quiet time in your hotel room, go to the gym, or take a walk outside.
  • Skip a session or two for networking. My most valuable lessons and tips about evaluation have come from casual conversations with other evaluators, not from formal trainings.
  • Trade business cards and jot down notes about each person to guarantee that you’ll remember them a few years from now (e.g. “Knows my friend Joe; lives in Baltimore but visits DC often; schedule coffee together.”)
  • Tweet! Use the conference’s official hashtag (#eval12 for the next American Evaluation Association conference and #eers13 for the next Eastern Evaluation Research Society conference).
  • Attend a Topical Interest Group (TIG) business meeting at the American Evaluation Association conference. This is a great way to meet current and up-and-coming leaders in the field.
  • Attend at least one session each on: 1) a brand new topic (to broaden your understanding of the field); 2) a beginner-level topic (to meet other newbies, and to feel more confident in what you already know); and 3) an advanced topic (to give yourself a reality check about what you don’t know).
  • Ask questions during sessions. Don’t doubt their project, methods, or findings, or you’ll get a reputation for being an annoying audience member. I recommend straightforward clarification questions: “This is really interesting information, thank you. I’m new to this concept/project/approach. Could you give us a little more background about xyz?”
  • Talk to presenters after their presentation. Don’t feel pressured to develop an elevator pitch or be an expert about their background or topic. Try this: “I learned a lot from your presentation, thank you. Where can I learn more about your work? Do you/your company have a website, blog, white papers, handouts, etc.? Do you ever visit DC? If so, would you like to have lunch the next time you’re in town?”
  • Don’t arrive to sessions late or leave early. It’s bad manners and distracting to the presenters.
  • Don’t worry about taking notes. Most handouts and slides will be available online right after the conference. My “notes” are my 140-character tweets.
  • Wear that nametag like a rock star.
  • And if you’re job-hunting… Print 100 copies of your resume and post them to the jobs board. Don’t share your resume with people you’re meeting for the first time unless they ask for it first.

After the Conference

Here’s what newbie evaluators and first-time conference attendees should do after an evaluation conference:

  • Connect with everyone on Twitter and with a few people on LinkedIn.
  • Send personalized, casual emails to 5-10 people you met. I’ve actually received emails with citations – “Hi Ann, I liked hearing about your work, it coincides with Smith (2010), who found a statistically significant difference between x and y. That is, until Miller (2011) employed a larger sample and found xyz….” Please don’t send anyone a literature review! Instead, write something like this: “Hi Ann, I liked hearing about your work. I’m going to apply xyz skill in my next project. Let me know if you’re ever in DC. I’d enjoy learning more over lunch sometime.”
  • Schedule coffee, lunch, and happy hours with evaluators from your city.
  • Share what you learned! Write on your personal blog, your organization’s blog, and/or the aea365 blog. Tweet. Lead a brown bag for your teammates. Bonus points: Explain what you learned to a non-evaluator (like a parent, roommate or significant other) without putting them to sleep. Translating interesting ideas from evaluationese into lay language is a skill that improves with time.

Have additional tips and tricks to share with newbie evaluators and first-time conference attendees? Please share your ideas below.

Thanks, Ann Emery


Additional Resources:

Defining Complex Ecologies: 1 Photo, 25 Words

As Stephanie Evergreen wrote,

“This year, the American Evaluation Association is loaded with a ton of great stuff… I’m also really excited to see the closing session on Saturday, because AEA President Rodney Hopson is pulling together something amazing.

The theme of the conference this year is Evaluation in Complex Ecologies: Relationships, Responsibilities, Relevance. What in the heck does that mean, right? Well, this is your chance to help define it. Take a picture, wrap it in 25 words, and send it to AEA2012closingphotos@gmail.com before noon CT on Thursday, October 25. The best photos will be chosen and featured in the closing session on Saturday October 27, 2012 at 4:30 pm. Dudes, there will be prizes.

If it isn’t obvious to you already, what’s so so cool about this project is that it is an attempt to let people get visual with concepts that are pretty darn abstract. We, serious and academic researchers and evaluators, often shy away from exploring a bit of creativity. This is an officially sanctioned license to go play (even for those of you who aren’t headed to the conference this year – you can still participate).”

Although I was tempted to submit something like this, here’s my submission:

Internal evaluator seeks stakeholder buy-in and learning culture. Willing to wear hairnets, plastic gloves, and serve tortilla chips to 500+ children during organization’s Thanksgiving dinner.

And the countdown begins: 19 days until #eval12

When I realized that the American Evaluation Association’s conference is only 19 days away:


When I checked the schedule and realized the sessions start at 7am:


When I’m already flooded with work before the conference:


When I still have to finish a few presentations before the conference:


When I thought, hey, it’s not so bad, because this is how I felt at my first evaluation conference:

When I remembered there would be be plenty of happy hours at the conference:


And when I remembered I’d get to see all my favorite evaluators in one place: