Category Archives: Dataviz for Evaluation

New-ish Charts for Evaluation

You know the drill: Better charts = better communication = better understanding = better decision making. Whether you’re trying to highlight the most important findings, simplify that lengthy report, or just get someone to open your report in the first place, charts can be one of your strongest communication tools.

Ready to move beyond the typical pie chart or line chart? Today I’m covering 4 awesome charts that are under-used (but extremely useful!) in evaluation.

Social Network Maps

Johanna Morariu's map of the #eval13 hashtag

Johanna Morariu’s map of the #eval13 hashtag

Although social network maps aren’t brand new to evaluation (read about them on aea365 here), I had to mention them because I’m still surprised how many evaluators aren’t using social network maps.

Social network maps help you understand relationships between organizations, people, or even conference attendees. But beware – social network maps aren’t for everyone.

Want to create your own? Check out Johanna Morariu’s tutorial on using NodeXL, a free Excel plug-in.

Tree Maps

Tree maps are for hierarchical or nested data, and they’re great for showing part-to-whole patterns. 

Here’s an example from Innovation Network’s State of Evaluation research in which Johanna Morariu, Kat Athanasiades and I examined the proportion of nonprofits demonstrating promising evaluation capacities and behaviors:

Sample treemap from State of Evaluation 2012

Sample treemap from State of Evaluation 2012

(Can you imagine that same data in a bar chart? It just wouldn’t work; all the relationships between nested variables would be lost.)

Want to learn more? Check out Johanna Morariu’s example that breaks down participants’ gender, age, and whether or not they completed a program. 

Dot Plots

Dot plots are similar to bar charts and clustered bar charts (but in many cases, they’re easier to read and a lot less cluttered).

Here’s a 5-minute overview about what dot plots can be used for:

(Better) Bar Charts

And don’t forget about the good ol’ bar chart, your go-to chart for most of your datasets.

But not all bar charts are created equal. It’s no longer acceptable to paste that default draft chart straight  into your report; you should expect to spend a few minutes cleaning up every single chart to improve its labeling and overall readability.

Once you’ve mastered the basic bar chart, try your hand at one of these newer variations, like a diverging stacked bar chart, floating bar chart, or small multiples bar chart. The bar chart’s versatility make it the most essential chart for evaluation.

Have you used any of these charts for evaluation purposes? Are there other new-ish charts you think the evaluation world should be aware of? Please share your ideas with the community!

Four Steps: Social Network Analysis by Twitter Hashtag with NodeXL [Guest post by Johanna Morariu]

Note from Ann: Today’s guest post is from Johanna Morariu, Director of Innovation Network, AEA DVRTIG Chair, and dataviz aficionado.

snaBasic social network analysis is something EVERYONE can do. So let’s try out one social network analysis tool, NodeXL, and take a peek at the Twitter hashtag #eval13.

Using NodeXL (a free Excel plug-in) I will demonstrate step-by-step how to do a basic social network analysis (SNA). SNA is a dataviz approach for data collection, analysis, and reporting. Networks are made up of nodes (often people or organizations) and edges (the relationships or exchanges between nodes). The set of nodes and edges that make up a network form the dataset for SNA. Like other types of data, there are quantitative metrics about networks, for example, the overall size and density of the network.

There are four basic steps to creating a social network map in NodeXL: get NodeXL, open NodeXL, import data, and visualize.

Do you want to explore the #eval13 social network data? Download it here.

Here’s where SNA gets fun—there is a lot of value in visually analyzing the network. Yes, your brain can provide incredible insight to the analysis process. In my evaluation consulting experience, the partners I have worked with have consistently benefited more from the exploratory, visual analysis they have benefited from reviewing the quantitative metrics. Sure, it is important to know things like how many people are in the network, how dense the relationships are, and other key stats. But for real-world applications, it is often more important to examine how pivotal players relate to each other relative to the overall goals they are trying to achieve.

So here’s your challenge—what do you learn from analyzing the #eval13 social network data? Share your visualizations and your findings!

Dataviz Challenge #6: Unit Charts

Lately I’ve been feeling let down by summary statistics: the min and max, mean and median, quartiles and standard deviation… They do their job well enough. Summary statistics tell a summary. An aggregate story, bringing all the messy scores together into some sort of cohesion. We grab the averages and stick them in bar charts.

But sometimes we don’t want to summarize, we want to highlight the variety in scores and remind readers that the chart is actually made up of individual people, not just the mean or median. Long live the messy data, the dispersion, the distribution, the spread!

unit_chart_1

I could tell you a few descriptive statistics: min = 26%, max = 100%, Q1 = 64%, Q3 = 83%, median = 74%, mean = 73%, standard deviation = 15%. Or, I could show you the spread in this unit-chart-turned-histogram.

Unit charts are not your new go-to chart. They do not replace bar charts. They are not appropriate for all datasets. They’re best for those few moments when you choose to emphasize individual units of data. A unit could be 1 person, or 10 people, or 1 school, and so on. Units can be represented in circles or squares or triangles. Units can be stacked on top of each other to form a histogram, or they can be plotted along a line.

The dataviz challenge: Re-create the chart in in Excel, R, or some other free software program. Then, tweet a screenshot to @annkemeryBonus: Make a unit chart for your own data. Or, do you emphasize individual differences with other chart types? Share your ideas with the community!

The prize for playing: A professional development opportunity and bragging rights. I’ll post the how-to guide in a couple weeks.

Want to learn more? I’m presenting about charting techniques at the American Evaluation Association’s annual conference on Thursday, October 17, 2013 at 11am in Washington, DC. Hope to see you there!

Dataviz Challenge #5: The Answers!

I’ve been in love with diverging stacked bar charts since I saw Joe Mako’s submission to Cole Nussbaumer’s dataviz challenge last December. Joe made this contest-winning chart. But in Tableau! The amazing but expensive software!

Could I ever create one in Excel?!

Yes! Luckily I’d learned about the Values in Reverse Order feature from Stephanie Evergreen. With Joe’s inspiration and Stephanie’s strategy, I started making these beauties for myself in Excel.

I wanted to share the chart secrets with all of you, so last month, I challenged readers to re-create a diverging stacked bar chart like this one:

diverging_before-after

It looks like I’m not the only one who loves diverging stacked bar charts. Congratulations to the 12 contestants! In order of submission, they are:

Most contestants seized the opportunity to use their own datasets and made adjustments as needed. For example, Sheila’s dataset fit a traditional stacked bar chart better than a diverging stacked bar chart, and Anjie needed to display cut-off scores.

So how do you make these diverging stacked bar charts, anyways?! There are at least two strategies: Either a) create two separate charts, a strategy demonstrated in previous posts like this one, or b) use floating bars, a strategy demonstrated in previous posts like this one. Stephanie Evergreen blogged about strategy B a few weeks ago and her explanation is pretty awesome, so I’m going to focus on strategy A today.

Here’s a slideshow about the two-charts-in-one strategy. Enjoy!

Bonus! Download my Excel file.

Want to learn more? I’ll be sharing my top 5 must-have chart strategies at the American Evaluation Association’s annual conference on Thursday, October 17.

For discussion: Nearly all of the contestants requested friendly feedback on their graphs. In most cases, contestants were trying these charts for the first time and thinking about whether or not these charts could be adapted for their datasets. What do you think?

Dataviz Challenge #5: Diverging Stacked Bar Chart

Last week I shared strategies for improving any chart’s colors. One of the examples was a diverging stacked bar chart:

diverging_before-afterI love stacked bar charts because they’re pretty versatile, and because they’re a great chart for lots of evaluation and survey data. In my example, I looked at the percentage of survey respondents who selected strongly agree, agree, disagree, and strongly disagree on a satisfaction survey. But stacked bar charts can be used in dozens of different ways.

So when can you use a stacked bar chart?

  • Stacked bar charts are for part-to-whole relationships. Use them when you want readers to see both a) one portion of the bar and b) compare that piece to the entire bar.
  • Stacked bar charts can be used for tallies or percentages. A tally is the number of actual people, dollars, etc. For example, a nonprofit could display their funding sources in a stacked bar chart – $100K from a foundation, $200K from a government grant, and so on. The reader can see the size of each grant as well as how the grants stack up as a whole.
  • Stacked bar charts can be used for nominal, ordinal, or diverging data. An example of nominal data is the racial/ethnic categories of your survey respondents. Ordinal data has a natural order – from best to worst, most to least, something to nothing – like my example. Diverging data is a subtype of ordinal data – when the categories are polar opposites and there’s a clear middle ground or neutral zone in between two ends.

And when can you use a diverging stacked bar chart? Diverging stacked bar charts are just for comparing several sets of ordinal data at once. They work best when you’ve got an even number of categories (like the 4 survey choices). Then, you can easily line up the midpoints along an invisible y-axis.

The dataviz challenge: Re-create the “after” version in Excel, R, or some other free software program. When you’re finished, email me or tweet a screenshot to @annkemery.

Bonus! 1) Adapt this chart for own data. Think outside the box! 2) There are at least two different ways to create diverging stacked bar charts in Excel. Can you find more than one solution? (And these charts are so awesome that you’ll even see one solution on Stephanie Evergreen’s blog next week!) 3) Don’t forget to use custom colors!

The prize for playing: Beer or coffee, my treat, the next time you’re in DC; a professional development opportunity; and bragging rights.

I’ll post the how-to guide in 3 weeks, on September 6. Happy charting!