Monday, May 6, 2013

The Ten Commandments of Survey Writing


Ah, surveys. They're used everywhere--election polls, censuses, major corporations, even "mom and pop" stores are doing them. It seems like everyone wants to ask other people some questions to get feedback. And everyone seems to think that anyone can write a survey. How hard could it be? Just write down some questions and see what kind of answers you get, right?
Sadly, that is not the case. Survey writing is actually a specific skill. The reason for that is, if you want the data you get in return to be accurate enough that you can actually do something with it, it is important to format the survey as a whole and all of its individual questions in the right way. Otherwise, you could run into problems like different folks interpreting questions/answers differently (giving you inconsistent results), becoming confused and quitting the survey (lowering your response rate), or becoming nervous and not answering truthfully (or completely misunderstanding the question and answering incorrectly). It's difficult to know when you get data back if they are correct or not (because you can't actually compare it to what's in people's heads), but you can reduce the potential for error by following some basic rules.
1) Thou shalt format the survey as a funnel.
The respondents are not as familiar with the subject matter at the beginning of the survey as they are at the end, and they are typically hesitant to answer difficult questions or share personal things immediately in the relationship they have with you, the researcher. So start out with more broad, easy questions to get them introduced to the topic. Court them. More difficult or lengthy questions like grids or multi-choice questions should be near the end. And demographics, being very personal in nature, should always be optional, and should (almost) always be at the end (exception--if a demographic is needed as a screener, but that's for another blog entry).
2) Thou shalt utilize skip patterns and page breaks correctly (for online surveys)
Having surveys online gives a lot more options that aren't possible otherwise, like using skip patterns and page breaks. Take advantage of these, and use them correctly! Spread the survey out over multiple pages because having the entire questionnaire on one page can be too daunting or overwhelming. If you want some people to answer a particular question but not other people, program it so that only those people see that question, rather than collecting data from everyone which may be confusing to some who find the question not applicable. Never let the respondent guess what they are supposed to do if you can avoid it!
3) Thou shalt use common or layman's language
It's tempting to assume everyone knows what you're talking about when you use certain words or phrases. But be aware that a) not everyone is as educated as you are, b) some of your words or terms may be specific to your industry, so even though you think everyone knows it, it may just seem that way from your perspective and c) some words or phrases may have different meanings to different people. When in doubt, always clarify what you mean.
4) Thou shalt avoid leading or loaded questions
Never give the slightest hint that you anticipate or guess how the respondent might answer. You must remain completely neutral! The way you phrase a question must indicate that any answer (and any opinion) is "correct." Bad idea: "So be honest, how drunk did you really get on Saturday night?" Good idea: "Which option best describes how many drinks you had on Saturday night?" The good question here not only asks in a non-leading way, but it also asks for a specific answer, and not a relative one--that means that one person will interpret it the same way as the next person. Which leads to the next commandment....
5) Thou shalt be as specific as possible
Without being specific, your respondents might all be answering different questions. If you ask, "do you like oatmeal?", your respondents might wonder if you want to know whether they like the taste, the texture, the affordability or value, the variety available, the health benefits, or something else. Never assume they know what you mean--always be specific and remove all doubt.
6) Thou shalt live by the rules of MECE
What does MECE mean? Write this down, because you're about to learn your fact of the day, and if you remember only one thing from this article, this should be it. MECE stands for "Mutually Exclusive, Collectively Exhaustive." Repeat that to yourself--I promise, it's actually important in areas outside of survey writing, too. This should be applied to both questions and answer choices. You can't ask "Do you think this event was affordable and informative?" Those are actually two different questions! It's also very important to be MECE in answer choices (and this is a common mistake I see all the time). Try to find the problem with the following question:
How many children do you have?
-0
-1 to 2
-2 to 3
-3 to 5
-5 or more
See it? The responses overlap! These are not mutually exclusive. If I have 2, 3, or 5 children, I'm not sure which answer to choose. This gives you very muddy data. Try to find the problem with the next question:
Please describe your area of specialization (choose one):
-Finance
-Marketing and Statistics
-Data analysis
-Graphic Design
Oh dear. These choices are not mutually exclusive. What if I specialize in Statistics and Data Analysis? What if I specialize in Marketing, but not Statistics? I don't know which to choose! Also, this list is not collectively exhaustive. It's a very short list for a very broad question. I could specialize in accounting, management, negotiations, sales, customer service, and any number of other things and still not have an answer that suits me. Aim to cover about 90% of the possible responses, and include an "Other" selection for things you might have missed. If you end up with a large amount of people who choose "Other," you probably didn't do a good job including an exhaustive list. If your exhaustive list is too long and burdensome, your question probably is not specific enough.
7) Thou shalt use balanced lists
The easy side of this is to say a question like, "How satisfied or dissatisfied were you with the service?" would have an equal number of responses ranging from strongly dissatisfied to strongly satisfied, with a neutral response in the middle. Easy, right? It gets trickier when you get to questions with weighted answers, like income. Consider the following question:
What was your total pre-tax household income in 2012?
-$0-$49,999
-$50,000-$99,999
-$100,000-$150,000
-$150,000-$200,000
First of all, I should point out that the question was worded specifically enough, and the answer choices were mutually exclusive. Good job. The problem is, if you have any awareness of household income in the United States, you know that most of the answers will come lumped in the first two options, and the last two options will not have many responses at all. While it makes sense for the answer ranges to be equal (in this case, about $50K), you can make reasonable exceptions to that, and you also should have some idea (when possible) what your ranges of responses might be in order to format accordingly. In this case, you can consult the latest census results. Let's try that again:
What was your total pre-tax household income in 2012?
-Less than $30,000
-$30,000-$49,999
-$50,000-$69,999
-$70,000-$89,999
-$90,000-$109,999
-$110,000 or more
Bear in mind that there is no one right way to ask for income. If my survey was going out to a very affluent group of people, my response choices would look very different. Also note that the response choices are not equal--the first bucket is $30K, the groups in the middle are only a $20K range, and the range that is above $110K in the last bucket is going to be even larger. But if I know that the majority of my responses are going to land somewhere in the middle, and I've spaced out the ranges in the middle enough that I can do the analysis that I need to do, then this format is appropriate and much better.
8) Thou shalt use caution with complex questions
Questions like open-ended response, multi-choice grids, ratings or rankings etc. (apologies if you don't know what those are--maybe that will be another blog post), are laborious in that the respondent needs to think harder about their answers, and they take longer to complete. You should be careful to only include a reasonable number of these in the survey. If you over-burden the respondent, they might either quit the survey, or just fill in bubbles without even reading the question! That's not good...
9) Thou shalt avoid "nice to know" questions
It is VERY tempting to get greedy when we're collecting data. If we have someone's captive attention, we want to keep questioning them! Ask them all sorts of things! Just keep going and who knows, maybe something brilliant will come out of it! Whoa there, tiger, don't get too excited. More is definitely not better when it comes to surveys. The longer the survey gets, the more tired or annoyed the respondents become at the end, and the more likely they are to become fatigued and either drop out, or give faulty answers. You should have in mind exactly what kind of analysis you are going to perform, and what questions you need for that analysis. Ask those things--no more, no less.
10) Thou shalt mind the overall length of the questionnaire
I won't go into detail on this because I've already said it (see the irony?). But it bears repeating.

Thursday, April 4, 2013

Tardy to Tweet, but I'm No Twit

I know, I know, I'm a little late getting on this bandwagon. I have used Twitter before as a researcher, and it has been a great tool for tracking trends and searching for information. But I intentionally stopped short of joining it personally up until now because it always seemed a bit narcissistic. Facebook can be great to keep in touch with people you actually know, but to broadcast your thoughts to the entire world and try to get more "followers" out of people you don't actually know? I'm not sure it's possible to create a tool more driven by narcissism.

In the last couple of months that I have had to play around with Twitter, though, while it is true that narcissism is alive and well in some users (and there seems to be almost a game among many to see how many followers they can get), I have actually come to like it and appreciate it for reasons I did not quite realize before I hopped on the bandwagon.

1.  Sharing content. This reason I was already aware of through previous research work that I've done, but it's quite different to see it in action. It's overwhelming the amounts and variety of content that is available on Twitter, and it spans as far as your imagination can reach. I can see how it would be possible to obsess over watching your Twitter feed constantly over hours at a time, but I've avoided that so far and hope I never reach that point.
2.  Making new connections.  Like many people, I would imagine, I utilize Facebook mainly for personal connections, and LinkedIn mainly for professional connections. But in both cases, I don't often interact with people I don't know. In LinkedIn I may get contacted from time to time by headhunters and such, but when I share information there, I highly doubt many people pay attention--even those I am actually connected to. But with Twitter, the more valuable the content that I share and the more ways I find to share that content with appropriate audiences directly and engage with key people in my industry, the more exposure I get within my industry and the more valuable connections I am able to make with my peers. By sharing one article, I got myself featured in one industry newsletter's website for the day, and while that is a small accomplishment, it astounded me by the power and possibility that Twitter has.
3.  Building a personal/professional brand.  I have always believed in the importance of making a name for yourself and developing a digital brand. This blog is the result of that, and even though I don't find the time to update it as often as I'd like, it is an outlet I keep for sharing my thoughts and showing the digital world who I am. There are many outlets for digital branding, and Twitter is another one. The difference is, whereas it is difficult to find time to write a blog entry, it is quite easy to throw something out in 140 characters, and I find it a good way to show a little bit of both my personal and professional persona, as a good businesswoman can be her true self in both capacities, and someone is much more interesting to do business with if you get to know him or her a little bit on a more personal level.

These are just a few of my initial thoughts on Twitter. I am sure I have only scratched the surface on what it is capable of (especially since this only really covers the individual level and not the business/corporate brand level), so I look forward to exploring it a bit more.

P.S. If you haven't already found me on Twitter, you can check me out @beckybmw

Wednesday, February 27, 2013

What's your dream job?

The other day in an interview, someone asked me what would be my dream job. It's a common question, and one I know exactly how to answer in an interview.  But when the moment came that I realized that the job I was describing actually was the job I was interviewing for, I wondered if this job really was that great, or if it was time that I re-visited what my idea of a dream job could be, and think about more of the finer details.

This is a question that I've thought about often in my career, but I've gotten to a point where my dream job could be reachable soon, so it actually is time to start ironing out specifics.

I think we've all had a dream position and/or a dream company in mind.  But have we thought about all the details a dream job would entail? What would a dream job look like according to level of company influence, size of company, company culture, work style, work environment, location, industry, etc, etc?

It's a fun thing to dream about, but it's also a good practical exercise. Once you identify exactly what it is that you want, you can see the differences between what you want and where you currently are in your career. Then you can think about what steps you might need to take to get to the dream.

I'd recommend repeating this exercise every few years, both to see if the dream has changed at all, and to monitor your progress toward the goal. Not to mention, it's also just fun and inspiring to daydream a little bit now and then, to help you believe that the thing that you want is out there, and you can make it happen.

Happy dreams!

Monday, February 4, 2013

Super Bowl XLVII Commercials Review!

Here we go again, it's time for my annual post reviewing the Super Bowl commercials.  If you're joining me for the first time this year, this is something I do every year (except I missed last year--sorry about that).  I, like so many people, usually watch the Super Bowl just for the commercials (pro football? couldn't give a flying fart....), and while many people throw around their one or two favorites, I enjoy taking a bit more time to dissect the commercials of the year.  So I take notes on every last one, pick out my favorites, and add some commentary on my choices.  If you'd like to go back in time and catch up, you can find my posts about Super Bowl Ad History, Super Bowl XLIV, and Super Bowl XLV.

This year's commercials overall were much better quality than last year's.  Although I did not write up a review last year, I do remember that not very many of them stood out to me, and I certainly cannot remember any of them now (which says a lot).  A few overall interesting observations: one, this year's ads were not nearly as exploitative and overly-sexual in nature as the usual (exception: Go Daddy).  An interesting and welcome change of pace, in my opinion.  Two, while Doritos typically offers 3 or 4 spots during the game, all incredibly witty and entertaining, this year they only had one, which was kind of a dud in my book.

Alright, let's get right to it!  My top 5 of the year are:

5.  Taco Bell--"Viva Young"


Not everyone in my house got this one, but the track playing is fun.'s "We Are Young," but sung in Spanish--Sort of a "Taco Bell" joke, if you will.  The song goes well with the video of some folks sneaking out of the retirement home for a little fun out on the town.  The theme of living forever young goes well with the Taco Bell brand, and even though it wasn't my house's favorite, it made me smile.

4.  Best Buy--"Questioning Amy Poehler"


This holds a soft spot in my heart because the spot is for a retailer. But in addition, there is no denying how awesome Amy Poehler is. And, not only is this ad clever and funny, but it really sets up Best Buy as a service provider--one who can answer all those questions.  In an age when Best Buy is fighting off the "showroom" phenomenon with their business being threatened by the internet, it's an important leg to stand on.

3.  Coca Cola--"See the World Differently"

>

This commercial actually isn't new--it came out last June, although if you're like me and have been a little bit out of the commercial loop this year, this may have been your first time seeing it.  (Also because it's been around a while, the internet police have already snatched it away from a lot of places online, it was a lot harder to find a video that I could share.  If the above embed doesn't work, try this link for the source).  And yet, even though it was an older commerical, it still stood out to me.  I have always loved the sense of optimism that is a theme in Coca-Cola's ads, and it is always a bright spot in a string of Super Bowl commercials that feature beer, sex, slutty girls, lazy guys, and other content that just makes me roll my eyes.  Perhaps that is one of the reasons why Coca Cola's brand is the biggest brand of the world.  Perhaps that is why they always have spots in my own personal top 5.  Well, whatever.  I just liked it.


2.  Oreo--"Silent Fight"


The internet BLEW. UP. after this ad aired, and so did my house.  We loved this.  The debate between cream or cookie is pretty straight-forward when it comes to Oreos (BTW, I'm on team Cookie), but the delivery of a whisper is clever and makes you pay attention to it amidst all the other commercial clutter.  Loved the extremes that it develops into.

1.  Budweiser--"Brotherhood"


*sniff* I always find it amazing how Budweiser can manage to create an entire mini-drama that is touching, heartwarming, and a complete story, all in a short clip that's just over a minute long.  This one was a standout tonight in the way it did all those things, and still stuck to strong brand position that's been around for years (and yet has not gotten old or stale!).  Good job, Budweiser.

Honorable mentions:
  • M&M's "Anything for Love" - They took the classic (?) Meatloaf song and spun it into the drama that the red M&M faces in his relationship with a human lady, and where he draws the line.  Cute.
  • Samsung "The Next Big Thing" - Paul Rudd and Seth Rogan are invited to brainstorm ways for Samsung to advertise the next big thing.  Their ideas range from stereotypical Super Bowl commercial fare to quirky weird oddities to things that can be found in the very ad they are featured in.  I loved the clever plays, like "If you get Lebron James, you won't need anyone else..."
  • Jeep "Coming Home" - Featuring Oprah's voiceover, this was a tribute to our troops.  I loved the idea of Jeep saluting the troops, and using Oprah to read the script was a bold statement.  It was just too long and somewhat repetitive to make it in my top 5.
  • Dodge RAM "God Made a Farmer" - Beautiful nod to all the amazing qualities of our country's farmers (who of course, get it all done with their Dodge trucks). Again, a bit lengthy for me, but I loved the spot, and it was a good brand fit.
Duds:
  •  Budweiser Black Crown - There were a couple of these spots, virtually identical, and very beer commercial cliche--sexy people drinking beer at a party. Seems like they are introducing a new product that is supposed to compete in a premium market, but any premium beer drinker would laugh at the idea of "Budweiser" being considered premium.  Maybe they should have thought more carefully about using the Budweiser name for that.
  • Go Daddy - They nearly always make my dud list, and while I do give them credit for making an ad that everyone will be talking about the next day (and the "shock and awe" factor is pretty much what they always stand for), this one really pushed the envelope even more than usual.  Not in a good way, either.  I didn't mind the fact that the hot girl was making out with a geek on principle, but I didn't really need to hear the detailed saliva-swapping audio of such an encounter.
  • Subway - What's that?  Jarred's anniversary, lots of famous people who can't pronounce February or FebruANY or whatever? Meh, forgettable.  Nice try, though, I guess.
  • E*Trade - I know that the talking baby is party of their brand legacy now and maybe I'm just going to have to accept it.  I just hate that thing.
  • Pistachios - Crackin' Gangnam Style?  Oh please.
 Until next year!

Wednesday, January 2, 2013

New Year, New Perspective

Happy New Year!

I'm not normally a person who does resolutions and such for New Years--my general belief is that I can be motivated to make a change in my life at any time of the year, and I take advantage of that when the motivation is pure and strong, not when it is dictated by a holiday.  However, perhaps because my life is currently at a bit of a crossroads, I have found myself recently reflecting on a few things and thought it would be good to write them down (if for no one else other than myself).

First, I've thought about what has happened in the past year and how I have grown.  Since I have worked in very fast-paced industries in the past, I've always been used to frequent and rapid change.  But 2012 has definitely shown me how to roll with the punches in my personal life, as well.  People always say, "don't sweat the small stuff," and we all believe that we live by that rule.  But usually what happens is we tell ourselves that small things don't bother us, and secretly they fester under the surface and make us unhappy.  This year I think I've made more progress on really living that mantra.  This year I was laid off along with 40 or so other colleagues in a company restructuring, and although I understand very well my colleagues' desire to lash out against said company with verbal slander, I just did not find it productive for myself since there was nothing I could have done to change the situation, and I needed to move on with my life.  That's a big event, too--I've found that the small things roll off my back fairly easily now as well, without even much thought.  I think in past years I have told myself that things should not bother me, but the reality was that they did.  In a sense, we can't control what bothers us and what doesn't, at least in the short-term.  But perhaps between all the times I told myself that things shouldn't bother me, and going through a period when a lot of big stuff happened, I have gained that deep-seeded perspective that if there isn't anything I can do about a situation, it isn't worth getting upset or stressed-out over.  I think it's important that I recognize this change in myself and be grateful, before I launch into all the things I want to change.

So, about that.  The coming year is going to present a lot of changes for me, of that I am sure.  I do firmly believe that I will be in another job soon (it just remains to be seen where it will be).  And regardless of where that job will be, I will also have a new place to live soon.  I have to recognize that all of these changes afford me the ability to "start fresh," set a new routine, and make my life into what I want it to be.  Now is the time for me to decide what that is.  A few things I want to change:
  1. It's okay to be a little selfish.  I've thought about others my entire life.  Practically my entire existence has been about making others happy, trying to make others like me, and doing the right thing for everyone.  While this is admirable and I will always continue this to a degree, I've found that balance is necessary so that others don't take advantage of me.  Maybe this is a little bit of the East Coast rubbing off on me, where everyone only thinks about "number 1" and if I am always thinking about others, I always lose.  I'm not going to lose anymore.  I deserve to live a good life, too.
  2. Get back into volunteering.  Some things will never change, though, and working for my community and for a cause is a big part of who I am.  I've fallen away from it a bit in the past few years as I've dealt with a lot of personal issues, but it's time to start back up again.
  3. Assume nothing.  It is so easy to get into an argument or disagreement or misunderstanding by not saying something because I assume the other person already knows, or by assuming that the other person would act in the same way I would.  They are not mind-readers, just like I am not a mind-reader.  State the obvious--I'll avoid the problems, and if it really is too obvious, we'll both have a laugh over it.
  4. Be grateful.  There will always be terrible things that happen to me in life.  But I get through all of them when I remember that no matter what happens, it can always be worse.  Focusing on the positive things in my life helps adjust my attitude away from dwelling on those terrible things.  I like the idea of waking up every morning and thinking of at least 3 things that make me happy, or that I'm grateful for.  Thinking of happy things is a good way to start every day, don't you think?  It makes a big difference in my attitude for the entire day.
  5. No waiting around for life--life is short.  Since I think I've gotten down the "don't sweat the small stuff" mantra in practice, this is one I'd like to work on as a new long-term thought mantra.  I've lived my life carefully for the most part, and while that can be a good thing in many ways, it may have stifled my ability to take risks or take advantage of opportunities that could end up being great or even life-changing.  I don't want to look back at my life in 20 years and wish I had done more or tried more.  The older I've gotten, the more I've realized that it all moves very fast, and the years I have ahead of me are not infinite.  There's a saying that hit me like a ton of bricks the first time I read it, and I like to remind myself of it often, whenever I catch myself "waiting" for happiness to find me:
“For a long time it seemed to me that life was about to begin – real life. But there was always some obstacle in the way, something to be gotten through first, some unfinished business, time still to be served, a debt to be paid. At last it dawned on me that these obstacles were my life. This perspective has helped me to see there is no way to happiness. Happiness is the way. So treasure every moment you have and remember that time waits for no one. Happiness is a journey, not a destination.” ~Souza

Anyway, that's enough deep philosophy for now.  Good luck to all of you in your goals, whether they are weight loss, quitting smoking, or attitude adjustments (like mine).  

Friday, December 14, 2012

Unemployment--what's that like?

I don't often like to get too personal in this blog, but I thought I'd make an exception to share some of my experiences for this entry.  You see, even though the unemployment rate in recent years has been the highest that most of us currently living have ever seen, I have come to realize that there are still many folks out there who don't know what it's really like to be unemployed and often have words of advice for me that are really unhelpful (and, at times, downright hurtful).  So I thought I'd jot a few words of my own down so that curious readers can get a sense for what it's really like "out there."

First, I should say that I am not "lazy," and neither are most of us who find ourselves temporarily without work (which is one of the stigmas out there).  I dedicate 40 hours a week to my job search, and treat it as my full-time job.  How can I fill up this time, you may ask?  Well, these days, a job isn't just going to fall into my lap, so it's easy to fill up the time with  networking (either going to events or reaching out to my own network, sometimes to inquire about a company and sometimes just to "wave my hands" so I'm a little more top of mind).  I'm also constantly looking for job postings, talking to recruiters and headhunters, attending webinars (I'm working on my PRC certification--one more thing to add to my resume), and reading a LOT of news--I am more aware now of what's going on out in the business world than I usually have time for when I'm working full-time.  I also do interview a lot, so I spend a lot of time doing company research and interview prep.  With all this work that I do, you can see why it would be hurtful when I hear folks say that the unemployed are "not trying hard enough," or are "lazy mooches."

Despite all this hard work, I still put up with a lot of adversity.  Many companies never call me, sometimes surprisingly so (if a company's industry and job description match exactly what I have done in the past, making me perfect for the role).  I take my interactions with headhunters with a grain of salt because, while it might be a decent lead into a company, they ultimately work for the companies, not for me.  And in dealing with the companies themselves, I have found that many processes do not benefit the job-seeker.  Follow-up always takes longer than they say it will (hey, they have a lot going on), the formats of online job applications indicate that some companies appear to be recruiting keywords rather than people, and because of the stiff competition out there, they are (and perhaps can afford to be) very very selective.  More than at any other time I've spent job-searching, companies now are increasingly requiring much more before making any offers--several rounds of interviewing (5 rounds is not uncommon), tests, throwing folks into stressful situations to see how they handle it, looking at work samples, etc.  Some of this is to be expected, as I am further along in my career than I was in my younger days.  But sometimes it does seem like more than that--companies obviously now can afford to be picky, and they do indeed take advantage of that.

All that is just the day to day stress.  There have also been some fascinating experiences that make up the stories I may tell my children someday.  My favorite example is a company that was a great fit for my background--I had worked in the industry before, and the job description basically described me.  I spent a month interviewing with them--I  met with lots of people, and every time I was in the office, they pulled more people into the interview, unplanned ("oh, if you have a few minutes, I'd love for you to meet X").  This is always welcome, and a positive sign.  They had me put together a project plan with 3 scenarios, and present it to them.  When all was said and done, they told me I nailed all the interviews.  But they weren't going to hire me.  Not because there was someone else they liked more--they were going to leave the position open and keep accepting applications.  Why, you may ask?  They decided they were looking for someone who had done the work with no budget.  I wish them all the luck in finding such a person, if it exists, but I wish they hadn't spent a month of my time interviewing me when they would ultimately rule me out based on something in my background that they knew the first time I talked to them.

The worst part about unemployment, however, is the stuff that people don't like to talk about (which I will, because if you know me, you know that I have no problems talking about nearly anything).  Even if we know that the situation is temporary, it is very difficult to not have a "purpose."  No one is expecting me to show up somewhere every morning.  In an American culture where who you are is often measured by what you do for a living and how hard you work, it's dehumanizing to believe that you make no worthwhile contribution--especially when you have to rely on friends and family for help more often than you would like.  If the job search lasts more than a couple of months, you become very sensitive when people ask you, "so, you don't have a job yet?" suggesting that you aren't good enough or have somehow failed.  It hurts even more when it comes from family.  You start to avoid talking to those people.  If you have any hope that you will (eventually) find a job, you still face the stress of the unknown--your life may change drastically, causing you to move, perhaps across the country, and you have no way to prepare for it because you don't know when it might happen or what the circumstances will be.  If you're lucky enough to receive unemployment benefits, you still have a very limited budget, and may worry about paying all your bills.  You have to turn down a lot of invitations from friends because it just isn't in your budget anymore, and may be embarrassed to say why because you don't like to talk about money.  Sometimes that means you don't see your friends as often.  You feel depressed, and if you already had some sort of clinical depression, the situation is worsened (although you are still criticized by others who say you should "be more positive," or "stop being depressed," when they obviously don't understand what real depression is).  And despite all this stress that you go through worrying about your future and your livelihood, you still  have to appear in great spirits to the companies you talk to because one hint of negativity or one slip-up in even the smallest way, and they can turn you away.  Because they can afford to be picky.

Why am I sharing all this with you?  Why get so personal with my peers, my mentors, and anyone else who might read my blog? (okay, maybe I'm too optimistic about my readership--I'm not sure even my mom reads my blog).  It's because I believe, in all aspects of life, that the world is a better place when we understand each other.  My unemployment experience is not going to be the same as all those who are unemployed, but I can guarantee that we're all fighting a tough battle.  Be kind to us.  Instead of saying something like, "so you don't have a job yet?", try simply saying, "how are you doing?" and don't be shocked if we let a lot of horror stories spill out.  We don't have a lot of people to talk to.  Instead of inviting us to your birthday party at an expensive restaurant, tell us that you'd like to see us, and suggest something we can do together that won't make us worry about money.  And forgive us if we haven't been ourselves lately.  We're dealing with a lot.

Best wishes to all of you, and thanks for reading all the way to the end.  That last part is the most important.

Thursday, October 25, 2012

Hiring: How's it Hanging?

Whichever side of the hiring process I've been on, in the last several years I have noticed some glaring problems in the way recruiting/hiring has changed.  Certainly with the problems in the economy, many HR departments have been looking for ways to be more efficient.  Depending on the position, they may be facing hundreds (or even thousands) of applicants per open position, and they simply do not have the staff to cull through the pool the way they had done in the past.
Their current solution?  Make it electronic.  Use a web-based application system to weed out anyone who is unqualified, weed through the remaining pile with a cursory glance over the resumes, narrow down the list further with phone screens, then finally deliver the top handful of candidates to the hiring manager, who will interview them and decide on the best person.

So what's wrong with this system?  Where do I begin.  While it is certainly understandable that there is a need to more efficiently work through an overabundance of candidates (some which may be qualified, some not), it can't work the same way with human beings as in other situations because humans are not cookie-cutter.  If I want a pair of shoes on Zappos, all I have to do is specify search criteria for the things that I want (e.g. Women's, boots, casual style, size 9, black, less than a 2-inch heel, knee-high, and less than $100), and boom!  I have a small set of boots to choose from, making my decision much easier than if I had scrolled through all the thousands of shoes Zappos has available.

Online application systems were designed to basically filter humans in a similar way that Zappos does with shoes.  Want a candidate with 5 years experience, a college degree, experience designing webpages and running search engine analytics?  Sure, you can filter that.  Also want someone who lives less than 10 miles away, enjoys fly-fishing, and has blonde hair?  No problem.  Okay, some of that is an exaggeration, but the point is that this system of turning people into data takes advantage of the idea that the hiring company has the advantage of infinite possibilities, and can have whatever they want, so the filter criteria can get a little outrageous.  This kind of system hurts both job applicants and hiring companies, and I fear that a lot of times the companies are not aware of the ways it hurts them.  You see, people are not data.  People are not made from cookie-cutters.  They will never fit molds because their lives have infinite possibilities, and the value of their potential contribution cannot be evaluated by a series of data that are created by a seemingly arbitrary lists of demands the hiring manager provides.  Some of the most hard-working, dedicated, and intelligent people I have known in my past work experiences were those who did not have a college degree, or whose background was otherwise outside of what is "typical" for the work that they do.  Those gems are easily missed through this process, but the search criteria has gotten so crazy that even folks who are extremely qualified are lost through the cracks, never to even be noticed by a human being.

Missing out on qualified candidates is a big loss for the hiring company.  But this system also creates other problems.  Candidates are becoming more and more aware of the downfalls of this system, so they do what they can to get around it so that they can be noticed.  They flood their resumes and applications with keywords and buzzwords, as many as they can, so that their application will land in the "keep" pile.  They make more calls and emails to HR and the hiring manager, hoping that it will get them noticed.  They send out applications to EVEN MORE companies than they would have before, even applying to positions that they know they are unqualified for, just thinking that maybe luck is in numbers.  The result?  HR has to filter through even MORE correspondence and applications than they would have in the first place, basically shooting them in the foot by making a problem larger that they were trying to solve in the first place.

This problem, of course, begets more problems--HR managers become frustrated, creating even stricter search criteria to plow through the masses, which brings the problem back to the beginning in a downward spiral, making HR managers grumpy and overworked, and job candidates frustrated, weary, and confidence-shot.

Oh, what to do, what to do.  I give advice to others all the time on how to conduct an effective job hunt.  This time I'll give some tips to HR departments that might help ease their headaches and not miss the best candidates:

You can filter--but keep it real

Of course, it would be unreasonable to say that you should stop filtering candidates altogether based on their online profiles.  After all, there are only so many hours in the day, and so many of you to get the work done.  But you have got to be reasonable.  Have really good communication with the hiring manager to get to know what he/she needs and what that particular area of expertise is like.  Decide on the dealbreakers (must-have qualifications) and the desireables (things you think a good candidate would have, but you might hire someone without).  Note:  most things will (and should) fall into the "desireable" camp rather than the "dealbreaker" camp.  Think really hard about filtering by 5-7 years experience, for example.  Is it really out of the question that someone with more or less years could shine at the job and work harder than anyone else to get it?  In this case, maybe it makes sense to ask for 5-7 years experience in the description, but perhaps filter by 3-10 years and look at the results in more detail to see if the details make those people an interesting candidate.  Remember, "years" of experience do not lead to quality of experience, and people with any number of backgrounds could contribute something to your company.  You just have to figure out which is the best.  Don't rule out those gems who went against the grain.

Don't be so negative

By this, I mean the attitude or culture you maintain in the way you approach a pool of candidates.  A negative approach would be to go into a resume review or a phone screen looking for ways to "weed out" a candidate.  The goal is to get down to a handful to interview in person, so the more you can get rid of, the better.  It's almost a "pass the buck" attitude--like, "my job is just to get down to a small group of candidates, then the hiring manager can worry about picking one."  What about picking the best candidate?  With a positive attitude, instead of focusing on weeding out candidates, the focus is to find out who can make the best contribution.  This involves experience and background partly, yes, but it's also in listening to their ideas and let them explain why they are the best and why they want the job.  The people who want it the most and have the best ideas will work the hardest and do the best work, not necessarily the ones with the most credentials who have the most "checkmarks" on your list of things you're looking for.  That simple attitude change does not mean more work for you, just a shift in the questions you ask, the way you ask them, and the way you listen to the answers.

Fix the online application

Oy, there are so many issues here.  This is almost always outsourced, and if busy HR managers aren't careful checking the outsourced work, they may not notice all the potential problems that could be in their very own online applications.  As someone who has worked with data all my career, I cannot stress enough how important it is to get it right.  When it comes to data collection, it's garbage in, garbage out!  That is to say, if the method for collecting data (or, in this case, information on job applicants) is not precise, the information you get back will not be usable to your standards.  Let me offer up a few examples based on what I've personally seen in real-life online applications:
    • A couple of companies had drop-down lists of countries (to either indicate residence, or past work).  But a couple of them were not in alphabetical order, or the United States was not even listed!
    • Sometimes there was other kinds of menus, either for how you heard about the job, or what industry your past work was in, but the menu does not list all options, and there is no option for "other."  What is an applicant to do?  And you might filter them out if they interpret their industry differently than you do, or if you don't even list theirs.  Bad data....
    • Asking for salary history.  This is an entirely different blog post, so I'll try to hold myself back from launching into it.  What it boils down to, though, is that of course it's helpful to you in getting the best deal when you make an offer.  However, asking for salary history should not be used as a proxy to evaluate the potential contribution of a candidate, and it turns a lot of candidates off if you ask for it prematurely (or ever).  Don't scare away your best candidates.  If you ask for this, at least make it optional.
There are many more examples, but I'll stop there.  Basically, if the candidate is confused about how to fill in the application, you will get shoddy, unusable data, rendering your whole screening process useless.  Be careful!

Be respectful

There is no way to put this delicately.  Yes, it's a "buyer's market" in the hiring market, meaning that there are more applicants for each open position.  But that does not give you license to be rude.  Don't set up applicants to fail by giving them no notice to prepare for interviews, or blowing off meetings, or not apologizing when you mess up.  Remember that the applicants are interviewing the company as much as you are interviewing them.  They are trying to figure out if the company is a good fit for them, and you are often the first contact they have.  Please remember your manners and treat them as you would like to be treated.  This kind of thing should go without saying.

I know you're overworked.  I know it's tough to do it all.  Just please do what you can.

And candidates, good luck.  It's tough out there.