3 Great Learnings from Rejected Offers!

The CEO of Kapwing, Eric Lu, a video online technology company, recently wrote a blog post about what he and his team learned from recruiting engineers and had sixteen offers that were rejected! Go read it, it’s a great insightful post, from a leader will to share a bit of his pain and learning for the benefit of all of us!

First, we all know that recruiting technology candidates have been, and will continue to be, very difficult, especially in Silicon Valley. Eric knows this as well, but you still like to dig into your own data and find out more. I find most leaders don’t truly like to know why someone rejected their offer. In fact, most leaders make up excuses about the candidates who reject them, instead of learning more about themselves. So, Eric is already a pretty damn good leader by just wanting to know more about this issue!

Why do people reject your offers?

Before we even get into some of the common reasons, the reason most candidates reject an offer is that “we” (recruiting, hiring managers, leaders) did a crappy job at closing the potential candidate. What should happen is we all have pre-closed enough that when an offer is made, we already know the answer, and that answer is “yes”! You should rarely be surprised by this answer, and if you are, something failed in closing this candidate.

Money! (Duh, you really wrote that?!) Yeah, turns out people almost always want more money to come work for you, when they have a job and have some experience. They want a lot more money when they have those things and others who also want them.

No High-Level Title. Why? Ego, yeah. But, honestly, this is also another money thing! If you can actually get a higher title, this helps in your career progression. If I’m looking to hire a “VP” I want someone who has that experience or career progression. Most orgs won’t hire a “Manager” to become a “VP”, so titles matter to a lot of people. Even though they shouldn’t.

Your Brand/Position/Leader is what they want. This is the hardest one because many times there’s nothing you can do. Some candidates are looking for something specific and they don’t know if that will be you until they go through the process to find out. Sometimes that takes them to the end where they discover this isn’t for them.

What did the CEO of Kapwing learn from his rejected offers?

1. Expiring offers actually work! I absolutely love this concept! It’s a psychological concept to be sure! Once someone decides to accept your offer, even if other offers come in, they will usually stay with that offer. Kapwing had both sign-on bonuses and offer expiration dates! Take a look at this pic –

Expiring Offer Model from Kapwing

2. Access to your founders, C-suite, and Board can make a difference! But, really it’s more than just access, it’s also about those folks showing interest and making the person feel desired. If I’m interviewing for a non-leadership role and the CEO and a Board member reach out to me to say great things, that makes me feel all warm and fuzzy, and like those folks give a sh*t! I want to work for a company like that!

3. Communication from interviewers and potential new teammates is a big win! Candidates constantly get ghosted. They hate this and they hate “you” for it! If you want to land more candidates FORCE those who interviewed to email, call, send flowers, etc., and give those candidates constructive, yet positive, feedback. Also, have potential teammates of this person send notes, like “hey, Timmy, said he interviewed you last week and mentioned you have some knowledge around “X” we could so use you right now on this project…can’t wait to work with you!” A future employee wants to feel like they will find great friends at your company!

Shoutout to Eric Lu and the Kapwing team for sharing their pain, knowledge, and learning. It was a brave post, honestly, and I loved it!

7 Words That Turn Candidates Off!

Communication is a tricky thing. It’s so easy to turn off another party by simply using just one wrong word, especially when you’re trying to build a relationship with a candidate you potentially want to hire.

I think there are some words and phrases that have a high probability of turning off a candidate to want to come work for your organization. I speak to students a few times a year about interviewing and I tell them something similar, which is what you say can automatically make a hiring manager not want to hire you!

Think about being an interview and the candidate starts to tell you why they’re no longer working for ACME Inc. “Oh, you know it was just a ‘misunderstanding’, I can explain…”

“Misunderstanding” is a killer word to use while interviewing! It wasn’t a misunderstanding! You got fired! The ‘misunderstanding’ is you not understanding the crap you were doing was wrong! 

So, what are the 7 Deadly Words you should never use as a recruiter? Don’t use these:

-“Layoff” – It doesn’t matter how you use it. Even, ‘we’ve never had a layoff!’ “Layoff” isn’t a positive word to someone looking to come to work for you, so why would you even add it to the conversation!

-“Might” – Great candidates want black and white, not gray. “Might” is gray. Well, we might be adding that tech but I don’t know. Instead, use “I’m not sure, let me check for you because I want to get you the truth.  Add

-“Maybe” – See above.

-“Unstable” – You know what’s unstable? Nothing good, that’s what! If something isn’t good, don’t hide behind a word that makes people guess how bad it might be, because they’ll usually assume it’s worse than it really is!

-“Legally” – “Legally” is never followed by something positive! “Legally, we would love to give you a $25K sign-on bonus, but…” It’s always followed by something that makes you uncomfortable. When trying to get someone interested in your organization and job, don’t add “Legally” to the conversation!

-“Temporarily” – This is another unsettling word for candidates. “Temporarily” we’ll have to have you work out of the Nashville office, but no worries, you’ll be Austin soon enough! Um, no.

-“Fluid” – Well, that’s a great question, right now it’s a fluid situation, we’re hoping that hiring you will help clarify it! Well, isn’t that comforting… Add: “Up in the air” to this category!

We use many of these words because we don’t want to tell the candidate the truth. We think telling them exactly what’s wrong with our organization, the position, our culture, will drive them away. So, we wordsmith them to death!

The reality is most candidates will actually love the honesty and tend to believe they can be the ones to come in and make it better. We all want to be the knight on the white horse. Candidates are no different. Tell them the truth and you’ll end up with better hires and higher retention!

Adjust Your Recruitment Packaging!

I talk to a lot of TA leaders and pros who tend to get stuck when it comes to their employer branding and messaging. They want to be transparent and tell candidates exactly who they are and what these candidates should prepare for. The problem being, they believe if they are transparent then candidates will not want to apply or join their company.

The problem with this type of thinking is every single employee, and every candidate for that matter will look at your company and your jobs through different lenses. Take your most loyal employee of all time (Timmy), the person who loves working for your brand more than anyone. What they believe is their truth. Our hope and dream is everyone sees the world, and our company, the exact same way!

Now, take the employee who is the exact opposite end of the spectrum as Timmy! This employee hates you, the company, their job. They are a walking work cancer. The only question you really have about this employee is can we fire them faster than they might be able to quit.

The reality is, your brand and your jobs are truly no different to these two employees, yet they see it as completely different.

When it comes to your employer brand there are some key things you should not adjust for:

  1. This is who we are.
  2. This is what we stand for.
  3. This is what we do.

The rest is just packaging!

Now, I’m not saying you should put out a video that shows daily ice cream socials and free Tesla’s. That would be lying. But if your packaging of your jobs and your company aligns more with how Timmy sees your brand, that’s the packaging. This world is real for at least one person at your company. It’s not a lie, it’s one employee’s truth.

You can change your packaging constantly. By location, by job, by month, etc. The core of your brand doesn’t change. This is who we are, and what we stand for, and what we do. You might even add to this with some this is what we will do for you or help you become. As long as that’s your core and you can deliver on it.

Each of us works for a brand and a job that can sometimes suck and sometimes be amazing, but mostly is a job that we like fine enough, but not as much as a puppy giving you a kiss, or your child running to you after you’ve been gone on a trip. And that’s okay!

So many of us are struggling to get people to apply to our jobs and come work for us right now, and the truth is, we need to step up our marketing game! We need to make our stuff more attractive! More desirable! We need to adjust our packaging. You’re trying to sell high-end jobs with generic branding, and you’re getting generic results.

Don’t Mistake Credentials for Intelligence!

I was the first person in my family to graduate from college. I was the first person in my family to obtain a master’s degree. I continue to have the grammatical skills of a middle schooler!

My parents are “real” people and have “real” conversations. My family has reached high levels of what most people would call successful. My Mom and Dad didn’t go to college, but both I would consider being very intelligent. They “get it” at a very high level, but one of their biggest strengths was never assuming someone was smart or dumb based on a credential.

This fact allowed them, in their careers, to speak to anyone on an equal footing. The guy swinging a hammer, or the woman running the billion-dollar company, both started on the same level in my parent’s eyes. Both the hammer guy and female CEO have great knowledge, although most likely different knowledge, to share and learn from. Depending upon the specific time, each brought high value to the interaction that was being had.

I get told all the time, “oh, you are just like your mother”, and I see why people make that comparison. I also believe I’m very much like my father, in that both of my parents feel very comfortable fitting into almost any situation. Because they don’t measure a person’s value based on their credentials or the size of the bank account, but on the value, that person brings overall to the interaction that they are having in that exact moment.

At the same time, I’m very pro-credential!

I married a woman who has her master’s degree. My oldest son, at 24, already has his master’s degree, my middle son has his bachelor’s and I’m sure eventually something beyond that, and my youngest son will attend university very soon. So, if credentials don’t equate to intelligence, why did I push my own children to obtain said credentials?

Just because a credential doesn’t equate to intelligence, doesn’t mean that most people don’t make this mistake as a first impression! Also, we are still in a society that overvalues a credential for the most part when it comes to getting jobs and promotions. So, you set your kids up the best you can with the hope this will assist them in being successful.

The real challenge is to get them to understand that just because you are educated, doesn’t mean you’re smart! To have that super valuable skill my parents have! That I hope I have some of! To truly value those around you without the credential that many times have so much more to offer you than you have to offer them.

I believe the best leaders in the world have this skill. The ability to look at each individual and know they probably possess all kinds of strengths that I don’t have, regardless of pay grade or formal education, and to treat them accordingly. It seems like an easy concept, but every day I see examples of highly credentialed people looking down on those less credentialed than themselves.

It goes both ways, we all judge…

I also understand that this type of judgment goes both ways. I have many friends and family who are blue-collar and tend to think less of those who are credentialed for the simple fact they view these people as less hardworking. Sure, they might not get dirty and sweat on a daily basis, but it doesn’t mean they don’t work their butts off.

Covey has the classic line, “Seek first to understand”. You swing a hammer, I try to sell the project that allows you to swing a hammer. Without each of us, business does not happen. One is not more important than the other, and both are keenly needed for success. If more of us understand this very simple concept, the world would be a much more civil place to live in.

“Hire Fast! No, Faster! Fire Fast!” The New Recruiting Axiom!

Traditionally, talent acquisition pros would say it’s “Hire Slow, Fire Fast”. I always thought that was stupid because the reality was for most corporations it was “Hire Slow, most likely Never Fire someone unless they kill another employee in front of you…” Or something like that!

Okay, “It was Hire Slow, Fire Fast”, but we all know that never really worked. Currently, around the world, it’s mostly, “Hire Slow, Fire Slow”. I’m a true believer in we you don’t hire someone to fire them. So, move quickly, hire well, and then support the heck out of them and make them superstars, seems like a higher ROI approach to hiring!

Welcome to 2021!

The problem is, economies don’t give a crap about our axioms! Currently, in the US you better Hire As Fast As You Can, and Still that probably isn’t fast enough! So, “Hire Fast, No Faster, and Fire the Bad Ones That Got Through Your Super Fast Process!” That is really the only shot you have in 2021, and most likely for 2022 and 2023!

Let’s break down what would really happen if you started hiring super fast!

1. You would fill positions much faster than you do now.

2. You would probably make more bad hires. Turnover would increase if you do it right.

3. You would probably spend more on training.

4. You would probably hire some folks you normally wouldn’t and actually, some of those will be really good.

5. You would be forcing your hiring managers to make very quick decisions if you let them decide at all.

Of course, this isn’t your long-term let’s do this forever recruiting strategy! This is, hey, if we don’t start moving super fast, we’ll never be able to compete for talent in our marketplace!

Amazon Warehouses can currently hire candidates from applications to offer in under 30 minutes. Low skill jobs, paying around $17-21/hr. Yes, their turnover is about 150%. Yes, that is actually about normal for warehousing jobs. Turns out, Doug, the hiring manager, doesn’t have some magic selection instinct. Is the Candidate is interested? Does the Candidate show up? You’ve got a 1 in 3 shot they’ll be a good hire.

If I was in the same marketplace as an Amazon Warehouse and hiring the same level of talent, I would literally hire a taco truck to sit outside their property across the street and just hire all the people who turnover from Amazon on a daily/weekly basis. That would be my sole recruiting strategy! Let them do all the work, and I just clean up the mess!

How Could We Make “Hire Fast, No Faster, and Fire Fast” Work?

It’s pretty simple. You pay slightly above market pay. Be one of the top-paying companies in your market. Hire extremely fast, and the moment an employee starts to show you they actually suck BAM! You fire them. The reality is, being a pay leader in your marketplace will continue the funnel of incoming candidates coming.

We aren’t trying to put Jeff Bezos in space people! We are just trying to fill openings at our companies that are all about average. We treat you fairly well. You’ll have some laughs, and once in a while, we’ll buy ice cream and stuff. It’s not the best gig, but it’s far from the worst.

The key is you can’t let low performance even show up for a day! You reward, celebrate, and do all the good stuff for those who come to work. Those who come to collect a check, and not work, you have to kill instantly! Sounds harsh, but this isn’t show friends, this is show business!

Delivering Exceptional Experiences to Employees and Candidates!

In 2021 and moving forward into the future, HR and TA leaders will be tasked with delivering “exceptional” experiences for both our employees and our candidates. It’s the future of work. People expect that “work” won’t be an awful experience, that we’ll get as much as we give, and we aren’t just talking about the exchange of compensation. Getting paid is no longer enough.

I’ve partnered with the folks at Symphony Talent to share some free resources and data because we share the same ideas and strategies around how to make this happen. The 4-part research study is called The Exceptional Experiences Research Report and it’s broken into four sections, which as of today have all been released and you can download them for free:

Also, on July 27, my friend and TA Technology Analyst and Expert, Madeline Laurano will be holding an exclusive limited-access roundtable event to discuss The Future of Exceptional Experiences for Employees and Candidates. Sign-up now, so you can reserve your spot!

Why should we even bother with delivering exceptional experiences?

  1. Because the risk is, someone you are competing with for talent will, and while you will still get talent, you will not get the good talent.
  2. Longer tenure delivers better operational performance. That is a fact. The better an employee experience is, the longer they will stay around. Another fact.
  3. If the Pandemic has taught us anything it’s that life is short and unexpected. You deserve to work at a place where you actually like that experience. So does everyone else. The great thing about being in HR and TA is we actually have some control over this!
  4. This isn’t difficult. Yes, it is work. But in the end, it’s work you can be proud of and get behind.
  5. This is strategic stuff! We always whine and complain about not being strategic! Here’s your chance!

Go download the four reports. They’ll give you the ideas and the data to get the leadership support you will want. Also, sign up for Madeline’s roundtable before all the spots are gone, this will be a dynamic discussion with fellow peers all looking to elevate their function!

Should Candidate Response Time Be a Measure We Care About?

I have expectations as a leader in my organizations for other employees who are in a leadership position in my company. One of those expectations is, if I call or text you on off hours, weekends, vacations, etc., for something that is urgent to the business, I expect a reply in a rather short time frame.

Some people would not like that. I don’t care. You’re a leader, the business needs you, there’s no time clock for that.

That expectation is set for someone at a leadership level in my organization. They know this expectation before taking the job. Also, I’m not an idiot about it. I can probably count on one hand the number of times in the past five years I’ve reached out to someone on weekends or vacations expecting and needing a response.

But, what if you measured candidate quality in the same manner? Seems unreasonable, doesn’t it!?

Well, check this out:

Nardini is the CEO of the sports and men’s lifestyle site Barstool Sports. In a New York Times interview, she detailed her process for vetting job candidates. After saying she was a “horrible interviewer” because of her impatience, she explained a unique process for gauging potential hires’ interest in the job.

“Here’s something I do,” she said. “If you’re in the process of interviewing with us, I’ll text you about something at 9 p.m. or 11 a.m. on a Sunday just to see how fast you’ll respond.”

The maximum response time she’ll allow: three hours.

So, Erika believes if a candidate doesn’t reply back to her on a Sunday at 9 pm within three hours, they are not interested in a job.

This is why recruiting is hard.

You have moron leaders who come up with stupid ideas of what they think is ‘important’ and then they make you live by these dumb rules. This rule is ridiculous. Erika’s assessment of why this works is ridiculous. But, she’ll get a pass.

Why?

She’s a she. If some dumb white dude came up with the same rule the New York Times would write an expose on how this guy is a complete tyrant and out of touch with today’s world, and how crappy this candidate experience is, and how bad leadership this is, etc. But, no one will. She’s just leaning in and doing what the guys do!

Yes, she is. She’s being an idiot.

Now, I’ll say I actually agree with her on her assessment on response time, assuming the roles she is expecting a reply from in three hours are time critical roles. She runs a media site with breaking stories. Twitter has these things up in seconds, media sites need replies to what is happening within minutes and hours. So, there could be some legitimacy to something as arbitrary as measuring candidate desire by response time.

It’s fraught with issues, to be sure, but for certain roles, it might find you some good talent. Should it be a golden rule of hiring for your organization? No, that’s just dumb.

If you really want a silver bullet I ask every candidate if they’re a dog person or cat person. Works every time!

How Should We Structure New-Hire Sign-On Bonuses for Hourly Hires?

Right from The Project mailbag comes this beauty of a question! Very timely in that so many organizations are moving super fast to add sign-on bonuses for new hires to help them attract more hourly candidates right now. Here’s the actual question:


Dear Tim,

We are looking to offer a new hire sign-on bonus for our hourly hires. I was wondering if you have any advice in terms of what is the best way to do this that one, makes it attractive to candidates, and two, works to help retain these hires so we aren’t just throwing money away?

Thanks for the help,

Mandy


How would I offer an hourly sign-on bonus?

It’s a great question because there isn’t any one correct answer. The correct answer is you do what it takes to meet your goals! In this scenario, without giving up Mandy’s specific details, here’s what I would do:

  • Offer an amount that makes staying on extended UI/Stimulus a non-issue. So, if someone is making $300 a week additional stimulus ($1200 per month), I’m going to pay that on top of our hourly wage.
  • Pay this sign-on as a fraction per hour worked. So, an additional $300 per week would be $7.50 per hour over your normal hourly rate. So, a person who normally makes $15/hr, would be making $22.50/hr until the “sign-on bonus” is paid off.
  • The decision you have to make is how long do you pay this additional extra hourly sign-on addition? One month, two months, until the end of September?! I would pay it for one month and if the person quits and tries to collect unemployment, we would challenge it. The reality is, once someone has worked for a month, there more than likely going to keep working. The ones who really don’t want to work, won’t make it a month.
  • “Tim, we just can’t afford that much”-edition. I hear you, $300 per week is way too much. What can you do? Steal workers from other employers who are making roughly the same as what you pay, but you pay more, just not $7.50 an hour more! Maybe you pay $2/hr more.
  • But, wait, you’re not done! What about your current workers? The reality is, if you start offering a sign-on bonus to new hires, your current employees are going to be upset, especially your best ones! So, you have to make it good with them. More than likely you end up in a compensation track that pays your more experienced people more than your new hires. The key for success here is whoever is getting the best pay must be your best performers, or you get rid of them.
  • Also, you can’t pay your more experienced hourly workers $.50 to $2/hr more if you’re paying new hires sign-on bonuses worth more than that, but you don’t have to pay them the same. The key is to make sure your best workers are being paid at a rate that leads the market, so they can’t go anywhere else for similar work in your market and make the same or more. Pay for performance.
  • Move quickly to make changes to market compensation. In crazy employment times, as we have right now for hourly workers, you can not rely on paid compensation data and services. They move too slow. Pay attention to what candidates are telling you and make some calls to fellow pros around your market to see what folks are paying.
  • Bonus Tip: Have multiple sign-on bonus/retention plans for potential new hires/current employees to choose from! Let’s face it, no one plan will be what everyone wants. So, design three and let them choose. Maybe some want an additional hourly rate, maybe some want a retention bonus paid at the end as a lump sum, and maybe some want something totally different. Get creative!

Brainstorming Idea: What if you paid bonuses for certain activities that lead to the new employee behaviors you wish to have? Show up for the interview, get $50 cash in your hand. Show up to the first day of work, get $100 cash in your hand. Make it through the first week, etc.! Reward based on the behavior you want to happen, and ensure it happens. Yes, payroll will hate you, but it doesn’t mean that it can’t be done!

Yes, this is expensive, but not as expensive as going out of business because you can’t find labor. You can always increase your prices for your products and services to meet this additional demand. Say hello to inflation, it’s going to happen, the current administration made sure of that with a multi-trillion dollar stimulus package!

The key to making sign-on bonuses work is to only pay those bonuses fully to those workers who truly are working. If you start paying that higher wage to slackers, you’ll be dead in the water. People are willing to work market leading wages, but they are also willing to collect market leading wages for not working so hard if you allow it.

The Past-Employee Walk of Shame!

I’ve lost jobs and I’ve called old employers to see if they would want to hire me back. I’ve usually gotten a response that sounded something like, “Oh, boy would we want you back but we just don’t have anything. Good Luck!”  Many of us in the talent game talk about our employee Alumni and how we should engage our Alumni but very few of us really take true advantage of leveraging this network.

I was reminded of this recently when a friend of mine took a new job. You know the deal, shorter drive, more money, growing company, and oh, boy, just where do I sign!? The fact was, it was all they said, shorter drive, more money and they were growing, but they forgot to tell him was our operations are broken beyond repair, you will work 7 days a week and probably 12-14 hours per day because of the mess we have, but keep your head up it’s the only way you won’t drown here!

So, now what does he do?

He already had the going away party, bar night out with the work friends with the promises to do lunches and not get disconnected, packed up, and unpack the office into the new office.  Let’s face it, big boy, you’re stuck! Not so fast. He did the single hardest thing an employee can do he called his old boss after 7 days and said one thing, “I made a mistake, can I come back?”

Luckily for him, his past boss was a forward-thinking leader and so this past Monday he did the 2nd hardest thing an employee can do he made the “Employee Walk of Shame”.

You can imagine the looks from people who didn’t know him well, “Hey, wait a minute, didn’t you leave?” Having to tell the same story over and over, feeling like he failed, like he wasn’t good enough to make it in the new position.

HR plays a huge part in this story because it was HR who can make this walk of shame a little less rough. Let’s face it, it is different. You just don’t leave and come back as nothing happened. Something did happen, there was a reason he left and that reason isn’t going away. A transition back needs to be put into place even though he was gone seven days.  It’s not about just plugging back in, it is about re-engaging again and finding out what we all can do better so it doesn’t happen again.

It’s also about making sure you let those employees who you truly want back, that they are welcome to come back (assuming you have the job) and not just saying that to everyone. There are employees who leave that you say a small prayer to G*d and you are thankful they left! There are others where you wish there was a prayer you could say so they wouldn’t leave.

Make it easy for your employees to do the Walk of Shame, it helps the organization, but realize they are hurting, they are embarrassed, but they are also grateful!

Be Careful with Employer Online Reviews!

Some recent data out analyzing online reviews on sites like Amazon and Yelp show that half of all reviews give the highest possible rating possible. So, ask yourself, of all the stuff you bought on Amazon and all the restaurants you tried on from Yelp, would you give the highest rating possible?

Human nature would tell us of course not! This phenomenon is known as a “Positivity Problem“. It’s like when I asked you all to give me a 5-star review on my book “The Talent Fix” and you all did! (Well, all except like two of you, and the next time I see my Dad I’m really going to give him hell over that 3-star review!).

Basically, “star” ratings are unreliable rating mechanisms. 

The big problem is when we measure things like employee experience, candidate experience, etc., we use star rating measurements. Glassdoor, the employer review site, turned job board, gained millions of followers and giant traffic by using anonymous star reviews from employees which were almost immediately problematic, but we all ignored it and took it as the word of God. OMG! Amazon is a 5-star employer and Walmart is a 2.5-star employer. Both of which are most likely wrong.

What should we be doing to find an accurate measure? 

Like any great leader, we should be looking less at a number rating and more at the verbatim comments. If you have a giant sample size and can use AI to gain further insights, you can really gain some understanding of what candidates and employees are thinking, or which employers truly are the best or worse to work for.

The study mentioned above found that the comments using the most emotionally charged wording, both positive and negative, were greater predictors of measuring success. Comments become a great predictor of what’s really going on.

What can go wrong with this? I’ll call this the “Business Insider” Dilemma! 

The BI Dilemma is a phenomenon I’ve noticed recently with writers at Business Insider. I’ve been a long-time reader of BI and they produce some really good content, but over the past 12-24 months they tend to make some extremely bold conclusions based on comments from only a handful of employee’s comments.

Things like, Amazon is an awful employer for women, just come and read about twelve women we spoke to who are former Amazon employees, out of 300,000 Amazon employees who are female! Come on!

To be fair, BI isn’t the only media outlet to do this, it’s become common place in cancel culture. Find a minority opinion and run with it as a majority opinion. This is a problem when it comes to using employee and candidate comments as a measure of success or failure.

That number has to be pretty substantial to gain real insight. At a minimum, I would think you would need about 5-10% of all to comment to be comfortable in making any real decisions based on comment data. So, if you have one thousand employees, I want to see about 100 comments to get a true feel for what’s really going on.

We focus so heavily right now on “data” on the number and the movement of the number. But if we know that star ratings alone are unreliable, do we truly feel like we are getting the full picture of what’s really needs to improve or change?