Generative AI may well be the most important technology innovation in a generation. Yet very few of us know how to manage it. Central to that pursuit is proficiency in prompt engineering.
Over the course of the past year, the team at TalentGenius have gone very deep on generating just the right prompts to help people optimize their most important asset: their careers. We built TalentGenius Coach to leverage generative AI to provide unbiased answers to career questions in very specific contexts, like “am I a good fit for this job.”
Getting Coach to answer these questions accurately is more involved than you’d think. It’s all in the prompts, the words you send to ChatGPT to get it to answer your questions. If you engineer your prompts to include key concepts like persona, context, output form and length, you can get AI systems to give you the outputs you want. If not, the answers may be misleading.
In short, leveraging Generative AI is akin to quizzing a 12 year old boy who has gotten into mischief: You have to ask the exact right questions to get to the full truth. Similar to that interrogation, prompt engineering can be frustrating. So, let me spare you some pain by sharing some key steps.
Step 1: Build your persona
The first step is to build your persona. Who is the person who wants the answer, what kind of answer are they looking for, and in what format? When building TalentGenius Coach, we often used the persona of “HR Professional” or “Career Coach” to provide the appropriate perspective.
Once you’ve nailed down your persona, you can start to experiment. Ask the simplest of questions, ones where you know the expected answer. Do you like it? Does it make sense for your audience?
Generative AI systems like ChatGPT are very smart – but they only use the information you have given it along with its previous training to help it form its response. Even a prompt where it’s “pretending” to be an expert doesn’t make it a real one. That’s where the engineering part comes in. You’ll need to evaluate its responses, and try a few different ones, to find what best suits the outcomes you’re looking for.
Step 2: Refine your prompts
You’re having a conversation, and it has some short term memory. ChatGPT can give you an answer and you can respond with “take that answer and make it shorter, funnier, more interesting.” Be as direct as you can be. You can’t hurt the AI system’s feelings – yet.
Refinements that are truly helpful include:
Step 3: Beware Positivity Bias
ChatGPT is like that friend who is too nice; it doesn’t want to give you bad news.
When our prompt engineering team was working on TalentGenius Coach, we found that ChatGPT has a bias for positive feedback and does not like providing negative responses. It takes prompt engineering work to get ChatGPT to give a neutral or negative response. This bias often results in a generic answer of “I’m an AI bot, I don’t know” to any question that results in a negative result unless you specifically tell it to overweight negative answers and give it specific neutrally worded responses to give in negative scenarios. This was true whether we asked ChatGPT salary questions, questions about resumes, or to give feedback on job responsibilities. In its quest to be positive, and without any other context, ChatGPT would give responses that made our marketing director look like a great fit for a Senior AWS Cloud Developer job. We needed to tell it to be more critical, and that negative answers are accepted and appreciated.
For a machine, ChatGPT needs a bit of emotional reassurance that it’s doing a good job and that it’s OK to give negative answers. It also helps to give ChatGPT structure to its responses that include the potential for negative answers. The AI equivalent of “multiple choice” has been helpful in engineering prompts for TalentGenius Coach. You can specifically say something like “return an answer of good, neutral or bad – with a bias toward bad if the answer fits the criteria” and you might improve your ChatGPT outputs if your goal is to get honest/neutral evaluations of information.
TalentGenius Coach has been “engineered” with the tech workforce in mind, by real leaders with experience on both sides of the hiring desk. If you haven’t already, download TalentGenius Coach from the Chrome Store and take it for a test drive and see some of these ideas in action.