Skip links

GenAI in HR Analytics – Strengths, Limitations, Workarounds — Part II

Jump To Section

GenAI in HR Analytics – Strengths, Limitations, Workarounds — Part II

The world is abuzz with terms like Generative AI (GenAI), Large Language Models (LLMs), ChatGPT etc. There’s a bit of a mysterious aura surrounding these areas. 

This is one of a series of blog posts which will attempt to clear the haze around these areas, from a practical standpoint. You might want to read Part-I of this same title, to get a fuller context of what we’ll talk about in this particular post.

Business Context — Voice of Employees (VoE) — continued from Part-I

In Part-I, we saw three practical challenges faced while using LLMs. Here’re a couple more, related to the same context.

Challenge 4:  Unaware of local context

Your team is building a chatbot for Employee Queries. An Employee can ask a question about HR policies, and get answers from the chatbot. That’s the expectation.

Here’s the catch, though…ChatGPT sitting out there has no clue about your organization’s HR policies. To be fair, it has never been trained on that. So, it may get lucky with the answers occasionally, but there is no way it can provide reliable answers in a reasonably consistent manner. 

Here’s a screenshot depicting one such interaction between an Employee and ChatGPT. The company name has been greyed out, for obvious reasons. 

image 12

So, what’s the solution? 

There are 3 options to be considered.

Option 1:  Simple prompt engineering

We could consider taking the easy way out, and simply bundle the context (here, HR policies) in the prompt/question provided to ChatGPT.

Unfortunately, this option may not work, since there is a limit to the number of words you can send to ChatGPT for each question. So, it would not be feasible to add large HR policy documents.

Option 2:  LLM Fine-tuning

Large Language Models (LLMs) like GPT, which underpin applications like ChatGPT, are trained using a very large corpus of documents. Sure, you can take those models, and train them further on your company’s HR policy documents. In LLM parlance, this is called ‘fine tuning’. That will make these models more aware of your company specific HR policies, in turn making its answers more relevant. But there is a time and cost associated with this exercise. It also needs to be repeated every now and then, to include the latest policy, changes in policies etc. Moreover, it has been practically seen in the industry that such fine-tuned models, while better than the ‘no fine tuning’ option, are still found lacking in terms of relevance of answers. One reason is that the amount of text contained in your company’s HR policy documents is still miniscule as compared to the humongous amount of data the models have been trained on, thereby limiting the ‘influence’ of these specific policy documents on the overall model results.

Option 3: Take the middle path

An underlying engine running in your organization can filter the context related to the question, and send that context along with the question, to ChatGPT. 

That way, you are combining the local Context Intelligence within your company, with the global Language Intelligence of the LLM. 

Your results will look much better now. Building the above automated engine is a tricky yet effective part of your overall solution.

=================================================

Challenge 5:  Insights beyond Language models

While discussing the four challenges so far in this post as well as the previous one, am hoping we have gained some intuitive understanding of the strengths and limitations of such language models. In this section, we will see how these language models can work with other engines to build powerful symbiotic ensembles.

Sticking with the context of HR Analytics, let’s say you want to understand the factors that influence attrition (or, positively speaking, retention) in your organization, how much does each of these factors influence retention, and how to predict retention/attrition

You know intuitively that there are several predictors of retention/attrition — learning opportunities, organizational culture, manager, how challenging/interesting the work is, current salary, difference between the current salary and the market median etc.

Many of the above factors (e.g. salary) are available as structured data. Traditional Machine Learning /AI engines are reasonably good at crunching such structured data to identify patterns, correlations etc, and use that information to predict the possibility of attrition.

At the same time, there are some critical factors like learning opportunities, work life balance etc which are subjective opinions/perspectives from the employee. These are present as unstructured (meaning, regular text) data that are not easily consumed by traditional ML/AI engines. This is where GenAI engines like LLMs come into play. They can convert these unstructured data into structured data. For example, you can use the LLM to create a sentiment score per review from an employee, and aggregate that to get an overall sentiment score from the employee. This can then be added to the rest of the structured data (like salary etc), to be fed into the ML/AI engine. So, you are effectively capturing the latent information potential of such subjective data and feeding that into the prediction process. 

To summarize, the Generative AI LLMs can be used not just on their own, but also in combination with other engines that can mutually strengthen each other’s capabilities, thus providing you with a better toolkit for informed decision making.

Picture of Jayaprakash Nair

Jayaprakash Nair

Suggested Reading

Ready to Unlock Your Enterprise's Full Potential?

Michael Woodall

Chief Growth Officer of Financial Services

Michael Woodall, as the Chief Growth Officer of Financial Services at Altimetrik, spearheads the identification of new growth avenues and revenue streams within the financial services sector. With a robust background and extensive expertise, Michael brings invaluable insights to his role.

Previously, Michael served as the Chief of Operations and President of the Trust Company at Putnam Investments, where he orchestrated strategic developments and continuous operational enhancements. Leveraging strategic partnerships and data analytics, he revolutionized capabilities across investments, retail and institutional distribution, and client services. Under his leadership, Putnam received numerous accolades, including the DALBAR Mutual Fund Service Award for over 30 consecutive years.

Michael’s dedication to industry evolution is evident through his involvement with prestigious organizations such as the DTCC Senior Wealth Advisory Board, ICI Operations Committee, and NICSA, where he served as Chairman and now holds the position of Director Emeritus. Widely recognized as an industry luminary, Michael frequently shares his expertise with various divisions of the SEC, solidifying his reputation as a seasoned presenter.

At Altimetrik, Michael plays a pivotal role in driving expansion within financial services, leveraging his expertise and Altimetrik’s Digital Business Methodology to ensure clients navigate their digital journey seamlessly, achieving tangible outcomes and exponential growth.

Beyond his corporate roles, Michael serves as Chair of the Boston Water & Sewer Commission, appointed by the Mayor of Boston, and is actively involved in various philanthropic endeavors, including serving on the board of the nonprofit Inspire Arts & Music.

Michael holds a distinguished business degree from Northeastern University, graduating with distinction as a member of the Sigma Epsilon Rho Honor Society.

Anguraj Kumar Arumugam

Chief Digital Business Officer for the U.S. West region

Anguraj is an accomplished business executive with an extensive leadership experience in the services industry and strong background across digital transformation, engineering services, data and analytics, cloud and consulting.

Prior to joining Altimetrik, Anguraj has served in various positions and roles at Globant, GlobalLogic, Wipro and TechMahindra. Over his 25 years career, he has led many strategic and large-scale digital engineering and transformation programs for some of world’s best-known brands. His clients represent a range of industry sectors including Automotive, Technology and Software Platforms. Anguraj has built and guided all-star teams throughout his tenure, bringing together the best of the techno-functional capabilities to address critical client challenges and deliver value.

Anguraj holds a bachelor’s degree in mechanical engineering from Anna University and a master’s degree in software systems from Birla Institute of Technology, Pilani.

In his spare time, he enjoys long walks, hiking, gardening, and listening to music.

Vikas Krishan

Chief Digital Business Officer and Head of the EMEA region

Vikas (Vik) Krishan serves as the Chief Digital Business Officer and Head of the EMEA region for Altimetrik. He is responsible for leading and growing the company’s presence across new and existing client relationships within the region.

Vik is a seasoned executive and brings over 25 years of global experience in Financial Services, Digital, Management Consulting, Pre- and Post-deal services and large/ strategic transformational programmes, gained in a variety of senior global leadership roles at firms such as Globant, HCL, Wipro, Logica and EDS and started his career within Investment Banking. He has developed significant cross industry experience across a wide variety of verticals, with a particular focus on working with and advising the C-Suite of Financial Institutions, Private Equity firms and FinTech’s on strategy and growth, operational excellence, performance improvement and digital adoption.

He has served as the engagement lead on multiple global transactions to enable the orchestration of business, technology, and operational change to drive growth and client retention.

Vik, who is based in London, serves as a trustee for the Burma Star Memorial Fund, is a keen photographer and an avid sportsman.

Megan Farrell Herrmanns

Chief Digital Officer, US Central

Megan is a senior business executive with a passion for empowering customers to reach their highest potential. She has depth and breadth of experience working across large enterprise and commercial customers, and across technical and industry domains. With a track record of driving measurable results, she develops trusted relationships with client executives to drive organizational growth, unlock business value, and internalize the use of digital business as a differentiator.

At Altimetrik, Megan is responsible for expanding client relationships and developing new business opportunities in the US Central region. Her focus is on digital business and utilizing her experience to create high growth opportunities for clients. Moreover, she leads the company’s efforts in cultivating and enhancing our partnership with Salesforce, strategically positioning our business to capitalize on new business opportunities.

Prior to Altimetrik, Megan spent 10 years leading Customer Success at Salesforce, helping customers maximize the value of their investments across their technology stack. Prior to Salesforce, Megan spent over 15 years with Accenture, leading large transformational projects for enterprise customers.

Megan earned a Bachelor of Science in Mechanical Engineering from Marquette University. Beyond work, Megan enjoys playing sand volleyball, traveling, watching her kids soccer games, and is actively involved in a philanthropy (Advisory Council for Cradles to Crayons).

Adaptive Clinical Trial Designs: Modify trials based on interim results for faster identification of effective drugs.Identify effective drugs faster with data analytics and machine learning algorithms to analyze interim trial results and modify.
Real-World Evidence (RWE) Integration: Supplement trial data with real-world insights for drug effectiveness and safety.Supplement trial data with real-world insights for drug effectiveness and safety.
Biomarker Identification and Validation: Validate biomarkers predicting treatment response for targeted therapies.Utilize bioinformatics and computational biology to validate biomarkers predicting treatment response for targeted therapies.
Collaborative Clinical Research Networks: Establish networks for better patient recruitment and data sharing.Leverage cloud-based platforms and collaborative software to establish networks for better patient recruitment and data sharing.
Master Protocols and Basket Trials: Evaluate multiple drugs in one trial for efficient drug development.Implement electronic data capture systems and digital platforms to efficiently manage and evaluate multiple drugs or drug combinations within a single trial, enabling more streamlined drug development
Remote and Decentralized Trials: Embrace virtual trials for broader patient participation.Embrace telemedicine, virtual monitoring, and digital health tools to conduct remote and decentralized trials, allowing patients to participate from home and reducing the need for frequent in-person visits
Patient-Centric Trials: Design trials with patient needs in mind for better recruitment and retention.Develop patient-centric mobile apps and web portals that provide trial information, virtual support groups, and patient-reported outcome tracking to enhance patient engagement, recruitment, and retention
Regulatory Engagement and Expedited Review Pathways: Engage regulators early for faster approvals.Utilize digital communication tools to engage regulatory agencies early in the drug development process, enabling faster feedback and exploration of expedited review pathways for accelerated approvals
Companion Diagnostics Development: Develop diagnostics for targeted recruitment and personalized treatment.Implement bioinformatics and genomics technologies to develop companion diagnostics that can identify patient subpopulations likely to benefit from the drug, aiding in targeted recruitment and personalized treatment
Data Standardization and Interoperability: Ensure seamless data exchange among research sites.Utilize interoperable electronic health record systems and health data standards to ensure seamless data exchange among different research sites, promoting efficient data aggregation and analysis
Use of AI and Predictive Analytics: Apply AI for drug candidate identification and data analysis.Leverage AI algorithms and predictive analytics to analyze large datasets, identify potential drug candidates, optimize trial designs, and predict treatment outcomes, accelerating the drug development process
R&D Investments: Improve the drug or expand indicationsUtilize computational modelling and simulation techniques to accelerate drug discovery and optimize drug development processes