Degrees of Change is a non-profit organization that provides cohort-based leadership training, college success support, and career development programming to underrepresented students and graduates. Two years ago, the organization developed a Power Platform solution that helped it go paperless. Since then, the solution has been expanded, including a Power Pages portal and powerful AI-driven models to help accelerate matching of candidates to available positions through its Seed Internship Program.
“With AI Builder, we are building AI models that we believe will allow us to triple the number of internships we provide over the next two years - without adding additional staff.”
Tim Herron, Founder and Chief Innovation Officer, Degrees of Change
A lot has happened at Degrees of Change since the organization launched its first Power Platform solution back in 2021. Its Act Six scholarship program has now sent more than 1,400 diverse, first-generation students to college equipped with leadership training and full scholarships provided by partner colleges. And the organization has been growing its Seed Internships program. This program identifies exceptional college students from underrepresented backgrounds and matches them with top, local employers.
All of this good work is driven by over 100 volunteers, a small support staff – and a very limited, non-profit budget. And that’s exactly what led to the organization’s first Power Platform solution. Before then, a custom-coded application had been built to digitize its Act Six program. But paying a third-party software vendor to maintain and improve the application was proving cost prohibitive. “We couldn’t afford to pay thousands of dollars each time we needed to make a small tweak or enhancement to the application,” says Tim Herron, Founder and Chief Innovation Officer at Degrees of Change.
Tommy Kim, the organization’s previous full-time IT resource, came up with a better idea. Kim already had some exposure to Power Platform. Once he completed his first Power Apps project, it lit a spark. “Tim, we can do so much more with Power Apps,” Kim said in a meeting. The company moved ahead with a Microsoft Power Platform solution in-house that would not only slash maintenance costs—but enable even more functionality than the original system.
Cutting development costs with Power Platform
The Act Six solution was built using Power Apps, Power Automate, and Dataverse. Applications from students are collected in Dataverse and accessed by staff using a “scoring app”. “We took the custom .NET scoring application as our baseline and, in a matter of weeks, built the Power Apps version of the app,” Kim says. This app also makes it easier for staff to record selection decisions based on student materials and share with colleges.
The low-code solution was an immediate success with students, volunteers, and staff. Inspired with this early win, Kim and Herron began work to refine and expand the solution. Updates included a feedback and support system for students and Act Six staff, with an online survey and a Power BI dashboard to display results. An embedded app enables the team to send custom text messages right from within the Power BI dashboard.
Evolving the platform with a centralized portal
One of the next big improvements made to the Act Six solution was the launch of a new Power Pages portal. Before this portal, students were using a third-party form builder service to submit program applications. Now, with the new portal, students can not only submit applications but see the status of their applications as they move through the evaluation and selection process.
The organization also integrated Dynamics 365 into the system for additional student support. When students express interest in the program through the portal, this kicks off a flow through Dynamics 365 Marketing which sends follow-up emails and selection results. For students that are selected for scholarships, Dynamics 365 Customer Voice sends and tracks surveys – all through the same portal.
Automating a complex recruitment process
As Herron and his team continued to expand its Act Six system, they also started work on another solution to help streamline the organization’s Seed Internships program.
Thanks to the flexibility of Power Platform, there were many parts of the Act Six system such as the scoring app that could easily be repurposed and customized to support the Seed program. But the program also had its own unique challenges. As Herron explains, “With the Seed program, we were managing and tracking hundreds of internships, candidates, interviews and job offers through a complicated system of spreadsheets and emails. The process was largely manual and pushed our small team to the limits.”
Today, much of that process is almost entirely automated. Here’s how it works using Power Platform:
Employers register for the program through a Power Pages portal and submit a list of internship positions and hiring managers. This kicks off flows which send emails to each hiring manager inviting them to log into the portal where they provide details of their positions. As interviews are completed and participants selected, managers provide status updates through the portal which, in turn, initiate flows to update participants and staff through their own portal view. All data is centralized in Dataverse.
The solution also helps streamline the hardest part of the program for staff – matching program participants to internship positions. By comparing structured data collected from participants and employers in the portal (such as education requirements for a job), a model-driven ‘matching app’ generates a ‘fit’ score using Microsoft Fabric. The fit score is displayed for staff in the app along with a quality score provided by volunteers in the scoring app to evaluate candidates at virtual and in-person interview events.
The app also consolidates information about the internship positions and candidates, along with participant’s essays and resumes. “This was a big leap forward for us as all of these critical matching elements could now be evaluated in the same view,” says Herron.
Using AI Builder to support faster, more effective matching
While the new matching app had dramatically streamlined the assessment process, the evaluation of free form resumes and essays from participants remained a time-intensive process. AI Builder helped solve that problem.
It all started with an interesting experiment by Herron using the new, generative AI-powered Bing Chat. First, he loaded a set of internships and candidates (including their fit and quality scores, resumes, and essays) and then asked Bing Chat for an assessment of the best matches. He also asked for a score to quantify the match. “What came back from Bing Chat literally blew me away,” says Herron. Along with its own ‘fit’ scores, Bing Chat also returned a detailed explanation behind each score. “This same output would have taken our staff hours to generate,” he says.
What also surprised Herron was just how easy it was to build this model into the new solution using AI Builder. He simply selected a pre-built generative AI model in AI Builder and created a flow which retrieves relevant data from Dataverse and sends it to Azure OpenAI Service. Responses are processed by Power Automate, stored back in Dataverse, and displayed to staff on their matching app.
Herron is careful to point out that, while powerful, the AI model is not always perfect. Nevertheless, ongoing testing has proven the AI model’s value to staff. “Augmenting our selection process with AI Builder allows us to scale and make the most use of our human assessments,” says Herron. “Using the pre-built models in AI Builder will help our staff make faster, more effective recruitment decisions without having to burn hours processing the raw data.”
Just how much more efficient is matching with the new AI model? Herron’s projections are impressive. “With AI Builder, we are building AI models that we believe will allow us to triple the number of internships we provide over the next two years - without adding additional staff.” Even better is that the company can achieve this while also maintaining their desired work-life balance policy for employees of a 32-hour week.
And the organization isn’t stopping there. As the team races to complete the integration of its new matching model into the platform, they have already added other AI elements using AI Builder.
One function anonymizes resumes to reduce bias. As Herron explains, “Removing gender bias, for example, is more than just replacing pronouns. Our AI-driven process even picks up implied gender.” AI Builder is also being used to build AI models that help students write better resumes. Like other parts of the platform, this process is fully automated: Once a resume is submitted, a flow initiates processing of AI-generated tips which are provided back to the participants via the portal.
Herron is exploring other AI-driven functions as well such as Copilot. “With Copilot in Power Apps, our citizen developers will be able to build more technical features with minimal training.” Solutions like these promise even greater efficiency for both the Act Six and Seed programs. And that ultimately means that more deserving students can look forward to a brighter future through Degrees of Change.
*Beginning September 1, 2023, Dynamics 365 Marketing and Dynamics 365 Customer Insights will merge into a single offering under Dynamics 365 Customer Insights. Learn more about the evolution of Dynamics 365 Customer Insights by visiting here.
“Using the pre-built models in AI Builder is helping our staff make faster, more effective recruitment decisions without having to burn hours processing the raw data.”
Tim Herron, Founder and Chief Innovation Officer, Degrees of Change
Follow Microsoft