CSE Projects – Fall 2024

AbbVie: Image Analysis Tool for Biphasic Solutions
Ally Financial: Agentic Collaborator
Amazon: Remediating AWS Security Gaps Using Generative AI
Anthropocene Institute: Ocean Carbon Pollution Cleanup
Auto-Owners Insurance: From the Ground Up VR
DRIVEN-4: DRIVEN-4 Connect Application
General Motors: Recycling Identification System
General Motors: Remote Wildlife Habitat Monitoring System
HAP: Healthcare Payer Price Transparency
Henry Ford Innovations: Modernizing Robotic Surgery Education
Henry Ford Innovations: MSU-HFH Research Synergy Vanguard Portal (RSVP)
Kohl’s: Governance of Expense in Kohl’s Cloud Operations
Launch by NTT DATA: Spatial IoT Control using Apple Vision Pro
Magna: Offline-Ready Mobile App for Delivery Optimization
Magna: Test-Driven Development for Embedded Software
Magna: Visualizing Neural Network Gradients
Magna: World Feature Generation for ADAS Simulation
Meijer: Increasing Awareness of Meijer-Branded Products
Michigan State University: Robotic Job Coaching
MSU Federal Credit Union: Branch Pickup Lockers
Roosevelt Innovations: Intelligent Benefits Parser and Knowledge Assistant
RPM: Automated VIN Integration for RPM Logistics
Stryker: Surgical OR Instruments and Needle Tracking
TechSmith: Video Insight and Knowledge Interface (VIKI)
Union Pacific: Virtual Reality Inspection Training
Urban Science: Predicting Automotive Sales Using Generative AI
Vectra AI: AI Cyberattack Early Warning System
Volkswagen Group of America: Safe Journey AI
Whirlpool Corporation: Cooking GPS
WK Kellogg Co: Cereal Industry Analysis Tool Using Generative AI



AbbVie: Image Analysis Tool for Biphasic Solutions

Headquartered in North Chicago, Illinois, AbbVie is a Fortune 500 biopharmaceutical company dedicated to advancing healthcare through innovative research and the development of lifesaving treatments.

AbbVie researchers often work with special liquids that separate into two layers, called biphasic solutions. Measuring properties of biphasic solutions, such as phase boundaries (where two layers meet) and how layers are blended, is a manual process that limits high-throughput experimentation. The time this process takes inhibits AbbVie’s mission of providing quality healthcare.

Our Image Analysis Tool automates this process by using a deep learning model to acquire metrics from images of biphasic solutions that AbbVie’s chemists need to make critical decisions. First, a robotic arm positions each vial for the camera, capturing high-resolution images which are then processed by the model. Solution properties are located and displayed to the user for quick and accurate insights into the composition of the biphasic solution. Chemists save the image with its associated information, such as sample number or the chemicals used.

Our software also includes a model training feature, enabling researchers to adapt the model to specific chemicals and environments. This ensures that the model is as robust as possible, leading to the most precise and realistic results.

To support the model training feature, the application also supports the saving of images to a database. This enables users to create new datasets that can be used to train models. It also enables users to revert the software to use previous versions of the model depending on the current use scenario.

Flask, a Python webserver, constructs the back-end interface which applies the model to the acquired data. The front-end framework, Angular, enables users to view model results with ease.

AbbVie project screenshots and logo
Team Members (left to right) Noel Vazquez
Round Lake Beach, Illinois
Alex Chirillo
Northville, Michigan
Henry Murdock
Ann Arbor, Michigan
Joe Cook
Birmingham, Michigan
Chirag Solanki
Grand Rapids, Michigan
Colton Leslie
Ortonville, Michigan

Michigan State University

Team Members (left to right)

Noel Vazquez
Round Lake Beach, Illinois

Alex Chirillo
Northville, Michigan

Henry Murdock
Ann Arbor, Michigan

Joe Cook
Birmingham, Michigan

Chirag Solanki
Grand Rapids, Michigan

Colton Leslie
Ortonville, Michigan

AbbVie

Project Sponsors

Ryan Chung
North Chicago, Illinois

Mike Dennis
North Chicago, Illinois

Ruben Quintero
North Chicago, Illinois

Daniel Tao
North Chicago, Illinois


Ally Financial: Agentic Collaborator

Ally Financial, headquartered in Detroit, Michigan is a leading entity in the U.S. financial services industry, known for its focus on digital banking and auto financing. The company serves approximately 11 million customers through a full range of online banking services. Being the nation’s largest online-only bank, Ally is at the forefront of revolutionizing financial interactions through technology.

Ally Financial employees handle hundreds of emails daily using Microsoft Outlook, but large threads with multiple collaborators make it difficult to track employee sentiment. The process of analyzing email responses is time-consuming, as employees must sift through large email chains to ensure nothing is overlooked. Hence, there is a growing need for technological solutions that can streamline this process, saving employees time and energy.

Our Agentic Collaborator is an artificial intelligence-powered solution created to enhance sentiment analysis and improve decision-making for Ally projects. The collaborator enables employees to monitor multiple decisions simultaneously, providing an overview of stakeholder responses in an easy- to-read dashboard.

Ally internal users are provided with an Outlook widget to flag email chains for monitoring. A summary of the thread responses is displayed on the web application where users can track the sentiment of email chains and who has responded. Quick actions, such as sending reminders to non-responsive stakeholders and opening email instances, make it easier to track project progress.

Our software utilizes a Microsoft Outlook add-in and a web application to deliver a powerful email analysis tool. The back end is built with Python, PostgreSQL, LangChain, and the OpenAI API for parsing and summarizing emails. The front end is developed using React, supported by a Node.js environment. Python Flask is used to handle data exchange between endpoints.

Ally project screenshots and logo

Team Members (left to right)

Andrew Chen
Bloomfield Hills, Michigan

Abdullah Baqai
Islamabad, Islamabad, Pakistan

Pranta Nir Barua
Chattogram, Chattogram, Bangladesh

Alison Schlacht
Chesterfield, Michigan

Stefan Lemke
Troy, Michigan

Areeb Islam
Troy, Michigan

Michigan State University

Team Members (left to right)

Andrew Chen
Bloomfield Hills, Michigan

Abdullah Baqai
Islamabad, Islamabad, Pakistan

Pranta Nir Barua
Chattogram, Chattogram, Bangladesh

Alison Schlacht
Chesterfield, Michigan

Stefan Lemke
Troy, Michigan

Areeb Islam
Troy, Michigan

Ally

Project Sponsors

Divyesh Jambusaria
Detroit, Michigan

Dan Lemont
Detroit, Michigan

Jesse Podell
Detroit, Michigan

John Stoutenger
Detroit, Michigan


Amazon: Remediating AWS Security Gaps Using Generative AI

Amazon is a multinational technology company that has grown to become the world’s largest retailer. Founded in 1994 by Jeff Bezos, Amazon has since expanded into various industries, including cloud computing, digital streaming and artificial intelligence.

As more users continue to use Amazon Web Services (AWS), they encounter challenges in configuring and monitoring their account’s security. Due to the platform’s complexity and broad range of services, it is imperative that users acquire a deep understanding of Amazon’s security features.

Currently, when an AWS user reviews their account security, they run a security scanning tool named Prowler. This tool generates a file with thousands of lines detailing security assessments they have passed or failed. Many users find this file difficult to understand.

Our Remediating AWS Security Gaps Using Generative AI tool streamlines the process of identifying, tracking, and fixing security issues through our interactive web application.

To use our application, users simply upload their file generated from Prowler. When users upload this report, machine learning models trained on hundreds of AWS security blogs and documentation generate easy-to-understand instructions. These instructions can be sorted by factors such as cost or danger so users can prioritize their vulnerabilities. Users also are given a security rating that provides the percentage of security vulnerabilities they have secured.

By leveraging these powerful AWS services, our tool provides users with an efficient, intuitive, and easy way to enhance their account security, ensuring peace of mind as they navigate the cloud.

Our web application is responsive due to a robust set of features provided by AWS. The front end is hosted on AWS Amplify, whilst back-end requests are managed by API Gateway, Lambda and S3.

Amazon project screenshots and logo
Team Members (left to right)

Ndiaga Diouf
Eastpointe, Michigan

Valdine Pegy Tchinda Pegou
Douala, Littoral, Cameroon

Sardar Murtaza
Chittagong, Chittagong, Bangladesh

Ilyas Abdulrahman
Detroit, Michigan

Nate Mikkola
Pontiac, Michigan

Michigan State University

Team Members (left to right)

Ndiaga Diouf
Eastpointe, Michigan

Valdine Pegy Tchinda Pegou
Douala, Littoral, Cameroon

Sardar Murtaza
Chittagong, Chittagong, Bangladesh

Ilyas Abdulrahman
Detroit, Michigan

Nate Mikkola
Pontiac, Michigan

Jaden Cabansag
Novi, Michigan

Amazon

Project Sponsors

Divyesh Jambusaria
Detroit, Michigan

Jennifer Free
Detroit, Michigan

Garret Gaw
Detroit, Michigan

Dean Schifilliti
Arlington, Virginia


Anthropocene Institute: Ocean Carbon Pollution Cleanup

The Anthropocene Institute is an organization based in California, whose goal is to solve the climate crisis by 2030. They promote education about the climate, connect experts with entrepreneurs and policymakers, and invest in technologies to make the Earth abundant and sustainable for future generations.

Removing excess carbon dioxide from the atmosphere is a crucial part of solving the climate crisis. Consequently, our client is partnering with the Grandparents Fund for Climate Restoration to design an ocean iron fertilization experiment. The experiment involves dispersing iron in the water to stimulate phytoplankton growth which sequesters carbon. Plankton growth is monitored by sensors mounted on ocean buoys. Usage of these sensors can be very expensive, so it is imperative that sensor locations are optimized to provide maximum ocean coverage with minimal cost.

Our Ocean Carbon Pollution Cleanup software models various buoy configurations to compare their effectiveness. Our software gives suggestions about how many sensors are required and which sensor layouts are best for recording adequate data during the experiment without going over budget.

Most existing datasets only contain a single buoy, which poses a problem for our system. To model multiple buoys from this data, older compatible datasets are combined and newer datasets are extrapolated using complex statistical methods to get estimated sensor readings for the entire experimental area.

Our software highlights the benefits of this carbon sequestration technique by visualizing the positive experimental outcomes.

The software features an appealing user interface built with the React framework. It connects to a FastAPI back end that retrieves data from a PostgreSQL database. This data is used to generate buoy configurations and create descriptive visualizations using Chart.js.

Anthropocene project screenshots and logo
Team Members (left to right)

Cam Koons
Durand, Michigan

Henry Bock
Grand Rapids, Michigan

Blake Potvin
Bloomfield Hills, Michigan

Faith Dawson
Austin, Texas

William Chasteen
Birmingham, Michigan

Nitin Polavarapu
Okemos, Michigan

Michigan State University

Team Members (left to right)

Cam Koons
Durand, Michigan

Henry Bock
Grand Rapids, Michigan

Blake Potvin
Bloomfield Hills, Michigan

Faith Dawson
Austin, Texas

William Chasteen
Birmingham, Michigan

Nitin Polavarapu
Okemos, Michigan

Anthropocene Institute

Project Sponsors

Melinda Alankar
Denver, Colorado

Peter Fiekowsky
Los Altos, California

Frank Ling
Tokyo, Japan

Carl Page
Palo Alto, California


Auto-Owners Insurance: From the Ground Up VR

Auto-Owners Insurance is a Fortune 500 company that provides automotive, home, life, and commercial insurance to nearly 3 million policyholders in 26 states. They have been headquartered in Lansing, Michigan since 1917, and are represented by 48,000 licensed agents.

In the insurance world, training new associates is a process that can take a lot of time and manpower. There are many details about insurance that are important for employees to know. Traditional training practices are informative but lack hands-on experience and can be unengaging.

From the Ground Up VR provides an enhanced training experience through a virtual reality video game, creating a new way for property claims associates to learn and engage with Auto-Owners’ policy. This software accelerates and personalizes the training process by enabling associates to navigate educational content at their own pace without the need for a human teacher.

Our software places users into a realistic virtual reality house. Associates navigate through the home and are tasked with discovering and identifying common building materials that are integrated into the environment. As the user finds items, information about relevant Auto-Owners insurance policies is displayed. After materials are collected, the game then asks the associate to use those materials to construct a home. Through these objectives, associates experience the process of building a home while also learning the basics of insurance, resulting in an informed and well-rounded employee.

The Unity game engine is used to model and represent the virtual environment. The game logic is implemented in C#, providing functionality and interactivity. The Meta Quest 3 VR headset is used by the player to access the virtual reality environment.

Auto-Owners project screenshots and logo
Team Members (left to right)

Owen Cochell

Ann Arbor, Michigan

Alex Hawkins

Shelby Township, Michigan

Elijah Medina

Lansing, Michigan

Emma Lamb

St. Clair, Michigan

Connor Blackmer

DeWitt, Michigan

Alan Feng

South Lyon, Michigan

Michigan State University

Team Members (left to right)

Owen Cochell
Ann Arbor, Michigan

Alex Hawkins
Shelby Township, Michigan

Elijah Medina
Lansing, Michigan

Emma Lamb
St. Clair, Michigan

Connor Blackmer
DeWitt, Michigan

Alan Feng
South Lyon, Michigan

Auto-Owners

Project Sponsors

Tony Dean
Lansing, Michigan

Ross Hacker
Lansing, Michigan

Scott Lake
Lansing, Michigan

Kolien Owens
Lansing, Michigan

Chad Peterman
Lansing, Michigan

Brad Schafer
Lansing, Michigan

DaCia Thompkins
Lansing, Michigan

Andrew Wegener
Lansing, Michigan

Julie Wilkinson
Lansing, Michigan


DRIVEN-4: DRIVEN-4 Connect Application

DRIVEN-4 is a technology consulting firm based out of St. Joseph, Michigan. The firm’s network of over 100 engineers and global partners drive solutions that have delivered over $50 million in business impact since 2017. Primary service offerings include product lifecycle management (PLM), connected product development (IoT), connected operations (IIoT) and cybersecurity.

The company’s latest innovation, a programmable logic controller (PLC) known as the DRIVEN-4 Connect Module, enables customers to create customizable data streams. However, this data can take several forms, presenting a challenge as DRIVEN-4 strives to provide comprehensive services to all client needs.

Our DRIVEN-4 Connect Application enables users to interact with their data streams from the Connect Module in a fast and easy manner. Users can manipulate data workflows and automate trivial processing stages for data analysis with only a few clicks.

Users first establish data storage capabilities by creating and editing project specifications on the web application’s data modifications tab. This creates a custom database for the user.

Once a database is created, the system automatically transmits the relevant data to the database to be stored for further use.

Clients query, relay, manipulate, visualize and derive insights from collected data. The data analysis and querying pages of the Connect Application display all available databases and associated tables. Clients select desired data sources and create custom scripted instructions on how to analyze relevant information. DRIVEN-4 also provides common scripts to make client data analysis easy, along with tutorial resources to ease onboarding.

The DRIVEN-4 Connect Application is powered by the Flask framework. Data is hosted in a MySQL database and accessed via SQLAlchemy. The analysis is conducted using Python scripts.

Driven-4 project screenshots and logo
Team Members (left to right)

Siddarth Satish
Glen Allen, Virginia

Quin Strausbaugh
Defiance, Ohio

Aiden Foley
Grandville, Michigan

Tess Murphy
New Boston, Michigan

A.J. Brummel
Grand Haven, Michigan

Michigan State University

Team Members (left to right)

Siddarth Satish
Glen Allen, Virginia

Quin Strausbaugh
Defiance, Ohio

Aiden Foley
Grandville, Michigan

Tess Murphy
New Boston, Michigan

A.J. Brummel
Grand Haven, Michigan

Mufeez Mulbagal
Riyadh, Central, Saudi Arabia

DRIVEN-4

Project Sponsors

Fred Bellio
Saint Joseph, Michigan

Ryan Slaugh
Saint Joseph, Michigan

Carl Wendtland
Saint Joseph, Michigan


General Motors: Recycling Identification System

General Motors (GM) is a multinational car manufacturer headquartered in Detroit, Michigan. They are at the forefront of innovation when it comes to car manufacturing as well as being industry leaders in sustainability.

To recycle plastics in their facilities, GM must identify what type of plastic has been discarded. While this can be easier for standardized plastics used in the production line, miscellaneous plastics that are not as easily identifiable are often thrown away. GM requires a quick way to identify these miscellaneous plastics.

Our Recycling Identification System provides an improved method for managing plastics and reducing waste by ensuring accurate identification, preventing improper disposal.

When an unidentified plastic is encountered, the plastic scanner swiftly identifies the material by scanning it and displaying the result on a connected smartphone.

Once the plastic is confirmed, the user places it in the appropriate bin. Additionally, the app tracks all previously scanned plastics, providing a convenient reference to the correct recycling bins.

Admins can train the model further whenever new plastic types are introduced in the facilities. This ensures accuracy is maintained when an employee is scanning unknown plastics in the bins. Composite plastics are supported seamlessly and automatically with our robust model.

Our system quickly and accurately identifies plastics for efficient recycling, reducing waste and carbon footprint.

Our Recycling Identification System is built with a handheld scanner integrated with an Arduino microcontroller. The scanner utilizes a feed-forward neural network, and the mobile app, developed using React Native, uses a SQL database to save and display the plastic data.

GM project screenshots and logo
Team Members (left to right)

Jerry Hoskins
Lake Orion, Michigan

Safiya Fareed
Brownstown, Michigan

Pedro De Oliveira Mitkiewicz
Belo Horizonte, Minas Gerais, Brazil

Matt Miller
West Bloomfield, Michigan

Andres Tamayo
Grand Rapids, Michigan

Keerthi Ramesh
Bangalore, Karnataka, India

Michigan State University

Team Members (left to right)

Jerry Hoskins
Lake Orion, Michigan

Safiya Fareed
Brownstown, Michigan

Pedro De Oliveira Mitkiewicz
Belo Horizonte, Minas Gerais, Brazil

Matt Miller
West Bloomfield, Michigan

Andres Tamayo
Grand Rapids, Michigan

Keerthi Ramesh
Bangalore, Karnataka, India

GM RIS

Project Sponsors

James Currie
Detroit, Michigan

Patrick Doyle
Detroit, Michigan

Jeffrey Seibert
Detroit, Michigan

Peter Wyatt
Detroit, Michigan


General Motors: Remote Wildlife Habitat Monitoring System

General Motors (GM) is a leading automotive company headquartered in Detroit, Michigan. GM produces and markets well-known vehicle brands including Buick, Chevrolet, GMC, and Cadillac. With many bold and innovative initiatives, including global carbon neutrality by 2040, GM is dedicated to sustainability and environmental protection for all.

GM has established 17 wildlife habitat facilities across the U.S., each spanning many acres. These habitats serve as sanctuaries for local wildlife, especially species of concern. Monitoring habitats and collecting wildlife data is essential for general analysis and habitat certification but it is very time- consuming for environmental engineers, diverting them from their other duties.

Our Remote Wildlife Habitat Monitoring System enables GM employees to access and analyze wildlife data directly from their computers and mobile devices. The system centralizes existing biodiversity data, automatically collecting real-time data using existing GM monitoring hardware and cloud-based data storage. Data is presented in an easy-to-understand format through graphs and charts for comprehensive analysis.

The system also includes an interactive map where users can record, share, and view wildlife sightings, updating the database in real time. This feature fosters a collaborative approach to habitat monitoring, making it simpler and more efficient for experts and laypeople alike.

The Habitat Monitoring System is comprised of a web application developed using Flask, which leverages Python on the back end and HTML, CSS and JavaScript on the front end. It is also available as a mobile application for both Android and iOS platforms, developed using Flutter for optimal cross- platform performance. MongoDB, hosted on a Linux server, supports the database needs of both the web and mobile applications.

GM project screenshots and logo
Team Members (left to right)

Jacob Walsh
Grand Rapids, Michigan

Sanjay Bhuvaneswaran
Rochester Hills, Michigan

Chase Halligan
Clarkston, Michigan

Anna Clark
Grandville, Michigan

Jude Cox
Battle Creek, Michigan

Kevin Zhang
Farmington Hills, Michigan≠

Michigan State University

Team Members (left to right)

Jacob Walsh
Grand Rapids, Michigan

Sanjay Bhuvaneswaran
Rochester Hills, Michigan

Chase Halligan
Clarkston, Michigan

Anna Clark
Grandville, Michigan

Jude Cox
Battle Creek, Michigan

Kevin Zhang
Farmington Hills, Michigan


GM WHMS

Project Sponsors

Patrick Doyle
Detroit, Michigan

Jeffrey Seibert
Detroit, Michigan

Steve Tomaszewski
Detroit, Michigan


HAP: Healthcare Payer Price Transparency

HAP is a Detroit-based healthcare insurer that strives to offer quality healthcare plans and innovation to their customers. With a workforce of more than 1,000 employees, HAP provides insurance solutions for just over 400,000 members across Michigan with 50,000 healthcare provider partners.

Modern healthcare providers face a competitive field. Since 2021, the Centers for Medicare and Medicaid Services has required healthcare and health insurance companies to publish their rates in standardized, machine-readable files. With this, large amounts of previously unknown data are now being published to the public, which creates a new avenue for data analysis.

Our Healthcare Payer Price Transparency tool uses these machine-readable files to provide business insights that were previously difficult to assess. The application leverages modern artificial intelligence with big data analysis to draw conclusions about healthcare plans such as plan coverage, covered providers, and costs to both the company and customer.

The Healthcare Payer Price Transparency web application stores files that contain information about healthcare rates from both HAP and external competitors. Users select which files they are interested in analyzing and have the option of uploading new files. The application reads the files and creates data visualizations that make it easy for the user to draw conclusions.

If the user has further questions about the files or data, they can begin a conversation with our AI chatbot that provides quick analysis of anything that interests the user.

The front end of the web application is built using industry standard HTML and CSS. For our back end, we leveraged Parquet files to store large quantities of data in smaller pieces. Python is used to manipulate data to produce insights. ChatGPT API is used for generative artificial intelligence.

HAP project screenshots and logo
Team Members (left to right)

Alvin Hoang
Holland, Michigan

Joshua Thomas
Novi, Michigan

Manan Vyas
Gandhidham, Gujarat, India

Sai Upparapalle
Novi, Michigan

Drew Hamilton
Holt, Michigan

Mansour Alblooshi
Al Ain, Abu Dhabi, United Arab Emirates

Michigan State University

Team Members (left to right)

Alvin Hoang
Holland, Michigan

Joshua Thomas
Novi, Michigan

Manan Vyas
Gandhidham, Gujarat, India

Sai Upparapalle
Novi, Michigan

Drew Hamilton
Holt, Michigan

Mansour Alblooshi
Al Ain, Abu Dhabi, United Arab Emirates

HAP

Project Sponsors

Angela Endres
Detroit, Michigan

Steve Neubecker
Detroit, Michigan


Henry Ford Innovations: Modernizing Robotic Surgery Education

Henry Ford Health is one of the nation’s largest and most respected healthcare providers located in Detroit, Michigan. At Henry Ford Health, medical professionals and expert researchers collaborate to develop and adopt new healthcare technologies. The partnership made between Henry Ford Health Innovations and Michigan State University advances medical education and improves patient well-being.

Many modern surgical techniques involve the use of some robotic components. Modern learners have an advantage in robotic operation due to the proliferation of technology in recent years. Modern students achieve high proficiency in robotic operation faster than previous generations, and therefore the training systems for robotic surgery tools need to be updated.

Currently, each completed training run requires a review from an expert-level provider, costing the healthcare system money and costing surgeons time.

Our Modernizing Robotic Surgery Education system reduces how many trials it takes a modern learner to gain expert-level status for each educational task. This reduces training time for learners and saves valuable time for surgeons who review the training.

Using statistical analysis and machine learning technology on robotic surgery training data, our dashboard displays visuals that find the most effective training modules and predict success rates of residents based on metrics collected from the robotic surgery console.

Our system identifies redundancies in the robotic training program, reducing training time and saving money.

Scikit-learn is used to identify the most important metrics that indicate success for surgeons as they complete various training tasks. The dashboard is developed by importing this data into Microsoft PowerBI.

Henry Ford Innovations project screenshots and logo
Joseph Eisho
Hazel Park, Michigan

Olivia Jordahl
Midland, Michigan

Sid Pawa
Novi, Michigan

Lilly Yanke
Novi, Michigan

Jacob Guty
Macomb Township, Michigan

Shaili Annadurai
Troy, Michigan

Michigan State University

Team Members (left to right)

Joseph Eisho
Hazel Park, Michigan

Olivia Jordahl
Midland, Michigan

Sid Pawa
Novi, Michigan

Lilly Yanke
Novi, Michigan

Jacob Guty
Macomb Township, Michigan

Shaili Annadurai
Troy, Michigan

Henry Ford
Innovations RSE

Project Sponsors

Surya Nalamati
Detroit, Michigan

Vikas Relan
Detroit, Michigan

Alexander Reynolds
Detroit, Michigan


Henry Ford Innovations: MSU-HFH Research Synergy Vanguard Portal (RSVP)

Henry Ford Health (HFH), based in Detroit, Michigan, is a leading healthcare system renowned for its commitment to innovation in medical research. In partnership with Michigan State University (MSU), HFH bridges the gap between clinical needs and academic expertise across both institutions.

Clinicians at HFH and faculty at MSU face challenges in connecting across disciplines due to fragmented communication channels and a lack of centralized resources. This hinders the potential for interdisciplinary research and limits opportunities for collaboration among clinicians and experts such as engineers and scientists.

Our Research Synergy Vanguard Portal (RSVP) solves this by providing a platform that automatically suggests potential collaborators. Our system analyzes user expertise and interests to recommend ideal partners, fostering interdisciplinary connections that might not occur otherwise.

Our portal integrates data from HFH and MSU and enables researchers and clinicians at both institutions to find research collaborators with a simple and intuitive keyword search.

With our profiles connection page, users manage their own detailed profiles, highlighting their expertise, interests and the resources that they have available. This facilitates direct communication, enabling users to connect, share ideas, and initiate collaborative projects seamlessly.

Our system connects MSU and HFH researchers and clinicians, improving collaboration and reducing time spent searching.

Our portal is built using a ReactJS front end for a dynamic user interface and a Flask back end for application logic. We utilize Bidirectional Encoder Representations from Transformers (BERT) for natural language processing to enhance search capabilities, and Elasticsearch for efficient search performance.

Henry Ford Innovations RSVP project screenshots and logo

Michigan State University

Team Members (left to right)

Mannan Dhillon
Canton, Michigan

Michael Faucher
Chesterfield, Michigan

Aarham Khan
Dhaka, Dhaka, Bangladesh

Harshita Rathod
Jackson, Michigan

Pranav Shukla
Rochester Hills, Michigan

Tom Brown
Aurora, Illinois

Henry Ford
Innovations RSVP

Project Sponsors

Scott Dulchavsky
Detroit, Michigan

Madison Myers
Detroit, Michigan

Vikas Relan
Detroit, Michigan

Alexander Reynolds
Detroit, Michigan


Kohl’s: Governance of Expense in Kohl’s Cloud Operations

Kohl’s, founded in 1962 by Maxwell Kohl, is a leading omnichannel retailer with over 1,100 stores across 49 states. Offering a wide range of apparel, home goods, and lifestyle products, Kohl’s is committed to using cutting-edge technology to enhance customer experiences and optimize its vast operations. As part of this effort, Kohl’s leverages the Google Cloud Platform (GCP) to manage over 7,000 cloud-based projects.

Despite GCP’s powerful infrastructure, the scale and complexity of Kohl’s operations poses challenges in monitoring costs, managing resources, and ensuring overall cloud efficiency. Existing tools are not equipped to handle the high volume and complexity of data, which makes it difficult for Kohl’s to gain real-time insights into their cloud performance.

To address these challenges, our Governance of Expense in Kohl’s Cloud Operations platform provides real-time monitoring and actionable insights into GCP data.

Our platform provides comprehensive visibility into cloud project expenses, showcasing potential cost-saving opportunities for each. Detailed instructions on how to reduce costs are listed in an easy-to-understand way so users can cut costs effortlessly.

Our software also features visual graphs for historical data, tracking trends in resource usage over time, helping stakeholders identify inefficiencies and optimize cloud operations.

Finally, the platform sends automated alerts to key stakeholders through Slack, helping employees make informed decisions in a timely manner on cost management, resource utilization, and security improvements.

Our system is fully dockerized and hosted on GCP powered by Kubernetes. On the back end, data is pulled from Big Query database and processed through a Python Flask server. This is displayed on the front end via a ReactJS web interface.

Kohl's project screenshots and logo
Jason Lin
Harrison Township, Michigan

David Lingan
Orland Park, Illinois

Aiden Dixon
Rochester, Michigan

Meredith Heberling
Rochester, Michigan

Adhyan Negi
New Delhi, Delhi, India

Samay Achar
Troy, Michigan

Michigan State University

Team Members (left to right)

Jason Lin
Harrison Township, Michigan

David Lingan
Orland Park, Illinois

Aiden Dixon
Rochester, Michigan

Meredith Heberling
Rochester, Michigan

Adhyan Negi
New Delhi, Delhi, India

Samay Achar
Troy, Michigan

Kohl’s

Project Sponsors

Thad Craft
Menomonee Falls, Wisconsin

James Hendley
Menomonee Falls, Wisconsin

Will White
Menomonee Falls, Wisconsin


Launch by NTT DATA: Spatial IoT Control using Apple Vision Pro

Launch by NTT Data is a global digital business that helps their clients to strategize, ship and scale digital experiences. They have developed innovative solutions for brands such as Ford, Epic Games, and Adidas.

As virtual and augmented reality technology matures and becomes more usable, virtual experiences continue to have an ever-increasing role in how we go about our daily lives. As a leader in creating innovative digital experiences, Launch explores how new devices like the Apple Vision Pro can be used to enable users to interact with their environment, specifically to control smart devices in their homes.

To this end, our Spatial IoT Control using Apple Vision Pro is a visionOS and iOS application that controls home appliances like plugs, lights and other appliances through a sleek and seamless interface.

Our software recognizes and tracks devices in the user’s view. When a device has been identified, a pop-up appears over it that the user can interact with to change the state of the device. For example, when a smart lamp enters the view of the Vision Pro, a toggle switch view is displayed above the lamp, which turns the lamp on and off when selected.

Our software enables actions involving other smart home appliances using various hand gestures recognizable by the Vision Pro, including sliding, pinching, and twisting.

In addition, IoT devices can be controlled via iPhone using our iOS application, which has the same features and functionality as the visionOS app. This provides more flexibility in how users can control their home appliances.

Both applications are written in Swift. Interaction with tracked objects is enabled through the RealityKit and ARKit frameworks, and devices are controlled via HTTP and MQTT protocols.

Launch project screenshots and logo
Team Members (left to right)

Noah Wolff
Grand Rapids, Michigan

James Ashworth
Novi, Michigan

Jacob Hakala
Kalamazoo, Michigan

Sanaye Lewis
Kennesaw, Georgia

Nathan Motzny
Troy, Michigan

Ethan Egger
Williamston, Michigan

Michigan State University

Team Members (left to right)

Noah Wolff
Grand Rapids, Michigan

James Ashworth
Novi, Michigan

Jacob Hakala
Kalamazoo, Michigan

Sanaye Lewis
Kennesaw, Georgia

Nathan Motzny
Troy, Michigan

Ethan Egger
Williamston, Michigan

Launch

Project Sponsors

Scott Campagna
Troy, Michigan

Jeff Meador
Troy, Michigan


Magna: Offline-Ready Mobile App for Delivery Optimization

Magna International is a leading global automotive supplier, focusing on delivering value to their customers through innovative processes and world class manufacturing. Magna New Mobility wing is committed to solving the complex challenges involved in the development of advanced mobility solutions.

Delivery drivers often face challenges with network connectivity and efficient route planning. This can impact their ability to complete deliveries in a timely manner. Similarly, fleet operators who oversee deliveries need real-time updates into the progress of deliveries to ensure everything runs smoothly.

Our Mobile App for Delivery Optimization enhances the efficiency of delivery operations by providing an application that works in areas with poor network connectivity. It optimizes drivers’ delivery routes, managing multiple consignments, and tracking their progress in real time. The mobile application leverages artificial intelligence to batch orders based on pickup and drop-off locations, while accommodating for configurable truck sizes.

Our system enables drivers to access the navigation system even if they are not connected to a network, ensuring the delivery process is not hindered by the loss of a network connection.

For fleet operators, the web dashboard provides a comprehensive view of the progress of deliveries. The dashboard displays real-time locations of the drivers and status of each order. This web application offers options for operators to intervene in a delivery if necessary, such as manually editing a consignment.

The front end is implemented in Flutter separately for both mobile and web applications. The back end encompasses route computation using NextBillion.ai and Node.js. Moreover, remote and local data storage is synchronized between both platforms using MongoDB.

Magna MADO project screenshots and logo
Team Members (left to right)

Adam Farkas
Northville, Michigan

Muhammad Shaikh
Karachi, Sindh, Pakistan

Shrey Kohli
Dehradun, Uttrakhand, India

Mia Granata
Chicago, Illinois

Chetan Chigurupati
Hyderabad, Telangana, India

Shane Patrarungrong
St. Joseph, Michigan

Michigan State University

Team Members (left to right)

Adam Farkas
Northville, Michigan

Muhammad Shaikh
Karachi, Sindh, Pakistan

Shrey Kohli
Dehradun, Uttrakhand, India

Mia Granata
Chicago, Illinois

Chetan Chigurupati
Hyderabad, Telangana, India

Shane Patrarungrong
St. Joseph, Michigan

Magna MADO

Project Sponsors

Esha Gavali
Troy, Michigan

Jim Quesenberry
Troy, Michigan

Raidu Rayasam
Troy, Michigan

Sundar Selvaraj
Troy, Michigan

Princi Sharma
Troy, Michigan


Magna: Test-Driven Development for Embedded Software

Founded in 1957, Magna is a leading global manufacturer in automotive parts, providing innovative products and services to nearly every automaker worldwide. As an industry leader, Magna has significantly advanced vehicle safety and technology through systems such as advanced driver assistance, blind-spot detection, and lane departure warnings.

One of the most innovative areas in the automotive industry today is autonomous driving systems, and Magna is at the forefront of this technology. To ensure the reliability of these systems, it is crucial that vehicles’ vision cameras are thoroughly tested.

Managing and testing the software behind vision cameras is not an industry standard due to the difficulties of testing hardware dependent code. Regardless, a test-driven approach can avoid critical errors, reduce the time required to diagnose errors, and increase code quality.

Our Test-Driven Development for Embedded Software platform introduces test-driven development to Magna’s existing surround view camera system and creates an automated testing process for a continuous integration and development pipeline.

Whenever a Magna employee publishes code to their GitHub repository, our platform runs a series of tests on the published code. Our tests fully probe the code base for any new errors that may have been introduced. This ensures the updates do not negatively impact other parts of the system.

Users are also able to analyze the percentage of the code tested to ensure that the platform has full coverage of the code base.

The test cases are written in the C++ language, using the CppUTest framework. The code is tested automatically whenever a push is made to GitHub, using the workflow automation platform GitHub Actions. Our workflow also uses LCOV and Python scripts to collect and display test metrics.

Magna TDD4ES project screenshots and logo
Team Members (left to right)

Matthew Wu
Rochester Hills, Michigan

Camilo Carmona
Guilford, Connecticut

David Mikola
South Lyon, Michigan

Eliezer Amponsah
Livonia, Michigan

Duong Nguyen
Hanoi, Vietnam

Radhe Patel
Grandville, Michigan

Michigan State University

Team Members (left to right)

Matthew Wu
Rochester Hills, Michigan

Camilo Carmona
Guilford, Connecticut

David Mikola
South Lyon, Michigan

Eliezer Amponsah
Livonia, Michigan

Duong Nguyen
Hanoi, Vietnam

Radhe Patel
Grandville, Michigan


Magna TDD4ES

Project Sponsors

Nikhil Parlapalli
Troy, Michigan

Jim Quesenberry
Troy, Michigan


Magna: Visualizing Neural Network Gradients

Founded in 1957, Magna has established itself as the largest automotive supplier in North America. With over 60 years of experience supplying components and systems to manufacturers worldwide, Magna is a visionary leader, driving the evolution of the automotive industry.

In the ever-evolving world of artificial intelligence, understanding how neural networks learn has been a complex challenge for engineers. Monitoring model performance, diagnosing issues, and optimizing architectures can be a daunting task, especially when working with large-scale networks.

Our Visualizing Neural Network Gradients software solves this problem for Magna, offering an innovative two- part solution: a logger, and a visualization tool. The logger seamlessly integrates into engineers’ existing machine learning pipelines, collecting data in real time. The visualization tool offers an interactive interface that provides an intuitive representation of the model’s learning process, revolutionizing how engineers analyze their networks, placing an emphasis on convenience and actionable insight.

Our platform provides detailed 2D and 3D visualizations of the neural network structure, with each layer and gradient dynamically visualized to reflect performance metrics like gradient flow and magnitude. Engineers can monitor performance in real time and identify potential issues with the network, such as vanishing or exploding gradients, enabling more efficient troubleshooting and model optimization.

Built using Electron, our platform leverages Three.js for 3D visualization, creating a fully immersive environment. The Python-based logger supports two widely used machine learning frameworks, PyTorch and TensorFlow, recording gradient and network data in HDF5 files that smoothly integrate with the visualization tool for real-time analysis.

Magna VNNG project screenshots and logo
Team Members (left to right)

Devin Dematto
Hastings, Michigan

Arhan Mulay
Santa Clara, California

Don Truong
Ho Chi Minh, Vietnam

Sarah Regan
McLean, Virginia

An Le
Hanoi, Vietnam

Alex Stornant
Birmingham, Michigan

Michigan State University

Team Members (left to right)

Devin Dematto
Hastings, Michigan

Arhan Mulay
Santa Clara, California

Don Truong
Ho Chi Minh, Vietnam

Sarah Regan
McLean, Virginia

An Le
Hanoi, Vietnam

Alex Stornant
Birmingham, Michigan

Magna VNNG

Project Sponsors

Jim Quesenberry
Troy, Michigan

Rajeev Verma
Troy, Michigan


Magna: World Feature Generation for ADAS Simulation

Headquartered in Aurora, Ontario, Magna is one of the world’s largest automotive suppliers that designs, develops, and manufactures automotive systems, assemblies and components. Magna provides services for major automakers across vehicle development, engineering, and manufacturing.

Currently, a major focus for Magna is to expand products relevant to self-driving vehicles. Unfortunately, testing these systems is quite difficult. Simulators are often used to ease this difficulty, but these simulations require hand-created environments for virtual vehicles to navigate and take hours to create.

Our World Feature Generation for Advanced Driver Assistance Systems Simulation streamlines the process by procedurally generating environments in Unreal Engine 4. Road layouts are generated from real-world street map data. These are preprocessed to apply modifications such as variable numbers of lanes. They are then imported to Unreal Engine where the maps are created before a postprocess scrubs over them and applies parameters such as weather, debris, and visibility. Individual world features are then randomized with additional parameters. This enables more fine-grained variation, such as a stop sign that has bent due to impact with a car, or a flickering streetlamp.

Our software enables further detailed alterations in an easy- to-access manner through an intuitive UI present in Unreal Engine. This trims down the time and manpower required to simulate edge cases while also enabling minute adjustments. This transforms hours of work into as little as the click of a button.

Our tool utilizes Unreal Engine in cooperation with several other technologies: Carla built from source, a program for importing sensors and actors to test self-driving car software; OpenStreetMap, which provides detailed road data from around the world; and Blender for asset modification.

Magna WFG4ADAS project screenshots and logo
Team Members (left to right)

Ethan Gomez
Macomb, Michigan

Walker McDonald
Ponce Inlet, Florida

Gabe Militello
Commerce Township, Michigan

Yi Wu
Wayne, Pennsylvania

Rohit Chavan
Okemos, Michigan

Jake Brown
Farmington Hills, Michigan

Michigan State University

Team Members (left to right)

Ethan Gomez
Macomb, Michigan

Walker McDonald
Ponce Inlet, Florida

Gabe Militello
Commerce Township, Michigan

Yi Wu
Wayne, Pennsylvania

Rohit Chavan
Okemos, Michigan

Jake Brown
Farmington Hills, Michigan

Magna WFG4ADAS

Project Sponsors

Banu Büyüker
St.Valentin, Austria

Jim Quesenberry
Troy, Michigan

Daniel Schleicher
St.Valentin, Austria


Meijer: Increasing Awareness of Meijer-Branded Products

Meijer is a prominent Midwest supercenter chain headquartered in Grand Rapids, Michigan, with over 250 stores across six states. Meijer is committed to offering value and quality through its 18 in-house brands.

With consumers having several options to choose from when selecting a grocery store, it is important for Meijer to foster their brand and provide incentives for people to continue shopping at their stores. Our project, Increasing Awareness of Meijer-Branded Projects, is a web application that achieves this goal by promoting Meijer-branded products and business practices.

The core of the website is the integration of product purchases and donations. When customers purchase three Meijer-branded products, Meijer donates the value of the highest priced item in the customer’s cart to one of the many food pantries it supports through its ‘Simply Give’ donation program.

The web application also incorporates gamified rewards through the rebranded mPerks program. A personalized mPerks dashboard tracks every customer’s order history, rewarding them with coupons as they accrue points and surpass specific point thresholds. Customers earn badges for milestones like ‘first timer’ for their first purchase and ‘century’ when their order history exceeds 100 dollars.

The dashboard features two meters: a shopping streak meter that tracks consecutive weeks shopping at Meijer, rewarding the customer with coupons as their streak increases, and a donation impact meter showing total donations made on behalf of the customer’s purchases.

The front end of the system used ReactJS. The back end utilizes C# and .NET, while the entire platform is hosted on Microsoft Azure. Data is managed through Microsoft SQL Server, and Power BI dashboards provide real-time analytics for tracking engagement.

Meijer projects and logo
Team Members (left to right)

Viraj Shah
Troy, Michigan

Robby Dewar
Royal Oak, Michigan

Mackenzi Steinmetz
St. Clair Shores, Michigan

Ishi Saripalle
Novi, Michigan

Sonia Thalatoti
Vijayawada, Andhra Pradesh, India

Michigan State University

Team Members (left to right)

Viraj Shah
Troy, Michigan

Robby Dewar
Royal Oak, Michigan

Mackenzi Steinmetz
St. Clair Shores, Michigan

Ishi Saripalle
Novi, Michigan

Sonia Thalatoti
Vijayawada, Andhra Pradesh, India

Meijer

Project Sponsors

Ariel Firon
Grand Rapids, Michigan

Phil Kane
Grand Rapids, Michigan

Terry Ledbetter
Grand Rapids, Michigan

John Morrison
Grand Rapids, Michigan


Michigan State University: Robotic Job Coaching

The Department of Computer Science and Engineering (CSE) is one of the largest academic units at Michigan State University. The department is home to 20 laboratories equipped with cutting-edge technologies that enable research in a wide spectrum of topics. The department leverages its impressive research capabilities in collaboration with other departments in areas of robotics, mechatronics, special education, psychology and more.

The CSE department hosts many research professionals from various fields who are collaborating to develop an innovative system for workplace training. Job coaching is a powerful tool for supporting the employment of individuals with disabilities, especially cognitive and behavioral disabilities. Existing methods of job coaching face several issues. On- site job coaching faces limitations because a coach must be physically present.

Our Robotic Job Coaching system solves many problems with modern job coaching techniques. Job coaches can now oversee many clients simultaneously and remotely. Coaches connect in a teleconference call with any one of their clients instantly using a queue system. Importantly, job coaches control a robotic arm to empower better teaching. The arm holds an iPad, which is running our application, and thus the coach can change their view of the work area at will.

Our system extends the influence of job coaches beyond in-person training to efficient remote conferencing. Unlike traditional conference software, our solution gives coaches the ability to manipulate their point of view, increasing effectiveness of coaching.

The front end of our application uses the SwiftUI framework. The back-end server uses the Flask web framework. The application communicates to the back-end server over the WebSocket protocol. The server initiates a peer-to-peer connection over WebRTC between the client and coach users.

Michigan State University CSE project screenshots and logo
Team Members (left to right)

Kyle Roleson
Hamburg Township, Michigan

Ekene Umobi
Abuja, FCT, Nigeria

Adam Cohen
Chesterfield, Missouri

Olivia Pal
Kharagpur, West Bengal, India

Stavro Polis
Sterling Heights, Michigan

Kaiwen Jiang
Kunming, Yunnan, China

Michigan State University

Team Members (left to right)

Kyle Roleson
Hamburg Township, Michigan

Ekene Umobi
Abuja, FCT, Nigeria

Adam Cohen
Chesterfield, Missouri

Olivia Pal
Kharagpur, West Bengal, India

Stavro Polis
Sterling Heights, Michigan

Kaiwen Jiang
Kunming, Yunnan, China

Michigan State University CSE

Project Sponsors

Ashrut Aryal
East Lansing, Michigan

Hung Jen Kuo
East Lansing, Michigan

Ranjan Mukherjee
East Lansing, Michigan

Charles Owen
East Lansing, Michigan


MSU Federal Credit Union: Branch Pickup Lockers

MSU Federal Credit Union (MSUFCU) has been serving Michigan State University and the greater Lansing area for over 84 years. MSUFCU strives to help its local communities thrive and achieve financial freedom.

MSUFCU members are currently restricted by traditional operating hours when they need to pick up essential items such as debit cards or important documents. MSUFCU is looking to introduce a more efficient, self-service solution that provides members with flexibility and convenience.

Our Branch Pickup Lockers system is a mobile application that enhances the customer experience by providing convenient access to banking items outside regular branch hours. Customers can request these items and securely retrieve them at any time using a One Time Passcode (OTP).

Users select the items they need and choose the most convenient branch for pickup through the MSUFCU app. Once the user arrives at the selected branch, they can request a unique six-digit OTP from their app. This code grants immediate access to the locker containing the requested items.

Employees can easily manage requests and unlock lockers through a responsive web application that notifies members when their order is ready to be retrieved.

Members can easily track the status of their order and retrieve items whenever they are ready. This system improves operational efficiency for MSUFCU and offers members flexibility.

The front ends for the web, iOS and Android apps are developed using Vue.js, Swift and Java respectively. These communicate with a back-end API written in Python Flask and store data in a PostgreSQL database. The smart lockers are controlled through a Raspberry Pi, which communicates with the system to manage the locks using 12V relay modules and magnetic locks.

Team Members (left to right)

Abdulla Alblooshi
Al Ain, Abu Dhabi, United Arab Emirates

Lucas Fankhauser
Toledo, Ohio

Rida Mahmood
Jubail, Eastern Province, Saudi Arabia

Will Morant
Grand Rapids, Michigan

David Kuehn
West Chicago, Illinois

Michigan State University

Team Members (left to right)

Abdulla Alblooshi
Al Ain, Abu Dhabi, United Arab Emirates

Lucas Fankhauser
Toledo, Ohio

Rida Mahmood
Jubail, Eastern Province, Saudi Arabia

Will Morant
Grand Rapids, Michigan

David Kuehn
West Chicago, Illinois

MSUFCU

Project Sponsors

April Clobes
East Lansing, Michigan

Filip Danielewicz
East Lansing, Michigan

May Isrow
East Lansing, Michigan

Ben Maxim
East Lansing, Michigan

Meredith Nicholoff
East Lansing, Michigan


Roosevelt Innovations: Intelligent Benefits Parser and Knowledge Assistant

Roosevelt Innovations, a subsidiary of Delta Dental of Michigan, develops software for insurance processing. Based in Okemos, Michigan, they support over 23 million customers with their reliable software platforms. With years of experience, Roosevelt helps health and dental insurers streamline group rate calculations and claims processing.

When a new business user transfers data to Roosevelt’s applications, they must translate the terminology of their insurance to a standardized format that the Roosevelt platform uses. This is a time-consuming process, since the files containing insurance information are lengthy and differ in formatting depending on the insurance company. During this process, the user often has to read and reference this insurance file multiple times to extract all of the required information.

Our Intelligent Benefits Parser and Knowledge Assistant software solves this problem through a web application that automatically extracts important insurance information from insurance benefit documents.

The extracted information is stored and displayed in fields on a validation page. Users on the validation page review and adjust the data to align with Roosevelt Innovations’ standardized format. The software includes storage and organization for many PDFs, enabling users to work within many different sessions.

The application is also equipped with a knowledge assistant chatbot. The knowledge assistant provides relevant, context-specific answers when asked about the content within an insurance document.

Our system’s front end is built using the Angular framework. The back end utilizes FastAPI. All data for our application is stored on MongoDB Atlas. The knowledge assistant runs on the OpenAI API.

Roosevelt project screenshots and logo
Team Members (left to right)

Brenden Cwiek
White Lake, Michigan

Jada Clark
Marquette, Michigan

Kyle Raeside
Clinton Township, Michigan

Riley Cook
Beverly Hills, Michigan

Austin Sawicki
Howell, Michigan

Maanasi Ganapathy
Dallas, Texas

Michigan State University

Team Members (left to right)

Brenden Cwiek
White Lake, Michigan

Jada Clark
Marquette, Michigan

Kyle Raeside
Clinton Township, Michigan

Riley Cook
Beverly Hills, Michigan

Austin Sawicki
Howell, Michigan

Maanasi Ganapathy
Dallas, Texas

Roosevelt Innovations Knowledge Science

Project Sponsors

Mukundan Agaram
Okemos, Michigan

Jacob Ernst
Okemos, Michigan

Daniel Magaway
Okemos, Michigan


RPM: Automated VIN Integration for RPM Logistics

RPM is an international logistics and supply chain solutions company based in Royal Oak, Michigan. RPM specializes in freight transportation and vehicle logistics across North America and Europe. As a non-asset logistics company, RPM invests heavily in modern technologies and automation solutions.

RPM uses an internal whiteboard to display and process orders that come in as email attachments. This is a time- intensive process that requires employees to manually hunt down orders. To reduce human involvement, RPM wants to automate incoming order emails and significantly minimize manually processed orders.

Our Automated VIN Integration Software achieves this by automating vehicle order types processed by email. The software receives incoming email orders, classifies the attachments and extracts details for order creation. Our AI models analyze text and CSV files, providing manual order creation for additional file types. Our software improves error detection by using external tools and common data input patterns for order validation.

The software visualizes order statistics and customized metrics tailored to the customer or specific date ranges, enabling improved customer insight. Brokers can access the software on RPM’s internal company apps platform for simple integration into current processes. Our software provides automated support to RPM brokers, minimizing overhead costs and significantly reducing order processing time.

The React front end and Flask back end are containerized using Docker and hosted on Azure hosting services. Our software uses Python and JavaScript, in addition to various Azure services. Utilizing Azure functions and HTTP triggers, the software classifies and uploads documents. OpenAI’s API extracts text and returns a structured JSON output. After error checking, the JSON formatted order is posted to the RPM order API from Flask.

RPM project screenshots and logo
Team Members (left to right)

Connor Sheridan
Macomb, Michigan

Ajay Suresh
Troy, Michigan

Brandon Linville
Whitmore Lake, Michigan

Palmer McGuire
Lake Orion, Michigan

Thomas Huynh
Grand Rapids, Michigan

Michigan State University

Team Members (left to right)

Connor Sheridan
Macomb, Michigan

Ajay Suresh
Troy, Michigan

Brandon Linville
Whitmore Lake, Michigan

Palmer McGuire
Lake Orion, Michigan

Thomas Huynh
Grand Rapids, Michigan

RPM

Project Sponsors

Rick Grubb
Royal Oak, Michigan

Synica Melton
Royal Oak, Michigan

Andy Thielking
Royal Oak, Michigan


Stryker: Surgical OR Instruments and Needle Tracking

Stryker is a Fortune 500 company that provides world class medical technologies to hospitals worldwide. From surgical equipment to neurotechnology, Stryker impacts over 150 million patients annually across more than 75 countries.

Millions of surgical procedures are performed each year. Throughout each procedure, safety is critical to ensure the best outcome for the patient. The impact of retained surgical items is a major safety concern. Nearly 12 times daily, retained surgical items occur in the USA. Retained surgical items lead to financial strain, malpractice allegations, and threaten a patient’s wellbeing.

Our Surgical OR Instruments and Needle Tracking iOS app uses real-time tracking and verification checkpoints to improve accuracy and efficiency of tracking instruments within the operating room (OR).

When opening the app, the surgical operating room schedule is displayed. From there, the user may select a procedure to begin tracking. Once selected, the user is directed to pre-check, where initial scans of surgical tools are taken for automated tracking in addition to manual verification. During active surgery, a live feed and the use state of surgical tools is shown. A final post-check is enabled to verify all instruments and needles are accounted for.

Users view, update, and add surgical procedures with corresponding tool catalogs. If circumstances require, tool catalogs may be updated mid-procedure as well. Status logs from completed operations are also available for audit and analytical purposes.

Our app aligns with Stryker’s mission to make healthcare better by saving surgical personnel time, minimizing error and decreasing retained surgical items.

The app’s front end uses Swift, SwiftUI and UIKit. CoreML integrates our YOLO model and PyTorch. Node.js and Express.js are used to run the back end. The data is hosted on an Ubuntu Server.

Stryker project screenshots and logo
Team Members (left to right)

Ryan Filipiak
Dexter, Michigan

Duong Tran
Hanoi, Vietnam

Joshua Mae
Rochester Hills, Michigan

Ashley Siegmund
Midland, Michigan

Declan Bahen
Canton, Michigan

Aditya Chaudhari
Aurangabad, Maharashtra, India

Michigan State University

Team Members (left to right)

Ryan Filipiak
Dexter, Michigan

Duong Tran
Hanoi, Vietnam

Joshua Mae
Rochester Hills, Michigan

Ashley Siegmund
Midland, Michigan

Declan Bahen
Canton, Michigan

Aditya Chaudhari
Aurangabad, Maharashtra, India

Stryker IST

Project Sponsors

Martin Griffin
Portage, Michigan

Patrick Lafleche
Portage, Michigan

Ross Nave
Portage, Michigan

Slaven Sutalo
Portage, Michigan


TechSmith: Video Insight and Knowledge Interface (VIKI)

Founded in 1987, TechSmith is the global leader in screen recording and screen capture technologies. TechSmith creates software that empowers people to produce extraordinary videos and images. TechSmith’s software products, notably Camtasia and Snagit, have over 65 million users across 222 countries.

In the modern world of short form content, social media, and hyper-personalized content everywhere, reaching your intended audience is crucial. Unfortunately, tailoring videos for specific audiences is very difficult for beginners. Furthermore, making sure videos are clear, concise, and entertaining is hard without receiving outside opinions. There is currently not much guidance and recommendation built into the editing platforms.

Our Video Insight and Knowledge Interface (VIKI) web application enables video creators to upload videos and receive tailored feedback based on custom AI audience members.

Users create AI reviewers and detail unique characteristics of each persona. For example, a professor uploads a video to VIKI and creates a student persona to give constructive feedback specifically tailored to videos in a university setting. There is no limit to the personas that can be created, ensuring any video can be properly tailored to any audience.

This feedback is based on multiple metrics such as tone, clarity, pace, content, etc. A final engagement score is also provided along with recommendations for improvement. VIKI has an integrated interactive timeline that is segmented into sections, where each section has feedback on the different metrics. This enables users to pinpoint exact moments where their video could be improved.

The front end of VIKI is built using ReactJS while our back end is built with FastAPI. Our web application is hosted using Microsoft Azure. VIKI uses OpenAI and Hugging Face models, and Azure AI Video Indexer to provide feedback.

TechSmith project screenshots and logo
Team Members (left to right)

Samuel Blashill
Park Ridge, Illinois

Brandon Hwang
Seoul, South Korea

Andrew Strominger
Highland, Michigan

Sania Sinha
Kolkata, West Bengal, India

Tyler McDonald
Rochester Hills, Michigan

Prajeeth Naliganti
Okemos, Michigan

Michigan State University

Team Members (left to right)

Samuel Blashill
Park Ridge, Illinois

Brandon Hwang
Seoul, South Korea

Andrew Strominger
Highland, Michigan

Sania Sinha
Kolkata, West Bengal, India

Tyler McDonald
Rochester Hills, Michigan

Prajeeth Naliganti
Okemos, Michigan

TechSmith

Project Sponsors

Dorie Blaisdell
East Lansing, Michigan

Wendy Hamilton
East Lansing, Michigan

Derek Hammond
East Lansing, Michigan

Tony Lambert
East Lansing, Michigan

Michael Malinak
East Lansing, Michigan

Scott Schmerer
East Lansing, Michigan

Craig Smith
East Lansing, Michigan

Xochitl Weiss
East Lansing, Michigan


Union Pacific: Virtual Reality Inspection Training

Union Pacific has been building America for more than 160 years. Founded July 1, 1862, they are one of the largest railroad companies in the United States. With over 32,693 miles of track in 23 western states, Union Pacific boasts an impressive lineup of over 7,154 locomotives and a team of over 32,973 employees.

Identifying defective or faulty equipment is a safety-critical task performed by all Union Pacific engineers. However, it is challenging to train employees to perform this task as defective equipment is either repaired or discarded. A remote and easily available solution is needed to train engineers on how to inspect railroad equipment.

Our Virtual Reality Inspection Training system modernizes Union Pacific’s training by converting existing training modules into a virtual reality (VR) format, creating an engaging and immersive environment for railcar inspection. Employees practice inspections in a hands-on manner, significantly improving both safety measures and operational efficiency. By shifting traditional training into a virtual space, workers receive more interactive experiences while gaining immediate feedback on their performance.

Our solution handles user interaction across different platforms, such as the Meta Quest 3 headset and an online learning management system (LMS). Each training session generates a unique PIN, which manages a user’s details and tracks their progress. With the LMS integration, scores are automatically recorded and stored, simplifying the overall process.

The back end of the system, using Java and Spring Boot, connects to a PostgreSQL database, while the React-based interface handles the user experience and course setup. The VR headset communicates with the back end to access necessary data and submit completed course results, ensuring smooth interaction between all components.

Union Pacific project screenshots and logo
Team Members (left to right)

Nicolas Georgescu
Grand Rapids, Michigan

Tyler Ziegenfelder
Orchard Lake, Michigan

Luc Walz
Grosse Pointe, Michigan

Sasha Tarasova
Lansing, Michigan

Sean Burch
Tampa, Florida

Mohammad Zaman
Warren, Michigan

Michigan State University

Team Members (left to right)

Nicolas Georgescu
Grand Rapids, Michigan

Tyler Ziegenfelder
Orchard Lake, Michigan

Luc Walz
Grosse Pointe, Michigan

Sasha Tarasova
Lansing, Michigan

Sean Burch
Tampa, Florida

Mohammad Zaman
Warren, Michigan

Union Pacific

Project Sponsors

Jeff Girbach
Milford, Michigan

Adam Halley
Omaha, Nebraska

Hunter Oestmann
Johnson, Nebraska

Brian Partlow
Omaha, Nebraska

Prasanna Rajendran
Omaha, Nebraska

Daniel Riedel
Lincoln, Nebraska


Urban Science: Predicting Automotive Sales Using Generative AI

Urban Science is a leading global consulting firm headquartered in Detroit, Michigan that has provided tailored insights and solutions for the automotive industry worldwide since 1977. They leverage data and business science to help clients increase market share, improve profitability, and enhance customer satisfaction.

Automotive companies rely on Urban Science to make effective and efficient insights based on rapidly updating statistics. This helps them to increase their profitability in the competitive automotive industry. Urban Science is called upon to help these automotive dealers make decisions and strategize, but with constant data changes it can be difficult and time-consuming to give each company personal recommendations.

Our Predicting Automotive Sales Using Generative AI web application uses generative artificial intelligence to give recommendations to dealers based on automotive sales predictions, delivering analytics faster and easier than ever.

The Insight Portal web application interface has multiple data analysis pages. Users select options from four categories: brand, state, date and model, and receive a display of unique data pertaining to the options selected. Users also interact with the artificial intelligence model in the form of a chatbot to gain insights from the data on the fly.

The application displays data unique to automotive dealers statewide in several different forms, including traditional charts and graphs, and also an intuitive heat map. The application uses sales predictions data to create recommendations via our artificial intelligence model, encouraging improvement in profitability, market share, and customer satisfaction.

Our web application is built using React and Tailwind for the front end, MySQL for data storage, and C# and .NET framework for the back end. The software utilizes Azure cloud services for hosting.

Urban Science project screenshots and logo
Team Members (left to right)

Quang Nguyen
Hanoi, Vietnam

Sam Wycoff
Clarkston, Michigan

Zeeshan Naeem
Sterling Heights, Michigan

Max Tetlow
Plymouth, Michigan

Aidan Gollan
Traverse City, Michigan

Trinity Johnson
Detroit, Michigan

Michigan State University

Team Members (left to right)

Quang Nguyen
Hanoi, Vietnam

Sam Wycoff
Clarkston, Michigan

Zeeshan Naeem
Sterling Heights, Michigan

Max Tetlow
Plymouth, Michigan

Aidan Gollan
Traverse City, Michigan

Trinity Johnson
Detroit, Michigan

Urban Science

Project Sponsors

Pratap Chennamoulu
Detroit, Michigan

Pierre Gilbert
Detroit, Michigan

Majd Nashwati
Detroit, Michigan


Vectra AI: AI Cyberattack Early Warning System

Vectra AI, founded in 2011, is an industry leader in cybersecurity and artificial intelligence. One of the many highlights of Vectra AI is that they successfully utilize artificial intelligence to detect complex cyberattacks before they occur. Additionally, they can do so without decrypting their client’s sensitive information. Vectra AI serves clients in 113 countries and is on the CRN Security 100, as well as the Forbes AI 50 List.

Vectra AI has a system that simulates cyberattacks before they occur. This state-of-the-art simulator replicates complex attacks when given valid parameters. However, Vectra AI needs to spend dozens of manhours to extrapolate data about new cyberattacks from online articles and reports to accomplish this.

To remedy this problem, advancements to Vectra AI’s system must be made. That is where our AI Cyberattack Early Warning System comes in. Utilizing large language models, we gather parameters from credible cyberattack reports, relevant threat intel resources, and other URLs gathered by trusted engineers.

With this data, the AI Cyberattack Early Warning System then runs simulations using Vectra AI’s C2 Simulator, as well as other common cyberattack tools. From there, this data is stored in Vectra’s database and is presented back to users in a user-friendly interface.

Our system predicts and identifies impending attacks before they happen, based solely on web traffic data. Vectra AI can then stop the attack before sensitive data is compromised.

The AI Cyberattack Early Warning System is a local web application that uses a Flask framework for the UI, Playwright as a webscraper to gather information from articles, Gemini as a large language model to extrapolate the configurations, and MySQL as the database where all valid new information is stored. Rubeus, and Mimikatz are used as additional cyberattack tools.

Vectra project screenshots and logo
Team Members (left to right)

Ajay Kumar
Farmington Hills, Michigan

Aleksa Popovic
Belgrade, New Belgrade, Serbia

Alex Fortsch
Rochester, New York

Morghane McAnelly
Rochester Hills, Michigan

Graham Holley
Kalamazoo, Michigan

Jacob Sock
Detroit, Michigan

Michigan State University

Team Members (left to right)

Ajay Kumar
Farmington Hills, Michigan

Aleksa Popovic
Belgrade, New Belgrade, Serbia

Alex Fortsch
Rochester, New York

Morghane McAnelly
Rochester Hills, Michigan

Graham Holley
Kalamazoo, Michigan

Jacob Sock
Detroit, Michigan

Vectra AI

Project Sponsors

Campbell Robertson
Traverse City, Michigan

Brad Woodberg
Plymouth, Michigan


Volkswagen Group of America: Safe Journey AI

Volkswagen Group of America, a subsidiary of the global Volkswagen Group, continues to lead in automotive innovation and sustainable transportation. Volkswagen operates in over 140 markets with production in 12 countries.

Drivers often face various external risks during their journeys, including areas with unpredictable weather, crime, and traffic hazards, all of which can compromise their safety.

Safe Journey AI addresses these concerns by using intelligent routing features to enhance driver safety. Our software is powered by artificial intelligence, dynamically updating route recommendations based on real-time safety ratings.

Drivers are provided with continuous updates on the safest paths, avoiding high-risk areas and offering alternative routes when necessary. The system provides suggestions for safe parking and refueling options, ensuring a secure journey from start to finish. Drivers can set their own safety preferences for a more customized experience.

The system is integrated directly into Volkswagen’s in-car navigation system, offering an easy-to-use interface that keeps drivers informed without distracting them.

Our platform offers real-time updates while on the road and gives drivers unparalleled control through intuitive and adjustable safety settings, helping drivers stay safe without distractions.

Safe Journey AI offers a reliable approach to route planning, aligning with Volkswagen’s focus on safer and smarter transportation solutions.

Our software leverages React for the front end, Quart for the back end, and Google Cloud Platform for scalable hosting. Machine learning models built with TensorFlow process vast amounts of crime and weather data, providing accurate and dynamic safety ratings for use in routing suggestions.

Volkswagen project screenshots and logo
Team Members (left to right)

Sudhanv Komanduri
Okemos, Michigan

Navya Singh
Dubai, United Arab Emirates

Ricardo Quinonez
San Salvador, El Salvador

Shashank Jayaram
Troy, Michigan

Pranav Premchand
Sterling Heights, Michigan

Maui Baba
Royal Oak, Michigan

Michigan State University

Team Members (left to right)

Sudhanv Komanduri
Okemos, Michigan

Navya Singh
Dubai, United Arab Emirates

Ricardo Quinonez
San Salvador, El Salvador

Shashank Jayaram
Troy, Michigan

Pranav Premchand
Sterling Heights, Michigan

Maui Baba
Royal Oak, Michigan

Volkswagen

Project Sponsors

Igor Efremov
Auburn Hills, Michigan

Hassan Elnajjar
Auburn Hills, Michigan

Frank Weith
Auburn Hills, Michigan


Whirlpool Corporation: Cooking GPS

Whirlpool Corporation, headquartered in Benton Harbor, Michigan, is a global home appliance manufacturer with approximately $19 billion in annual sales, 55 manufacturing and research centers, and 59,000 employees. Whirlpool’s mission is to improve satisfaction and engagement with their home appliances.

Kitchen appliance technology has advanced significantly over the last decade. However, the consumer experience and interaction has stayed relatively stagnant. The responsibility and effort to prepare a meal at home falls entirely on a home cook, often with very little assistance.

Our Cooking GPS alleviates the mental stress involved with meal coordination. The mobile application enables users to choose from pre-curated meals or incorporate singular recipes into a customized meal. When the user is ready to start the cooking process, the software compiles all preparation steps into a single easy-to-follow instruction list that accounts for time and efficiency.

Once meal preparation begins, the user is taken to a screen that displays all cooking steps ordered by start time. The current step is highlighted, displaying specific preparation instructions and necessary ingredients. In addition, a progress bar and estimated completion time is shown to communicate preparation progress. Once a step is completed, the user dismisses it. Completed steps are available to view by scrolling up on the meal preparation screen.

The Cooking GPS system is fully integrated into Whirlpool appliances, displaying steps in progress with relevant information such as timers, oven cycles, and stovetop burner temperatures.

The front ends for the Cooking GPS mobile application and smart appliance application are built using the Flutter framework. The back end consists of a Flask server connected to our job-shop algorithm and a WebSocket server to facilitate communication between the mobile application and appliance application.

Whirlpool project screenshots and logo
Team Members (left to right)

Conner Smith
Troy, Ohio

Ruitao Liu
Jinhua, Zhejiang, China

Bruce Smith
Clawson, Michigan

Audrey Parsons
Wixom, Michigan

Chris Swiecicki
Grand Rapids, Michigan

Connor Wurtz
Kalamazoo, Michigan

Michigan State University

Team Members (left to right)

Conner Smith
Troy, Ohio

Ruitao Liu
Jinhua, Zhejiang, China

Bruce Smith
Clawson, Michigan

Audrey Parsons
Wixom, Michigan

Chris Swiecicki
Grand Rapids, Michigan

Connor Wurtz
Kalamazoo, Michigan

Whirlpool

Project Sponsors

Alessandro Gigante
Cassinetta, Italy

Elizabeth (Liz) Kacpura
Benton Harbor, Michigan

Jackie Li
Benton Harbor, Michigan

Estefany Chavez Ruiz
Benton Harbor, Michigan


WK Kellogg Co: Cereal Industry Analysis Tool Using Generative AI

WK Kellogg Co, home to some of the world’s most iconic cereal brands, is one of the largest food manufacturing companies in the nation. Headquartered in Battle Creek, Michigan, WK Kellogg has grown into a major player in the food industry, thanks to its global reach and ability to adapt to shifting consumer demands.

WK Kellogg currently operates in the competitive global food market in over 180 countries. Operating at such a large scale, it is important for the company to stay up to date on current business and market trends.

Our Cereal Industry Analysis Tool Using Generative AI automates data analysis through a web application. The website enables analysts and financial professionals to extract valuable insights regarding WK Kellogg and their competitors. This information can then be used by the company to assist in making business decisions and developing strategies to enhance the WK Kellogg brand.

WK Kellogg employees navigate to the web application and select a large language model to perform analysis on the large amount of stored data. Users then pose questions to our intelligent chatbot to gain valuable insights into business performance. Users can ask questions about industry shifts, market trends, business strategies, and more. The chatbot provides detailed responses throughout the conversation, empowering users to make informed business decisions.

The platform uses public datasets stored in Snowflake, which serves as the primary data warehouse. SQL commands interact with the Snowflake database and extract information from stored files. Streamlit, a Python framework, powers the front end of the web application. The application enables user interaction via a chatbot, which leverages large language models for generating detailed responses.

WK Kellogg Co project screenshots and logo
Team Members (left to right)

Anand Pinnamaneni
Ann Arbor, Michigan

Daniel Flanagan
Huntington Woods, Michigan

Shubh Sharma
Kolkata, West Bengal, India

Roshni Kaur
Lansing, Michigan

Suryansh Singh
Mumbai, Maharashtra, India

Samin Matin
Dhaka, Dhaka, Bangladesh

Michigan State University

Team Members (left to right)

Anand Pinnamaneni
Ann Arbor, Michigan

Daniel Flanagan
Huntington Woods, Michigan

Shubh Sharma
Kolkata, West Bengal, India

Roshni Kaur
Lansing, Michigan

Suryansh Singh
Mumbai, Maharashtra, India

Samin Matin
Dhaka, Dhaka, Bangladesh

WK Kellogg Co

Project Sponsors

Federico Conde
Battle Creek, Michigan

Gerry Finck
Battle Creek, Michigan

Bill Rex
Battle Creek, Michigan

Aaron Smith
Battle Creek, Michigan

Jay Swiatek
Battle Creek, Michigan

James Wright
Battle Creek, Michigan