Capability Broker: A Tool for Mapping Capabilities with LLMs

Sammanfattning

In dynamic business environments, adaptive ways of working are essential for effective development and management. The need to respond to internal and external contextual changes has therefore increased interest in a capability-driven approach. However, fostering capability-thinking requires organizations to invest resources in identifying, mapping, and managing capabilities, which can be complex and time-intensive processes. Hence, many organizations may be discouraged from fully engaging in capabilities. As Large Language Models (LLMs) have been explored in the field of conceptual modeling it raises the question if they can also be used to assist in modeling and managing capabilities. This thesis presents the development of an LLM-based artifact to generate organization-specific capability maps from diverse document sources. The proposed artifact aims to support efficient identification, mapping and management of organizational capabilities within the NATO Architecture Framework version 4 (NAFv4). A Design Science Research methodology guided the development of the artifact, utilizing Action Research to explicate the problem, define requirements, and iteratively develop the resulting artifact. The final developed artifact was evaluated in workshops with domain experts in Enterprise Modeling (EM) and subsequently through a distributed questionnaire. It was found that the artifact could extract plausible capabilities and activities from organizational documents and label them accordingly, thereby speeding up the process of capability development. While the artifact can’t replace a domain expert, it can be used to create an initial draft of a capability map that an expert can revise.