Evaluating two cross-platform frameworks using Cognitive Dimensions

Sammanfattning

Cross-platform frameworks enable development for multiple platforms, such as iOS and Android, using the same codebase. Evaluation of cross-platform frameworks has traditionally been geared towards technical assessments and, more seldom, targeted usability, leaving a gap to be explored. This paper presents a usability analysis of Flutter and React Native, supported by a user study using the Cognitive Dimensions of Notations framework (CDN framework). Six developers were recruited and interviewed with the CDN framework questionnaire and a thematic analysis was performed where several usability issues, benefits and design trade-offs were identified. A recurring topic amongst the React Native developers was issues regarding hooks, while the Flutter developers unanimously identified problems relating to layout design. React Native was highlighted for its abstraction and progressive evaluation capabilities, indicating an edge toward Flutter. In contrast, comments regarding Flutters tooling capabilities and UI libraries showed an edge towards React Native. The identified usability benefits and trade-off characteristics give insight into each framework’s strengths and weaknesses.