BABAJIDE
OWOYELE
Data-driven theory-guided researcher developing cartographic frameworks for mapping role constellations in sustainability transitions. PhD candidate leveraging design science for multimodal data analysis across diverse data sources, including audio-visual recordings.
CURRENT
PhD Candidate
DRIFT, Erasmus University
AIIS, Hasso Plattner Institute
FOCUS
Design Science Research
Multimodal Ananlytics
Sustainability Transitions
LOCATION
Rotterdam, Netherlands
Potsdam, Germany
FUNDING
NWO Grant Recipient
International Collaboration
Open Science Advocate
RESEARCH
MULTIMODAL DATA ANALYSIS
Computational frameworks for gesture, speech, and visual data in collaborative settings. Focus on co-speech gesture detection and kinematic analysis.
DESIGN SCIENCE RESEARCH
Creating innovative artifacts that bridge academic theory with practical solutions for complex social systems.
SUSTAINABILITY TRANSITIONS
Using computational methods to understand how authors and their concepts enact social systems that de(accelerate) sustainability at scale.
AI ETHICS & PRIVACY
Developing privacy-preserving tools for research data while maintaining scientific utility and accessibility.
COMMUNITY BUILDING
Leading collaborative platforms that democratize access to multimodal research tools and foster international scientific communities.
ACTOR ROLE CARTOGRAPHY
Mapping role plurality and interconnectedness in multi-actor constellations.
SELECTED WORK
Featured Projects
SMASH
2024-2025 • NWO FundedSynthesis and Multimodal Analytics System for Humanities
Leading development of a fully open-source tool that analyzes non-verbal communication - body language, facial expressions, and speech patterns. SMASH integrates privacy-preserving data archiving with behavioral analysis, making multimodal communication research accessible to non-programmers.
Capabilities
- • Hand gesture analysis & diversity metrics
- • Facial expression & posture tracking
- • Voice tone variation analysis
- • Automatic speech transcription
Impact
- • Cross-cultural speaker databases
- • Clinical research applications
- • Social sciences & humanities tool
- • Privacy-first data archiving
Collaboration: Radboud University, Hasso Plattner Institute • Co-investigators: Gerard de Melo, Wim Pouw
EnvisionBOX
Core Team Lead • OngoingCommunity Platform for Multimodal Data Analysis
Community-driven platform for sharing multimodal data analysis solutions. Leading the development of open-source tools that lower entry barriers for newcomers in multimodal signal processing and analysis.
Mission
- • Increase research transparency & reproducibility
- • Lower entry barriers for newcomers
- • Foster international collaboration
- • Democratize multimodal research tools
Community Impact
- • Teaching modules & dynamic dashboards
- • Full body tracking with MediaPipe
- • International research collaboration
- • Educational platform serving globally
Team: Cognitive scientists, AI researchers, linguists across Europe • Partners: Tilburg University, University of Amsterdam, Leibniz Centre Berlin
Other Projects
EnvisionHGdetector Framework
2025Computational framework for co-speech gesture detection and kinematic analysis in multimodal communication research.
MaskAnyone Toolkit
2024Privacy-preserving strategies for audio-visual data archiving that balance open science with personal data protection.
Deep Narratives Africa (DNA)
StealthSocio-semantic analysis of development actor narratives across African institutions using natural language processing.
Publications
EnvisionHGdetector: A Computational Framework for Co-Speech Gesture Detection, Kinematic Analysis, and Interactive Visualization
Preprint • 2025 • Co-authored with Wim Pouw, Bosco Yung, Sharjeel Ahmed Shaikh
Computational framework for kinematic analysis of automatically detected co-speech gestures from single-person videos using TensorFlow and five open datasets.
MaskAnyone Toolkit: Offering Strategies for Minimizing Privacy Risks and Maximizing Utility in Audio-Visual Data Archiving
ResearchGate • 2024
Privacy-preserving toolkit for researchers to de-identify individuals in video and audio while balancing open science with personal data protection.
StudyU: A Platform for Designing and Conducting Innovative Digital N-of-1 Trials
Journal of Medical Internet Research • 2022 • DOI: 10.2196/35884
Open source platform including StudyU Designer and app for conducting personalized N-of-1 trials with innovative user-centric elements.
StudyMe: A New Mobile App for User-Centric N-of-1 Trials
PMC • 2022 • Co-authored with Alexander M Zenner, Stefan Konigorski
Mobile application supporting non-experts in conducting multi-crossover self-experiments to evaluate intervention effects on personal health goals.
Designing for Value Creation: Principles, Methods, and Case Insights from Embedding Designing-as-Performance in Digital Health Education and Research
Springer Design Thinking Research • 2022 • DOI: 10.1007/978-3-031-09297-8_10
Exploration of value creation principles in healthcare through stakeholder engagement in academia and industry, with focus on education and training.
Designing as Performance: Bridging the Gap Between Research and Practice in Design Thinking Education
Springer Design Thinking Research • 2021 • DOI: 10.1007/978-3-030-62037-0_3
Research-based training materials for high-performing design teams, bridging the gap between design thinking research and practice in education.
Neurodesign Live
Springer Design Thinking Research • 2021 • DOI: 10.1007/978-3-030-62037-0_17
Cross-disciplinary exploration of synergies at the intersection of neuroscience, engineering, and design thinking in collaborative innovation processes.
Exploring Ecosystem Orchestration Patterns and Systemic Intermediaries in Social Media
SSRN • 2022 • DOI: 10.2139/ssrn.4042351 • Co-authored with Arash Hajikhani
Analysis of social media ecosystems using digital trace data to map ecosystem orchestration and communication patterns in European Innovation Systems.
Exploring Digital Health Solutions: Personalised Medicine and N-of-1 Trials in Ghana - A Scoping Review
Preprint • 2024 • Co-authored with Godsway Sackey, Frank Kwesi Baiden, Stefan Konigorski
Scoping review of digital health applications and personalized medicine approaches in Ghana, examining N-of-1 trial implementations.
Multimodal Mapping of Structure and Temporality of Institutional Logics in Multi-Actor Constellations
ResearchGate • Ongoing Research
Development of proto-ontology for socio-institutional analysis in sustainability transitions using computational literature review and machine learning.
CONTACT
Open to research collaborations, speaking opportunities, and innovative projects in computational sustainability.