CapCut Usability Testing Evaluating AI-Powered Video Editing Tools
Understanding User Experience and Improving Workflow Efficiency
Background
CapCut, an AI-powered video editing platform, provides tools for creators at various skill levels—from novices to professionals. This usability study aimed to evaluate the usability, functionality, and overall user experience of CapCut’s AI Magic Tools and interface.
Our research sought to identify usability barriers, cognitive load issues, and user pain points across three different user groups (novice, intermediate, and expert).
Roles & Responsibilities
User Research: Secondary Desk Research, Competitive Analysis, User Interviews
Moderator: Usability Testing, In-Depth Interview, Cognitive Walkthrough with Participants
Reporting & Documentation: Created questionnaires, test protocol, scripts, and usability report with key findings and insights
The Vision
Triangulation Method (Mixed-Methods)
Usability Testing
Task-based interaction with CapCut’s editing tools
Our vision was to help improve CapCut’s usability to expand customer growth by providing profitable consumer insights.
Card Sorting
Evaluating feature categorization and user mental models
Key Objectives
Gather quantifiable metrics to assess the overall user friendliness & effectiveness of CapCut’s tools
Data Collection
A data log was used to record performance metrics such as error rate, post-test, and post-task questionnaires.
Task Completion Difficulty
Novice users found AI tools overwhelming
Intermediate users struggled with navigation, but adapted
Expert users expected more advanced customization
Identify current user challenges and pain points through qualitative methods
Research Findings
User Pain Points
Novice users had a steep learning curve (icons lacked clarity, confusing onboarding)
Intermediate users found too many UI elements on the home screen & inconsistent workflows
Expert users found AI tools were too simplified, preferred manual control
Takeaways
Weaknesses
Strengths
Post-Task Interviews
Capturing qualitative feedback on usability and frustrations
Gain in-depth knowledge of user trends and desires of features in video editing platform
User Satisfaction Score
Novice users needed better onboarding
Intermediate users appreciated AI-powered efficiency
Expert users liked the versatility, but wanted more customization
Card Sorting Analysis
Users preferred a feature hierarchy based on task goals rather than tool-based navigation
Unclear icons led to longer learning times for novice users
CapCut may have a steep learning curve or lack intuitive features for beginner and novice users
Lack of User Guidance: novice users might feel overwhelmed or lost due to its insufficient tutorials and guidance within the platform
New icons: Lack of understanding what certain icons mean
Social media integration (TikTok and Instagram)
Versatility: Wide range of editing tools and effects on both web and mobile platforms, catering to the needs of both intermediate and expert users
Design Recommendations
Improve Onboarding: Implement interactive walkthroughs and contextual tooltips
Revamp Navigation: Shift from a tool-based to a goal-based UI structure
Enhance AI Customization: Provide expert users with manual override options in AI editing tools
Quick Summary
My Role
I recruited participants, collected and analyzed their data, facilitated the study sessions, and derived actionable insights from in-depth questioning
My Impact
Guides enhancements in user onboarding, interface clarity, and AI feature customization to boost user satisfaction and engagement
What’s Next?
Future research should explore further customization for advanced users to optimize the app’s effectiveness and user retention