The echocardiogram allows for a comprehensive assessment of the cardiac musculature and valves, but its rich temporally resolved data remain underutilized. Here, the authors develop a video AI system trained to predict post-operative right ventricular failure.