Highly automated vehicles control the lateral and longitudinal movement of the vehicle in defined use cases, without being monitored by the human driver. According to the high and full automation level defined by SAE J3016 the driver may request the deactivation of the automated driving system at any time. However, interventions by the driver can lead to critical situations, especially in highly dynamic driving situations. Therefore, this paper investigates at which point driver interventions during highly automated driving can be critical and how the driver can be assisted in order to avoid dangerous driver inputs. To answer these questions, this paper presents concepts for intervention assistance systems that are implemented, tested and evaluated in a driving simulator.