ABSTRACT: This paper described the collection of multi-modal physiological signals, which include electroencephalography, electrocardiograph (ECG), photoplethysmography, electrodermal activity, temperature, and accelerometer data, recorded from 89 healthy college students during resting state, the emotion induction and recovery, and a set of cognitive function assessment tasks. Emotion, sleep, cognition, depression, mood, and other factors were evaluated through different methods, and were included in this dataset. Six emotions (neutral, fear, sad, happy, anger, and disgust) were induced by movie clips. The cognitive functions such as sustained attention, response inhibition, working memory, and strategy use, were quantitatively measured by Cambridge neuropsychological test automatic battery. The sleep ECG was collected the night before the emotion-induction experiment, and the sleep quality was analysed based on the sleep ECG. After the experiment, the participants were required to fill in questionnaires to evaluate the emotion regulation strategies, depression score, recent mood, and sleep quality index. The database can not only be directly used for the research of emotion recognition on multi-modal physiological signals, but also can further explore the interactions between emotion, cognition, and sleep.