Adaptive Learning Recommendation Strategy Based on Deep Q-learning.
Ontology highlight
ABSTRACT:
SUBMITTER: Tan C
PROVIDER: S-EPMC7262997 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Today, due to the expansion of the Internet and social networks, people are faced with a vast amount of dynamic information. To mitigate the issue of information overload, recommender systems have become pivotal by analyzing users' activity histories to discern their interests and preferences. However, most available social image recommender systems utilize a static strategy, meaning they do not adapt to changes in user preferences. To overcome this challenge, our paper introduces a dynamic image recommender system that leverages a deep reinforcement learning (DRL) framework, enriched with a novel set of features including emotion, style, and personality. These features, uncommon in existing systems, are instrumental in crafting a user's characteristic vector, offering a personalized recommendation experience. Additionally, we overcome the challenge of state representation definition in reinforcement learning by introducing a new state representation. The experimental results show that our proposed method, compared to some related works, significantly improves Recall@k and Precision@k by approximately 7%-10% (for the top 100 images recommended) for personalized image recommendation.
| S-EPMC10994284 | biostudies-literature
Project description:Deep learning, a subset of artificial intelligence, gives easy way for the analytical and physical tasks to be done automatically. There is a less necessity for human intervention while performing these tasks. Deep hybrid learning is a blended approach to combine machine learning with deep learning. A hybrid deep learning (HDL) model using convolutional neural network (CNN), residual network (ResNet) and long short term memory (LSTM) is proposed for better course selection of the enrolled candidates in an online learning platform. In this work, a hybrid framework that facilitates the analysis and design of a recommendation system for course selection is developed. A student's schedule for the next course should consist of classes in which the student has shown interest. For universities to schedule classes optimally, they need to know what courses each student wants to take before each course begins. The proposed recommendation system selects the most appropriate course that can encourage students to base their selection on informed decision making. This system will enable learners to obtain the correct choices of courses to be studied.
| S-EPMC10703022 | biostudies-literature
Project description:Multipose face recognition system is one of the recent challenges faced by the researchers interested in security applications. Different researches have been introduced discussing the accuracy improvement of multipose face recognition through enhancing the face detector as Viola-Jones, Real Adaboost, and Cascade Object Detector while others concentrated on the recognition systems as support vector machine and deep convolution neural networks. In this paper, a combined adaptive deep learning vector quantization (CADLVQ) classifier is proposed. The proposed classifier has boosted the weakness of the adaptive deep learning vector quantization classifiers through using the majority voting algorithm with the speeded up robust feature extractor. Experimental results indicate that, the proposed classifier provided promising results in terms of sensitivity, specificity, precision, and accuracy compared to recent approaches in deep learning, statistical, and classical neural networks. Finally, the comparison is empirically performed using confusion matrix to ensure the reliability and robustness of the proposed system compared to the state-of art.
| S-EPMC7532404 | biostudies-literature
Project description:The deep multiple kernel Learning (DMKL) method has attracted wide attention due to its better classification performance than shallow multiple kernel learning. However, the existing DMKL methods are hard to find suitable global model parameters to improve classification accuracy in numerous datasets and do not take into account inter-class correlation and intra-class diversity. In this paper, we present a group-based local adaptive deep multiple kernel learning (GLDMKL) method with lp norm. Our GLDMKL method can divide samples into multiple groups according to the multiple kernel k-means clustering algorithm. The learning process in each well-grouped local space is exactly adaptive deep multiple kernel learning. And our structure is adaptive, so there is no fixed number of layers. The learning model in each group is trained independently, so the number of layers of the learning model maybe different. In each local space, adapting the model by optimizing the SVM model parameter α and the local kernel weight β in turn and changing the proportion of the base kernel of the combined kernel in each layer by the local kernel weight, and the local kernel weight is constrained by the lp norm to avoid the sparsity of basic kernel. The hyperparameters of the kernel are optimized by the grid search method. Experiments on UCI and Caltech 256 datasets demonstrate that the proposed method is more accurate in classification accuracy than other deep multiple kernel learning methods, especially for datasets with relatively complex data.
| S-EPMC7498035 | biostudies-literature
Project description:Colloidal self-assembly-the spontaneous organization of colloids into ordered structures-has been considered key to produce next-generation materials. However, the present-day staggering variety of colloidal building blocks and the limitless number of thermodynamic conditions make a systematic exploration intractable. The true challenge in this field is to turn this logic around and to develop a robust, versatile algorithm to inverse design colloids that self-assemble into a target structure. Here, we introduce a generic inverse design method to efficiently reverse-engineer crystals, quasicrystals, and liquid crystals by targeting their diffraction patterns. Our algorithm relies on the synergetic use of an evolutionary strategy for parameter optimization, and a convolutional neural network as an order parameter, and provides a way forward for the inverse design of experimentally feasible colloidal interactions, specifically optimized to stabilize the desired structure.
| S-EPMC8769546 | biostudies-literature
Project description:In recent years, with the development of spatial crowdsourcing technology, online car-hailing, as a typical spatiotemporal crowdsourcing task application scenario, has attracted widespread attention. Existing researches on spatial crowdsourcing are mainly based on the coordinate positions of user and worker roles to achieve task allocation with the goal of maximum matching number or lowest cost. However, they ignores the problem of the selection of the pick-up point which needs to be solved in the actual scene of online car booking. This problem needs to take into account the four-dimensional coordinate positions of users, workers, pick-up point and destination. Based on this, this study designs a pick-up point recommendation strategy based on user incentive mechanism. Firstly, a new four-dimensional crowdsourcing model is established, which is closer to the practical application of crowdsourcing problem. Secondly, taking cost optimization as the index, a user incentive mechanism is designed to encourage users to walk to the appropriate pick-up point within a certain distance. Thirdly, a concept of forward rate is proposed to reduce the computation time. Some key factors, such as the maximum walking distance limit of users and task cost, are considered as the recommendation index for measuring the pick-up point. Then, an effective pick-up point recommendation strategy is designed based on this index. Experiments show that the strategy proposed in this article can achieve reasonable recommendation for pick-up points and improve the efficiency of drivers and reduce the total trip cost of orders to the greatest extent.
| S-EPMC10703052 | biostudies-literature
Project description:Recently, more personalized travel methods have emerged in the tourism industry, such as individual travel and self-guided travel. The service models of traditional tourism limit the diversity of service options and cannot fully meet the individual needs of tourists anymore. The aim is to integrate sparse tourism information on the Internet, thereby providing more convenient, faster, and more personalized tourism services. Based on the shortcomings of the traditional tourism recommendation system, a deep learning-based classification processing method of tourism product information is proposed. This method uses word embedding in the data preprocessing stage. The Convolutional Neural Network (CNN) is used to process review information of users and tourism service items. The Deep Neural Network (DNN) is used to process the necessary information of users and tourism service items. Also, factorization machine technology is used to learn the interaction between the extracted features to improve the prediction model. The results show that the proposed model can maintain an excellent precision of 64.2% when generating personalized recommendation lists for users. The sensitivity and accuracy of the recommendation list are better than other algorithms. By adding DNN, the word embedding method, and the factorization machine model, the precision is improved by 30%, 33.3%, and 40%, respectively. The model accuracy is the highest with 40 hidden factors, 100 convolutions, and a 100+50 combination hidden layer. Compared with traditional methods, the proposed algorithm can provide users with personalized travel products more accurately in personalized travel recommendations. The results have enriched and developed the theory of tourism service supply chain, providing a reference for constructing a personalized tourism service system.
| S-EPMC7714558 | biostudies-literature
Project description:BackgroundPredicting hepatocellular carcinoma (HCC) prognosis is important for treatment selection, and it is increasingly interesting to predict prognosis through gene expression data. Currently, the prognosis remains of low accuracy due to the high dimension but small sample size of liver cancer omics data. In previous studies, a transfer learning strategy has been developed by pre-training models on similar cancer types and then fine-tuning the pre-trained models on the target dataset. However, transfer learning has limited performance since other cancer types are similar at different levels, and it is not trivial to balance the relations with different cancer types.MethodsHere, we propose an adaptive transfer-learning-based deep Cox neural network (ATRCN), where cancers are represented by 12 phenotype and 10 genotype features, and suitable cancers were adaptively selected for model pre-training. In this way, the pre-trained model can learn valuable prior knowledge from other cancer types while reducing the biases.ResultsATRCN chose pancreatic and stomach adenocarcinomas as the pre-training cancers, and the experiments indicated that our method improved the C-index of 3.8% by comparing with traditional transfer learning methods. The independent tests on three additional HCC datasets proved the robustness of our model. Based on the divided risk subgroups, we identified 10 HCC prognostic markers, including one new prognostic marker, TTC36. Further wet experiments indicated that TTC36 is associated with the progression of liver cancer cells.ConclusionThese results proved that our proposed deep-learning-based method for HCC prognosis prediction is robust, accurate, and biologically meaningful.
| S-EPMC8504135 | biostudies-literature
Project description:Even though ghost imaging (GI), an unconventional imaging method, has received increased attention by researchers during the last decades, imaging speed is still not satisfactory. Once the data-acquisition method and the system parameters are determined, only the processing method has the potential to accelerate image-processing significantly. However, both the basic correlation method and the compressed sensing algorithm, which are often used for ghost imaging, have their own problems. To overcome these challenges, a novel deep learning ghost imaging method is proposed in this paper. We modified the convolutional neural network that is commonly used in deep learning to fit the characteristics of ghost imaging. This modified network can be referred to as ghost imaging convolutional neural network. Our simulations and experiments confirm that, using this new method, a target image can be obtained faster and more accurate at low sampling rate compared with conventional GI method.
| S-EPMC5915577 | biostudies-other
Project description:BackgroundClinical Decision Support Systems (CDSSs) have recently attracted attention as a method for minimizing medical errors. Existing CDSSs are limited in that they do not reflect actual data. To overcome this limitation, we propose a CDSS based on deep learning.MethodsWe propose the Colorectal Cancer Chemotherapy Recommender (C3R), which is a deep learning-based chemotherapy recommendation model. Our model improves on existing CDSSs in which data-based decision making is not well supported. C3R is configured to study the clinical data collected at the Gachon Gil Medical Center and to recommend appropriate chemotherapy based on the data. To validate the model, we compared the treatment concordance rate with the National Comprehensive Cancer Network (NCCN) Guidelines, a representative set of cancer treatment guidelines, and with the results of the Gachon Gil Medical Center's Colorectal Cancer Treatment Protocol (GCCTP).ResultsFor the C3R model, the treatment concordance rates with the NCCN guidelines were 70.5% for Top-1 Accuracy and 84% for Top-2 Accuracy. The treatment concordance rates with the GCCTP were 57.9% for Top-1 Accuracy and 77.8% for Top-2 Accuracy.ConclusionsThis model is significant, i.e., it is the first colon cancer treatment clinical decision support system in Korea that reflects actual data. In the future, if sufficient data can be secured through cooperation among multiple organizations, more reliable results can be obtained.
| S-EPMC7510149 | biostudies-literature