Deep belief networks for sentiment analysis
| dc.contributor.advisor | Zhang, Huajie | |
| dc.contributor.advisor | Du, Donglei | |
| dc.contributor.author | Jin, Yong | |
| dc.date.accessioned | 2023-03-01T16:52:06Z | |
| dc.date.available | 2023-03-01T16:52:06Z | |
| dc.date.issued | 2017 | |
| dc.date.updated | 2019-03-05T00:00:00Z | |
| dc.description.abstract | Sentiment analysis is a highly popular issue both in academic and engineering fields. Nowadays there is an increasingly large amount of online opinion resources, so people are inclined to develop some systems that can automatically determine the polarities of opinions, especially in the decision-making process of a company. On the other hand, deep learning is a recently developed popular topic and has received much attention in machine learning area. Deep belief network (DBN) is one important deep learning model, which has proved powerful in many domains including natural language processing. However, there still exist some big challenges for DBNs in sentiment analysis because of the complexity to express opinions. Therefore, this study tries to improve DBNs in sentiment analysis area from the following three aspects: (1) The neuron models are investigated in DBNs for sentiment prediction. We perform various experiments and apply both total accuracy and F-measure to evaluate the performance, which proves that Gaussian neuron model with specific parameter setting has better efiect. (2) In addition to the traditional bag-of-words representation for each sentence, the word positional information is considered in the input. We propose a new word positional contribution form and another novel word-to-segment matrix representation for text to incorporate the positional information into DBNs for sentiment analysis. Finally, we evaluate the performance via the total accuracy. The results show that the word positional information of sentences helps to improve the performance of DBNs for sentiment classification. (3) We propose a new method to improve the DBN learning algorithm based on the unsupervised training phase of restricted Boltzmann machines (RBMs). That is, the RBM generates the hidden layer in an unsupervised fashion, and then we use this hidden layer as the output of a single-layer neural network, which is trained via the delta rule (DR). The new weights trained from DR are then transmitted into the whole network for initialization of back propagation (BP). This way keeps more correction signal for each layer in the BP algorithm compared to the ordinary DBN training. Our experimental results demonstrate that this updated learning method performs better than the ordinary learning for sentiment classification. | |
| dc.description.copyright | © Yong Jin, 2017 | |
| dc.description.note | Ph.D. University of New Brunswick, Faculty of Computer Science, 2017. | |
| dc.format | text/xml | |
| dc.format.extent | xiv, 101 pages | |
| dc.format.medium | electronic | |
| dc.identifier.other | Thesis 10012 | |
| dc.identifier.uri | https://unbscholar.lib.unb.ca/handle/1882/14591 | |
| dc.language.iso | en_CA | |
| dc.publisher | University of New Brunswick | |
| dc.rights | http://purl.org/coar/access_right/c_abf2 | |
| dc.subject.classification | Deep belief network. | |
| dc.subject.classification | Opinion mining. | |
| dc.subject.discipline | Computer Science | |
| dc.subject.lcsh | Discourse analysis -- Data processing. | |
| dc.subject.lcsh | Computational linguistics. | |
| dc.subject.lcsh | Learning classifier systems. | |
| dc.subject.lcsh | Natural language processing (Computer science) | |
| dc.subject.lcsh | Recommender systems (Information filtering) | |
| dc.subject.lcsh | Machine learning. | |
| dc.subject.lcsh | Data mining. | |
| dc.subject.lcsh | User-generated content -- Data processing. | |
| dc.subject.lcsh | Public opinion -- Data processing. | |
| dc.subject.lcsh | Consumer profiling -- Data processing. | |
| dc.subject.lcsh | Consumers' preferences -- Data processing. | |
| dc.subject.lcsh | Consumers -- Attitudes -- Data processing. | |
| dc.subject.lcsh | Language and emotions -- Data processing. | |
| dc.title | Deep belief networks for sentiment analysis | |
| dc.type | doctoral thesis | |
| dc.type | master thesis | |
| thesis.degree.discipline | Computer Science | |
| thesis.degree.fullname | Doctor of Philosophy | |
| thesis.degree.fullname | Doctor of Philosophy in Computer Science | |
| thesis.degree.grantor | University of New Brunswick | |
| thesis.degree.level | doctoral | |
| thesis.degree.level | masters | |
| thesis.degree.name | Ph.D. |
Files
Original bundle
1 - 1 of 1