Distributional similarity model for multi-modality clustering in social media
Document Type
Conference Proceeding
Publication Date
2007
DOI
10.1109/WI-IATW.2007.105
Abstract
User generated content (UGC) has become the fastest growing sector of the WWW. Data mining from UGC presents challenges not typically found in text mining from documents. UGC can be semi-structured and its content can be very short and informal, containing relatively little content similar to a chat or an email conversation. In addition UGC can be viewed as a multi-modality data. These characteristics pose big challenges and research questions for scholars to cope with. To cluster UGC data, we can construct multiple contingency tables of modalities and employ the multi-way distributional clustering (MDC) algorithm. However, by considering a contingency table which summarizes the co-occurrence statistics of two modalities, it is not robust to represent the information entropy between two modalities in UGC data. In this paper, we propose a novel similarity measurement, called distributional similarity model (DSM), to solidify the graph model in the MDC algorithm to deal with the unique characteristics of the UGC data.
Source Publication
2007 IEEE/WIC/ACM International Conference on Web Intelligence Workshop on Social Media Analysis, Silicon Valley
ISBN
769530281
First Page
268
Last Page
271
Recommended Citation
Sze, D.,Fu, T.,Chung, F.,& Luk, R. (2007). Distributional similarity model for multi-modality clustering in social media. 2007 IEEE/WIC/ACM International Conference on Web Intelligence Workshop on Social Media Analysis, Silicon Valley, 268-271. http://dx.doi.org/10.1109/WI-IATW.2007.105