Third International Conference on Semantics, Knowledge and Grid
Research and Implement of Classification Algorithm
on Web Text Mining1
Shiqun Yin Gang Wang Yuhui Qiu Weiqun Zhang
Faculty of Computer and Information Science Southwest University
Chongqing, China 400715 E-mail: qiong-yin@126.com
Abstract
Research and application of Web text mining is an important branch in the data mining. Web is the biggest information system currently. Now people mainly use the search engine to look up Web information. The problem of getting reliable rate and comprehensive rate is increasingly convex, and it is very difficult to mine data further. Now the search engine can hardly provide individual service according to different need of different customers. However, Web text mining aims at resolving this problem. This paper discusses an Algorithm of how to follow the appointed Website or Web page according to the user’s request, how to analysis, compare, sample, reserve and classify the data information combined with the Web page text contents for later use. The model of Web text mining, mining algorithm and implement technique are discussed in details.
Keywords: Web text mining; individual service; Text Classification; Characteristic Vector; Similitude degree
1. Introduction
Web is the biggest information system currently whose data has some characteristics of abundance, diverse form, many different structures and dynamic varieties, etc. [1]. Now people use the search engine--Google, Yahoo, Baidu etc. To look up Web information mainly, but these search engines are ranged widely and intelligence degree is pool. The search engine is mainly involved in comprehensive data, but lack of getting reliable rate. The problem of getting reliable rate and comprehensive rate is increasingly convex[2], and it is very difficult to mine 1
data further. The search engine can hardly according to different need of different customers and provide individual service[4]. Therefore it became harder for people to acquire needed data accurately and quickly.
What is called Web text mining is the non-ordinary process in which we discover valid, novel, latent, available and comprehending knowledge from a great deal non-structure, different structure of Web text resources (including forms of concept, mode, rule, regulation, restriction and visualizing etc. ). Adoptive technique comprise of classification, clustering, associate rule and sequence analysis etc. Among them, classification is a kind of data analysis form, which can be used to gather and describe important data set [5]. Classification method is used to estimate the Categorical Label of data object. There are many applications of classification technique in a lot of domains, such as automatic text classification technique in the literature search and search engine. The safety domain also uses classification technique on Instruction Detection etc[6].
In Web text mining, the text extraction and the characteristic express of its extraction contents are the foundation of mining work, the text classification is the most important and basic mining method. The text classification means classify each text of text set to a certain category according to definition of classification system in advance. So, it is not only convenient for customers to browse text, but also easier to make text seek through restriction search scope. Currently, Yahoo still carry on classification to Web text by manpower. This largely limits the number of its index page and the overlay scope. We can say that the research text classification has extensive business foreground and applied value[7,8].
The Web text mining in the paper is different from search engine and intelligence technique. The Web text
This paper gets subsidy of 973 item(2003CB317008)
criteriahavebeenimplementedsinceDecember1st.2011.’...classificationofdiabetes fordiagnosisandmelfitusinthen...algorithm[外文期刊] 2005 6.Agarwal MM;Dhatt GS;...
Specifying and implement... 暂无评价 13页 免费 Modeling the Visual Cort.....Responsibilities Shlaer - Mellor Object lifecycles Odell Classification -24- ...
themodelofthree.weightneuraInetworkand i忸implementtext biomimeticpatternaBPR ...researchpurposeofthree-weightneuralnetworkaBPRtextclassifier,whosetextclassification...
- Quickly analyze requirements and gaps - Efficiently implement the R/3 System...Classification LO170 Quality Management Inspection Catalogs broken deformed fault...
thetheseThirdIevelThedesignandimplement(P1)Cost(P2...(OF2)Thecoston hisresearchteamintroducedthecost...themostpopularqualityclassification:preventioncost,...
– at each CLK tick (system heart beat) 6 TI Training Material Thread Classification HWI Hardware Interrupts Used to implement 'urgent' part of real-...
The encryption algorithm RC4 for Windows95, What...the following, respectively, simple classification. ...SSL3.0 to implement an electronic certificate (...
State Machine Classification There are two types of state machines as ...The easiest method to understand and implement is the two-always block ...
This paper presents a preprocessing classification algorithm that is based on...dispersive and heterogenous raw data is how to implement data preprocessing....
such as narration, description, comparison, classification and process analysis...draws on the relevant physiological mechanisms to implement the plan in the ...
热门文档