文档下载 文档下载导航
设为首页 | 加入收藏
搜索 请输入内容:  
 导航当前位置: 文档下载 > 所有分类 > IT/计算机 > 计算机软件及应用 > 数据挖掘重点知识点总结
侵权投诉

数据挖掘重点知识点总结

数据挖掘重点知识点进行了详细的总结

Given a collection of records (training set )Each record contains a set of attributes, one of the attributes is the class.Find a model for possible.A test set is used to determine the accuracy of the model. Usually, the given data set is divided into training and test sets, with training set used to build the model and test set used to validate it.Predicting tumor cells as benign or malignantClassifying credit card transactions as legitimate or fraudulent Classifying secondary structures of protein as alpha-helix, beta-sheet, or random coil Categorizing news stories as finance, weather, entertainment, sports, etc Decision Tree based Methods

Rule-based Methods Memory based reasoning Neural Networks Naïve Bayes and Bayesian Belief Networks Support Vector Machines Hunt’s Algorithm Let Dt be the set of training records that reach a node t General Procedure:If Dt contains records that belong the same class yt, then t is a leaf node labeled as ytIf Dt is an empty set, then t is a leaf node labeled by the default class, ydIf Dt contains records that belong to more than one class, use an attribute test to split the data into smaller subsets. Recursively apply the procedure to each subset.Greedy strategy.Split the records based on an attribute test that optimizes certain

criterion.IssuesDetermine how to split the records How to specify the attribute test condition? How to determine the best split? Determine when to stop splitting Depends on attribute types Nominal Ordinal Continuous Depends on number of ways to split 2-way split Multi-way split Different ways of handling Discretization to form an ordinal categorical attribute tatic – discretize once at the beginning Dynamic – ranges can be found by equal interval bucketing, equal frequency bucketing (percentiles), or clustering.Binary Decision: (A < v) or (A v)

consider all possible splits and finds the best cut can be more compute intensive Greedy approach Nodes with homogeneous class distribution are preferred

Need a measure of node impurity: Gini Index for a given node t :

(NOTE: p( j | t)

数据挖掘重点知识点总结

数据挖掘重点知识点总结

Maximum (1 - 1/n) when records are equally distributed among all classes, implying least interesting informationMinimum (0.0) when

call records belong to one class, implying most interesting information

P(C1) = 1/6 P(C2) = 5/6 2 2

Gini = 1 – (1/6)– (5/6) = 0.278

Use Binary Decisions based on one value Several Choices for the splitting value Number of possible splitting values Number of distinct values

Each splitting value has a count matrix associated with it Class counts in each of the partitions, A < v and A v Simple method to choose best v

For each v, scan the database to gather count matrix and compute its Gini index Computationally Inefficient! Repetition of work. For efficient computation: for each attribute, Sort the attribute on values Linearly scan these values, each time updating the count matrix and computing gini index Choose the split position that has the least gini index

(NOTE:

数据挖掘重点知识点总结

数据挖掘重点知识点总结

第1页

你可能喜欢

  • 用友ERP
  • 十大数据挖掘算法
  • 数据挖掘考试题
  • 数据结构总结
  • 数据分析总结
  • 项目总结
  • 数据仓库技术

热门文档

相关文档

  • 数据挖掘与数据仓库 知识点总结

    数据挖掘与数据仓库 知识点总结_计算机软件及应用_IT/计算机_专业资料。1、...晰显示哪些字段比较重要⑥容易转化成分类规则: 只要沿着树根向下一直走到叶子, ...

  • 数据挖掘重点

    数据挖掘重点整理 KDD 过程 了解应用领域: 了解应用领域:相关的预备知识和应用...数据挖掘功能:汇总,分类,关联, 选择数据挖掘功能:汇总,分类,关联,聚集 选择挖掘...

  • 数据挖掘知识点整理

    数据挖掘知识点整理_计算机软件及应用_IT/计算机_...汇总级或不同的数据子集显示数据,方体的格称为数据...概念:数据预处理是知识发现过程的重要步骤。检测数据...

  • 数据挖掘重点

    信息和模式 知识发现过程 KDD 过程的步骤 了解应用领域:相关的预备知识和应用...常量的表示 选择数据挖掘功能:汇总,分类,关联,聚集,选择挖掘算法 数据挖掘:搜索...

  • 数据挖掘考试重点

    数据挖掘考试重点_管理学_高等教育_教育专区。重庆大学 数据挖掘 期末考试重点整理术语解释 1、 数据挖掘是在大型数据存储库中,自动地发现有用信息的过程 2、 ...

  • 数据挖掘知识点

    数据挖掘知识点 隐藏>> 简答题 1. (第一章) 数据库与数据仓库的不同: ...的数据收集;数据仓 库不仅有详细数据,还有占数据存储比例很大的汇总数据;数据...

  • 数据挖掘重点

    数据挖掘期末考试重点 6页 1下载券 数据挖掘重点 6页 1下载券...的数据库为基础,根据所需解决的问题进行数据的汇总, 内部及外部既有的数据库为...

  • 数据挖掘总结

    数据挖掘总结_学习总结_总结/汇报_应用文书。数据挖掘总结(职业篇) 数据分析微...因此学习数据挖掘不意味着丢弃原有专业知识和经验。相反,有其它行业 背景是从事...

  • 数据挖掘重点--蔡博士

    关键词:DM重点数据挖掘重点粒度模型数据仓库OLAP 1/2 相关文档推荐...(统计报表、工作总结) (3) 数据利用:确保能够在适当的时间、以适当的形式得到...

  • 数据挖掘重点(最新版)

    (统计报表、工作总结) (3) 数据利用:确保能够在适当的时间、以适当的形式得到必要的数据和信息;从数据中发 现 决策所需要的知识。 (发展战略、销售计划) (4) ...

站点地图 | 文档上传 | 侵权投诉 | 手机版
本站所有资源均来自互联网,本站只负责收集和整理,均不承担任何法律责任,如有侵权等其它行为请联系我们.
文档下载 Copyright 2013 doc.guandang.net All Rights Reserved.  -  email