What is Data-Mining?

• From Web-documents in HTML format
  • What is Data Mining?
  • Yet Another "What is Data Mining?"

• From Articles in PDF format
  • An article which gives 45 pages of detailed expalnation of what is data-mining.
  • An article entitled "Why and What is Data Mining?" (20 pages)

• Not totally different but a more specifiñ target --- Text-Mining
  • "Text Mining with Information Extraction." (132 pages)

Let's give it a try!

• To learn what is C4.5 Rule, explore the following Web-documents in HTML format.
  • Tutorial on C4.5-Rules
  
  Or the other option is "k-mean algorithm." To study what is k-mean algorithm, the following is one of good basic articles.
  • Tutorial on C4.5-Rules

• Then one of the good target data set might be "IRIS flower data set" which is made up of 150 4-dimensional continuous data or 4 diffrent families of IRIS flower.
  • IRIS Flower data set
  • Wisconsine Breast Cancer data set

• Now, as examples, let's see how data-mining technique is applied to IRIS data set or Wisconsin Brest Cancer data set

A Taxonomy by Targets:

• Apprication to Financial Phenomena.

• General financial problems
  • "From Data Mining to Knowledge Discovery in Databases" ... By U. Fayyad et. al (18 pages)
  
  
• Stock Market

• Apprication to Medical Database.

• Exploration of Wisconsin Breast Cancer Data-set.
  • Basic Idea for the Application

    "Work In Progress: Establishing multiple contexts for student's progressive refinement of data mining" ... By David Kwartowitz et al.
    This article is from authrs's teaching experince, and as such it would be helpful for student to start this topic.

  • A Neural Network Approach.

    "Hybrid Neural-global Minimization Method of Logical Rule Extraction." ... By W. Duch et al. (10 pages)

    "Neural Network Methods for Rule Induction." ... By R. B. de Andrade et al. (5 pages)

    "Setting a Good Example: Improving Generalization Performance in Support Vector Machines through Outlier Exclusion" ... By P. D. Kuo et al.
    This is more specifically using Support Vector Machine.

  • A Genetic Algorithm Approach.

    "Pittsburgh Genetic-Based Machine Learning in the Data Mining era: Representations,Generalization, and Run-time" ... Thesis submitted by Jaume Bacardit and Penarroya. (352 pages)

    "Data Mining in Learning Classier Systems: Comparing XCS with GAssist." ... By J. Bacardit et al. (7 pages)

  • A Fuzzy Rule Approach.

    "Pruning Fuzzy ARTMAP Using the Minimum Description Length Principle in Learning from Clinical Databases" ... By Ten-Ho Lin et al. (8 pages)

    "Neural Optimization of Linguistic Variables and Membership fFunctions." ... By W. Duch et al. (5 pages)

    "An Artificial Immune System for Fuzzy-Rule Induction in Data Mining" ... By R. T. Alves et al.

  • An Artificial Immune System Approach.

    "An Artificial Immune System for Fuzzy-Rule Induction in Data Mining" ... By R. T. Alves

  • A Genetic Programming Apploach.

    "A Constrained-Syntax Genetic Programming System for Discovering Classification Rules: Application to Medical Data Sets" ... By C. C. Bojarczuk (40 pages)

    "A Constrained-syntax Genetic Programming System for Discovering Classification Rules: Application to Medical Data Sets." ... By C. C. Bojarczuk (22 pages)

  • An Ant Colony Optimization Apploach.

    "Classification Rule Discovery with Ant Colony Optimization" ... By Bo Liu 1 (5 pages)

  • An Agent-oriented Programming Apploach.

    "Agent-Oriented Programming Idioms" ... By J, C. Schlimmer

  • Other Approaches

    "Computaional Intelligence Methods for Rule-Based Data Understanding."
    Author describes "this paper is focused on the extraction and use of logical rules for data understanding. All aspects of rule gener-ation, optimization, and application are described, including the problem of finding good symbolic descriptors for continuous data, tradeoffs between accuracy and simplicity at the rule-extraction stage, and tradeoffs between rejection and error level at the rule optimization stage."

    "Pattern Separation and Prediction via Linear and Semidefinite Programming."

    "Exact Solution of L-infinite-norm and L-2-norm Plane Separation" ... C. Audet et al. (19 pages)

    "Ruls Set Quality Measurs for Inductive Learning algorintms." By R. KLINKENBERG (for the degree of Master of Science)

    "EMPRR: A High-dimensional EM-Based Piecewise Regression Algorithm" ... By M. Arumugam (also for the degree of Master of Science) (76 pages)

    "Unsupervised Feature Selection using Feature Similarity" ... By P. Mitra et al. (12 pages)

    "Pattern Discovery: A Data Driven Approach to Decision Support" ... By A. K. C. Wong et al. (11 pages)

• A Data-mining from Thyloyd Data-set.
  • "An Investigation of Supervised Learning in Genetic Programming " ... By C. Gathercole. (163 pages)

Approach to Seismic Data base --- To predict an Earthquake.

• "The Problems of Seismological Data Mining via Internet" ... By V. G. Gitis et al. (Russian Academy of Sciences) (11 pages)
• "Data Mining in Low Signal to Noise Overpressured Zones: A Case Study from Offshore Louisiana, Gulf of Mexico." ... By ??? (10 pages)
• "SeismoSpin: A Physical Instrument for Digital Dataþ" ... By M. Mckelvin et. al (2 pages)

Approach to Network Intrusion Detection.

(Not prepared yet.)

A Taxonomy by Methods:

• Ant Colony Optimization (ACS).

• If you would like to start ACO from scratch, the following tutorial paper will be really helpful.
  • "Ant Algorithms for Discrete Optimization" ... By M. Dorigo, G. Di Caro and L. G. Gambardella.

• Although the purpose of this page is "What we start the Data-Mining research with?" let's try really direct application of ACS to the Traveling Sales-person Problem (TSP)."
  • It would be good to start with the following paper to learn how we apply ACO to TSP.
    • "Discussion on the Implementation of the Ant Colony System for the Traveling Salesman Problem." ... By G. Sarigiannidis
  • Here we have an example of modest size --- 52 cities in Berlin
    • "52 cities in Berlin"
  • If you are more challanging here we have much larger example --- 13,509 cities in USA.
    • "13509 cities in US"
      
    (Above two data are from http://elib.zib.de/pub/Packages/mp-testdata/tsp/tsplib/tsplib.html)
  • Or, why don't you try cities in Belarus. Here you have map. You might pick up fair amount of cities and give an x-y-axis on the map. Then specify the (x,y) coordinate by mesuring them by yourself.
    • "A map of Belarus."

• Then Topics of Data-Mining:
  • Very Simple Way of Ant Colony Optimization to a Data-mining Problem
    • "On Data Clustering with Artificial Ants" ... By N. Monmarche
    • "AntClass: Discovery of Clusters in Numeric Data by an Hybridization of an Ant Colony with the K-means Algoritm." ... By N. Monmarche et al.
      (Detailed version of the above article.)
    • "A Clustering Model using Artificail Ants." ... By H. Azzag et al.
      A clustering algorithm for unsupervised learning as a data-mining system
  • A Little More Sophisticated Imprimentation.
    • "An Ant Colony Based System for Data Mining: Applications to Medical Data" A detaile version of the above article.
  • A Little More Practical Imprimentation.
    • "Mining with an Ant Colony Optimization Algorithm." By R. S. Parpinelli et al. (29 pages)
  • Ant Colony Optimization + Fuzzy Logic.
    • "Learning Fuzzy Rules Using Ant Colony Optimization Algorithms" Author test the system with a 3-D function and then apply to a real-world electric engineering problem.
  • Applications to a Real World Problems
    • "Collective Intelligence in Multi-Agent Robotics: Stigmergy, Self-Organization and Evolution." Application to Robotics: multiple autonomous mobile robots. (9 pages)
    • "An Ant Clustering Algorithm Applied to Partitionning in VLSI Technology." By ... P. Kuntz et al. (12 pages)

• Messy Genetic Algorithm.

Analysis on Fitness Landscape:

• Is a Needle in a Haystack Problem not Difficult?

• Positive assersions
  • "Finding Needles in Haystacks is not Hard with Neutrality" ... T. Yu, and J. F. Miller (2002) EuroGP pp. 13-25. (12 pages)
  • "Climbing Unimodal Landscapes with Neutrality: A Case Study of the OneMax Problem" ... T. Yu, and J. Miller (1 pages)

• A negative Reaction
  • "Finding Needles in Haystacks is Harder weit Neutrality." ... By M. Colins (6 pages)

• The Other Analysis of Fitness Landscape

• Specific target with specific approach, but...
  • "Fitness Landscape Analysis and Memetic Algorithms for the Quadratic Assignment Problem" ... By P. Merz et al. (17 pages) ... Good paper in the sense that this give a good overview of how to analyse fitness landscape and the target in this paper QAP is interesting enough.
  • "Fitness Landscapes and Performance of Meta-heuristics." ... By C. fonlupt et al. (12 pages)