1999.VLDB.Finding intensional knowledge of distance-based outliers

1999.VLDB.Finding intensional knowledge of distance-based outliers

paper

pdf

main idea

intensional knowledge:

a description or an explanation of why an identified outlier is exceptional.

two main issue:

what kinds of intensional knowledge to provide;

how to optimize the computation of such knowledge.

contribution

1、define two notions of outliers and the corresponding intensional knowledge: strongest outlier and weak outlier.

2、develop a naive and semi-naive algorithm for computing strongest outlier and weak outlier and the corresponding intensional knowledge.

3、effective sharing of IO and experiment.

method

other's citation

citation 1

authors identify outliers in subspaces of the features space using a distance-based anomaly detection method. This serves as explanation since the identified anomalies are outliers in the specific subspaces found, meaning that the features constituting the subspace are those that discriminate the most the instance. The authors introduce the notions of strongest, weak and trivial outliers. An outlier is non-trivial in a subspace A if it is not

an outlier in any subspace included in A. A strongest outlier is an outlier in a strongest outlying feature space (if no outlier exists in any subspace included in A, then A is a strongest feature space). A weak outlier is a non-trivial not strongest outlier. Algorithms are provided to identify (and thus explain) strong and weak outliers. This anomaly explanation method is model-specific because it is designed for distance-based methods. It is also local because it helps explaining one outlier at a time.[1]

citation 2

For example, Knorr and Ng [50] define the outlier categories C = {"trivial outlier," "weak outlier," "strongest outlier"} to help gain better insights about the nature of outliers. They define an anomalous data point o as the "strongest outlier" in a subspace A if it meets two criteria: (i) o is not an outlier in any subspace B ⊂ A, and (ii) no outlier exists in any subspace B ⊂ A.If o does not satisfy the criteria in (i), then it is a "weak outlier." If it does not fit the two criteria, then it is a "trivial outlier." The terms "trivial outlier," "weak outlier," and "strongest outlier" are used to separate noise from meaningful abnormal data [2].

Figure 3 shows an illustration of strongest, weak, and trivial outliers in the 3D space {A, B, C}. P1 and P5 are non-trivial outliers in the subspace AB because they are not outliers in subspace A or subspace B. They are also the strongest outliers in AB because there is no other anomalous point in the subspace A or B. P20 is a weak outlier in the subspace AC because there is another outlier point P11 in the subspace C. P11 is a trivial outlier in the subspace AC because it is also an outlier in the subspace C.[3]

definitions



experiment

reference

[1]2022.DKE.Anomaly explanation A review :3.1.1. Non-weighted feature importance

[2]2022.VLDB.A survey on outlier explanations:2.1.2 Categorical ranking of outliers

[3]2022.VLDB.A survey on outlier explanations:5.2 Techniques to find categorical rankings of

outliers

相关推荐
颹蕭蕭15 天前
pyflink 时序异常检测——PEWMA
python·flink·异常检测
mumukehao1 个月前
Rethinking Graph Neural Networksfor Anomaly Detection
异常检测·异配图
shaoyue12341 个月前
2020.ICDM.LP-Explain: Local Pictorial Explanation for Outliers
异常检测
shaoyue12341 个月前
2022.DKE.Anomaly explanation: A review
异常检测
妙龄少女郭德纲5 个月前
【异常检测】数据挖掘领域常用异常检测算法总结以及原理解析(一)
人工智能·算法·机器学习·数据挖掘·异常检测
妙龄少女郭德纲5 个月前
【异常检测】数据挖掘领域常用异常检测算法总结以及原理解析(二)
人工智能·算法·数据挖掘·异常检测
华为云开发者联盟9 个月前
异常检测、自动告警,业务问题分钟级识别
异常检测·华为云开发者联盟·自动警告
机器学习之心1 年前
异常检测 | MATLAB实现基于支持向量机和孤立森林的数据异常检测(结合t-SNE降维和DBSCAN聚类)
支持向量机·matlab·异常检测·孤立森林·t-sne降维·dbscan聚类
Thomas_Cai1 年前
3D异常检测论文笔记 | Shape-Guided Dual-Memory Learning for 3D Anomaly Detection
论文阅读·人工智能·深度学习·异常检测·3d异常检测