Detail publikace

Comparing Classifier's Performance Based on Confidence Interval of the RO

Originální název

Comparing Classifier's Performance Based on Confidence Interval of the RO

Anglický název

Comparing Classifier's Performance Based on Confidence Interval of the RO

Jazyk

en

Originální abstrakt

This paper proposes a new methodology for comparing two performance methods based on confidence interval for the ROC curve. The methods performed and compared are two algorithms for face recognition. The novelty of the paper is three-fold: i) designing a methodology for the comparison of decision making algorithms via confidence intervals of ROC curves; ii) investigating how sample sizes influence the properties of the particular methods; iii) recommendations for a general comparison of decision making algorithms via confidence intervals of ROC curves. To support our conclusions we investigate and demonstrate several approaches for constructing parametric confidence intervals on real data. Thus, we present a non-traditional and reliable way of reporting pattern recognition results using ROC curves with confidence intervals.

Anglický abstrakt

This paper proposes a new methodology for comparing two performance methods based on confidence interval for the ROC curve. The methods performed and compared are two algorithms for face recognition. The novelty of the paper is three-fold: i) designing a methodology for the comparison of decision making algorithms via confidence intervals of ROC curves; ii) investigating how sample sizes influence the properties of the particular methods; iii) recommendations for a general comparison of decision making algorithms via confidence intervals of ROC curves. To support our conclusions we investigate and demonstrate several approaches for constructing parametric confidence intervals on real data. Thus, we present a non-traditional and reliable way of reporting pattern recognition results using ROC curves with confidence intervals.

BibTex


@article{BUT148330,
  author="Tobiáš {Malach} and Jitka {Poměnková}",
  title="Comparing Classifier's Performance Based on Confidence Interval of the RO",
  annote="This paper proposes a new methodology for comparing two performance methods based on confidence interval for the ROC curve. The methods performed and compared are two algorithms for face recognition. The novelty of the paper is three-fold: i) designing a methodology for the comparison of decision making algorithms via confidence intervals of ROC curves; ii) investigating how sample sizes influence the properties of the particular methods; iii) recommendations for a general comparison of decision making algorithms via confidence intervals of ROC curves. To support our conclusions we investigate and demonstrate several approaches for constructing parametric confidence intervals on real data. Thus, we present a non-traditional and reliable way of reporting pattern recognition results using ROC curves with confidence intervals.",
  address="Společnost pro radioelektronické inženýrství",
  chapter="148330",
  doi="10.13164/re.2018.0000",
  howpublished="print",
  institution="Společnost pro radioelektronické inženýrství",
  number="3",
  volume="27",
  year="2018",
  month="september",
  pages="827--834",
  publisher="Společnost pro radioelektronické inženýrství",
  type="journal article"
}