Leaderboard

From Live review of baseline FHR methods
Jump to navigation Jump to search

Here is the current Leaderboard realised on the test dataset with the median score on each indices. The main criterium is the Morphological Analysis Discordance Index (MADI) by comparison with an expert consensus. More information on :


Houzé de l’Aulnoit, A., Boudet, S., Demailly, R., Delgranche, A., Peyrodie, L., Beuscart, R., Houzé de l’Aulnoit,D. - Automated fetal heart rate analysis for baseline determination and acceleration/deceleration detection: A comparison of 11 methods versus expert consensus Biomedical Signal Processing and Control 49:113--123,2019 Download on researchgate


Note that since this evaluation is not based on the neonatal outcome but on a ground truth by a consensus of expert, this is not an absolute ranking.

Leaderboard updated the 2019-09-26

Method submitted by Ranking MADI (test data) MADI (train data)
Lu 2012 [5] S. Boudet 1 7.3% 10.36%
Houzé 1990 [3] S. Boudet 2 10.9% 13.34%
Taylor 2000 [11] S. Boudet 3 11.5% 17.17%
Wrobel 2013 [12] S. Boudet 4 11.7% 11.93%
Mongelli 1997 [9] S. Boudet 5 11.8% 13.06%
Ayres 2000 [1] S. Boudet 6 12.2% 15.26%
Mantel 1990 [7][8] S. Boudet 7 12.6% 21.71%
Pardey 2002 [10] S. Boudet 8 13.2% 16.58%
Jimenez 2002 [4] S. Boudet 9 14.0% 20.47%
Maeda 2012 [6] S. Boudet 10 15.0% 15.58%
Cazares 2002 [2] S. Boudet 11 20.4% 21.32%
Boudet 2019 [13] S. Boudet * 4.0% 6.42%

* Since we are the authors of both the evaluation methodology and the method with the current best score, we removed our method from the official order. We designed the evaluation method independantly to our WMFB method and we share all training and testing data so that anyone have the same tools to break this record.

Resaercher wanting to evaluate their method should submit their method analysis on the evaluation dataset to samuel.boudet[at]univ-catholille.fr . More information on Boudet, S., Houzé de l’Aulnoit, A., Demailly, R., Delgranche, A., Peyrodie, L., Beuscart, R., Houzé de l’Aulnoit,D. - Fetal heart rate signal dataset for training morphological analysis methods and evaluating them against an expert consensus. Preprints pp. Submitted to data in brief,2019 Download on researchgate


Since the evaluation is not completely automated submission are limited to one per month for a team.

Researchers submiting results can choose to appear or not on the leaderboard.


References

[1] D. Ayres-de Campos, J. Bernardes, A. Garrido, J. Marques-de-Sá, L. Pereira-Leite, SisPorto 2.0: a program for automated analysis of cardiotocograms, J. Matern. Fetal Med. 9 (2000) 311–318.

[2] S.M. Cazares, Automated identification of abnormal patterns in the intrapartum cardiotocogram, University of Oxford, 2002.

[3] D. Houzé de l’Aulnoit, R. Beuscart, G. Brabant, L. Carette, M. Delcroix, Real-time Analysis Of The Fetal Heart Rate, in: IEEE, 1990: pp. 1994–1995.

[4] L. Jimenez, R. Gonzalez, M. Gaitan, S. Carrasco, C. Vargas, Computerized algorithm for baseline estimation of fetal heart rate, in: IEEE, 2002: pp. 477–480.

[5] Y. Lu, S. Wei, Nonlinear baseline estimation of FHR signal using empirical mode decomposition, in: IEEE, 2012: pp. 1645–1649.

[6] K. Maeda, M. Utsu, Y. Noguchi, F. Matsumoto, T. Nagasawa, Central Computerized Automatic Fetal Heart Rate Diagnosis with a Rapid and Direct Alarm System, Open Med. Devices J. 4 (2012) 28–33.

[7] R. Mantel, H.P. van Geijn, F.J. Caron, J.M. Swartjes, E.E. van Woerden, H.W. Jongsma, Computer analysis of antepartum fetal heart rate: 1. Baseline determination, Int. J. Biomed. Comput. 25 (1990) 261–272.

[8] R. Mantel, H.P. van Geijn, F.J. Caron, J.M. Swartjes, E.E. van Woerden, H.W. Jongsma, Computer analysis of antepartum fetal heart rate: 2. Detection of accelerations and decelerations, Int. J. Biomed. Comput. 25 (1990) 273–286.

[9] M. Mongelli, R. Dawkins, T. Chung, D. Sahota, J.A. Spencer, A.M. Chang, Computerised estimation of the baseline fetal heart rate in labour: the low frequency line, Br. J. Obstet. Gynaecol. 104 (1997) 1128–1133.

[10] J. Pardey, M. Moulden, C.W.G. Redman, A computer system for the numerical analysis of nonstress tests, Am. J. Obstet. Gynecol. 186 (2002) 1095–1103.

[11] G.M. Taylor, G.J. Mires, E.W. Abel, S. Tsantis, T. Farrell, P.F. Chien, Y. Liu, The development and validation of an algorithm for real-time computerised fetal heart rate monitoring in labour, BJOG Int. J. Obstet. Gynaecol. 107 (2000) 1130–1137.

[12] J. Wróbel, K. Horoba, T. Pander, J. Jeżewski, R. Czabański, Improving fetal heart rate signal interpretation by application of myriad filtering, Biocybern. Biomed. Eng. 33 (2013) 211–221.

[13] S. Boudet, A. Houzé de l’Aulnoit, R. Demailly, L. Peyrodie, R. Beuscart, D. Houzé de l’Aulnoit - Fetal heart rate baseline computation with a weighted median filter, Computers in Biology and Medicine. In press,2019