Unknown

Dataset Information

0

The BRaliBase dent-a tale of benchmark design and interpretation.


ABSTRACT: BRaliBase is a widely used benchmark for assessing the accuracy of RNA secondary structure alignment methods. In most case studies based on the BRaliBase benchmark, one can observe a puzzling drop in accuracy in the 40-60% sequence identity range, the so-called 'BRaliBase Dent'. In this article, we show this dent is owing to a bias in the composition of the BRaliBase benchmark, namely the inclusion of a disproportionate number of transfer RNAs, which exhibit a conserved secondary structure. Our analysis, aside of its interest regarding the specific case of the BRaliBase benchmark, also raises important questions regarding the design and use of benchmarks in computational biology.

SUBMITTER: Lowes B 

PROVIDER: S-EPMC5444242 | biostudies-literature | 2017 Mar

REPOSITORIES: biostudies-literature

altmetric image

Publications

The BRaliBase dent-a tale of benchmark design and interpretation.

Löwes Benedikt B   Chauve Cedric C   Ponty Yann Y   Giegerich Robert R  

Briefings in bioinformatics 20170301 2


BRaliBase is a widely used benchmark for assessing the accuracy of RNA secondary structure alignment methods. In most case studies based on the BRaliBase benchmark, one can observe a puzzling drop in accuracy in the 40-60% sequence identity range, the so-called 'BRaliBase Dent'. In this article, we show this dent is owing to a bias in the composition of the BRaliBase benchmark, namely the inclusion of a disproportionate number of transfer RNAs, which exhibit a conserved secondary structure. Our  ...[more]

Similar Datasets

| S-EPMC5903868 | biostudies-literature
| S-EPMC6738662 | biostudies-literature
| S-EPMC3973288 | biostudies-literature
| S-EPMC4117319 | biostudies-literature
| S-EPMC4810762 | biostudies-literature
| S-EPMC7054285 | biostudies-literature
| S-EPMC4922632 | biostudies-literature
| S-EPMC6816579 | biostudies-literature
2018-12-27 | GSE124366 | GEO
| S-EPMC1196371 | biostudies-literature