[OTDev] statisticsSupported / Algorithm

Christoph Helma helma at in-silico.de
Wed Dec 16 12:53:44 CET 2009


Excerpts from Nina Jeliazkova's message of Wed Dec 16 09:25:05 +0100 2009:
> Hello All,
> >>> - Does the Validation service rely on such functionality, or calculates the
> >>> relevant statistics itself ?
> >>>
> >>>       
> >> No, here is my (validation) point of view:
> >>
> >> Prediction models do not calculate prediction statistics on their own,
> >> they just make predictions.
> >> You can use the validation service to get the RMSE of a regression
> >> model on some dataset. The corresponding REST operation is the third
> >> command in the API
> >> (http://www.opentox.org/dev/apis/api-1.1/Validation). The RMSE as well
> >> as other regression statistics are available in the validation object
> >> which is returned.
> >>     
> >
> > Fabian and I have thought about that and we think that the fact that our
> > algorithms expose supported statistics might be due to the fact we
> > normally work. Using the same implementation for model building and
> > validation. But in OpenTox that is not the case. We have separate
> > services for model building and validation. Consequently, the algorithms
> > building the model does not have to support any statistics. They are as
> > Martin points out correctly calculated in the validation service. The
> > only thing that has to be exposed (maybe) is, what kind of statistics
> > can be calculated on the predictions. Classification or regression
> > stats.
> > So in our opinion we could get rid of the "statisticsSupported" stuff.
> > We may expose if the algorithm is classification or regression but that
> > should be covered by the algorithm ontology. 
> >
> >   
> Do we all agree to remove "statisticsSupported" field from Algorithm RDF
> representation?

Agreed.

Christoph



More information about the Development mailing list