[OTDev] statisticsSupported / Algorithm

Nina Jeliazkova nina at acad.bg
Wed Dec 16 09:25:05 CET 2009


Hello All,
>>> - Does the Validation service rely on such functionality, or calculates the
>>> relevant statistics itself ?
>>>
>>>       
>> No, here is my (validation) point of view:
>>
>> Prediction models do not calculate prediction statistics on their own,
>> they just make predictions.
>> You can use the validation service to get the RMSE of a regression
>> model on some dataset. The corresponding REST operation is the third
>> command in the API
>> (http://www.opentox.org/dev/apis/api-1.1/Validation). The RMSE as well
>> as other regression statistics are available in the validation object
>> which is returned.
>>     
>
> Fabian and I have thought about that and we think that the fact that our
> algorithms expose supported statistics might be due to the fact we
> normally work. Using the same implementation for model building and
> validation. But in OpenTox that is not the case. We have separate
> services for model building and validation. Consequently, the algorithms
> building the model does not have to support any statistics. They are as
> Martin points out correctly calculated in the validation service. The
> only thing that has to be exposed (maybe) is, what kind of statistics
> can be calculated on the predictions. Classification or regression
> stats.
> So in our opinion we could get rid of the "statisticsSupported" stuff.
> We may expose if the algorithm is classification or regression but that
> should be covered by the algorithm ontology. 
>
>   
Do we all agree to remove "statisticsSupported" field from Algorithm RDF
representation?

Best regards,
Nina
> Opinions?
>
> best regards
> Tobias
>   
>
>   




More information about the Development mailing list