[OTDev] model validation
Martin Guetlein martin.guetlein at googlemail.comMon Mar 29 12:21:08 CEST 2010
- Previous message: [OTDev] Common LDAP backend
- Next message: [OTDev] Sylvia Escher: Out of office
- Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]
Dear developers, I just managed to validate a knn-model from TUM (http://opentox.informatik.tu-muenchen.de:8080/OpenTox-dev/algorithm/kNNregression), with a small ambit dataset (http://ambit.uni-plovdiv.bg:8080/ambit2/dataset/342). I validated the model on the training-dataset (the results are as good as expected when validating a knn model on the training dataset!). Results can be found here: http://opentox.informatik.uni-freiburg.de/validation/15 http://opentox.informatik.uni-freiburg.de/validation/report/validation/3 (Remark: validation-rdf representation not working, only yaml available for the moment, will be fixed ASAP; regression report is still very basic). You can find the curl calls used to perform this validation, below. To Tobias, Nina: Do you have a nice representative example for a regression validation for the report (i.e. which model, dataset)? Please try validating your model (more curl examples see: http://opentox.informatik.uni-freiburg.de/validation/examples), and report errors to me (error reporting is not consistent with the new API yet, though). Best regards, Martin BTW: Munich model's rdf representation is fine, that was my fault. Example curl calls: curl -X POST -d algorithm_uri="http://opentox.informatik.tu-muenchen.de:8080/OpenTox-dev/algorithm/kNNregression" \ -d training_dataset_uri="http://ambit.uni-plovdiv.bg:8080/ambit2/dataset/342" \ -d test_dataset_uri="http://ambit.uni-plovdiv.bg:8080/ambit2/dataset/342" \ -d prediction_feature="http://ambit.uni-plovdiv.bg:8080/ambit2/feature/103141" \ http://opentox.informatik.uni-freiburg.de/validation This gives you a task-uri: http://opentox.informatik.uni-freiburg.de/task/XYZ, wait until task state is "complete". (Hint: Task is not API-consistent yet) When task-state is complete, access "resource" field in task, which will be http://opentox.informatik.uni-freiburg.de/validation/XYZ You can then create a report with: curl -X POST -d validation_uris="http://opentox.informatik.uni-freiburg.de/validation/XYZ" \ http://opentox.informatik.uni-freiburg.de/validation/report/validation -- Dipl-Inf. Martin Gütlein Phone: +49 (0)761 203 8442 (office) +49 (0)177 623 9499 (mobile) Email: guetlein at informatik.uni-freiburg.de
- Previous message: [OTDev] Common LDAP backend
- Next message: [OTDev] Sylvia Escher: Out of office
- Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]
More information about the Development mailing list