[OTDev] model validation

Martin Guetlein martin.guetlein at googlemail.com
Mon Mar 29 12:21:08 CEST 2010


Dear developers,

I just managed to validate a knn-model from TUM
(http://opentox.informatik.tu-muenchen.de:8080/OpenTox-dev/algorithm/kNNregression),
with a small ambit dataset
(http://ambit.uni-plovdiv.bg:8080/ambit2/dataset/342).

I validated the model on the training-dataset (the results are as good
as expected when validating a knn model on the training dataset!).
Results can be found here:
http://opentox.informatik.uni-freiburg.de/validation/15
http://opentox.informatik.uni-freiburg.de/validation/report/validation/3
(Remark: validation-rdf representation not working, only yaml
available for the moment, will be fixed ASAP; regression report is
still very basic).

You can find the curl calls used to perform this validation, below.

To Tobias, Nina: Do you have a nice representative example for a
regression validation for the report (i.e. which model, dataset)?

Please try validating your model (more curl examples see:
http://opentox.informatik.uni-freiburg.de/validation/examples), and
report errors to me (error reporting is not consistent with the new
API yet, though).

Best regards,
Martin


BTW: Munich model's rdf representation is fine, that was my fault.


Example curl calls:

curl -X POST -d
algorithm_uri="http://opentox.informatik.tu-muenchen.de:8080/OpenTox-dev/algorithm/kNNregression"
\
 -d training_dataset_uri="http://ambit.uni-plovdiv.bg:8080/ambit2/dataset/342" \
 -d test_dataset_uri="http://ambit.uni-plovdiv.bg:8080/ambit2/dataset/342" \
 -d prediction_feature="http://ambit.uni-plovdiv.bg:8080/ambit2/feature/103141"
\
 http://opentox.informatik.uni-freiburg.de/validation

This gives you a task-uri:
http://opentox.informatik.uni-freiburg.de/task/XYZ, wait until task
state is "complete".
(Hint: Task is not API-consistent yet)
When task-state is complete, access "resource" field in task, which
will be http://opentox.informatik.uni-freiburg.de/validation/XYZ

You can then create a report with:

curl -X POST -d
validation_uris="http://opentox.informatik.uni-freiburg.de/validation/XYZ"
\
  http://opentox.informatik.uni-freiburg.de/validation/report/validation


-- 
Dipl-Inf. Martin Gütlein
Phone:
+49 (0)761 203 8442 (office)
+49 (0)177 623 9499 (mobile)
Email:
guetlein at informatik.uni-freiburg.de



More information about the Development mailing list