wiki:PromotTestResults

Version 18 (modified by rempel, 16 years ago) (diff)

--

ProMoT Test Results

The numbering for test cases corresponds with the numbers in testplan.
Each test result should contain

  • the name of the test person,
  • the date of the actual testing,
  • the number of the build revision,
  • w/o development mode and
  • the type and version of the operating system.

JUnit Tests (development mode)

rempel 16.07. r8482 Vista: all passed
kolczyk 17.07. r8506 Suse10.1: all passed (VM-arguments -Xmx256 at least required, options editor: "show Terminal Names": ON, "Checker": ON)
mirschel 17.07. r8515 Suse10.2: all 35 tests passed (VM-arguments -Xmx256, options editor: "show Terminal Names": ON, "Checker": ON)

Test results for Promot Browser

functional tests: sbml import tested with curated models from current release (16.06.09) of biomodels, all models without delay (24, 25, 34, 154, 155, 196) could be imported, events are ignored so imported models are incorrect, some models (198, 199) result in errors for libsbml, but can be loaded still, for that reasons errors from libsbml are recorded but the models can be imported, error handling is done in lisp import or conversion (libsbml)

resulting mdl models (110 - 216) were exported to diana, problems with calculation of symbolic jacobian matrix for 161 and 171, 214 (both problem to get 2. derivative of mod) export works for all 3 models if calculation of symbolic jacobian is disabled

problems during import and export, import + layout to check models which did not work initially:

  • gui hang on BM110 (not reproduceable, most likely problem that signal that server has finished task is lost)
  • after exceptions (inconsistent model?) null pointer exception in checker for stacktrace see ExceptionsDuringTest
  • stacktraces for PromotUI start (everything worked afterwards, might be related to #163) for stacktrace see ExceptionsDuringTest
  • exceptions during layout (check of models with import/export problems probably most comprehensive test of editor so far ...) for stacktrace see ExceptionsDuringTest

2009-07-27: All tests in Browser passed (except test 12, see below), !JUnitTests not tested:

  • mirschel
  • r8624
  • no development mode
  • openSUSE 10.3, note44
  • jre1.6.0_14, default options for vm
  • Test 12: In the export dialog the new entered path in the generation directory must be finished with <ENTER>, a simple !focusChanged event is not handled.
    Possibly an issue in other export dialogs too.

2009-07-28: serious problems in test under windows xp:

  • load mdl doesn´t work if further mdl files are included

(default path might be different, loading of included files is working as sbml import depends on it and EGF-load is working with includes too, so an example might clarify what/if something is going wrong)

* promot.exe can not be started, batch files (promot, promot-server, promot-ui) work cmp. #168, read download mail/readme.txt

  • known problem with menu build up, sometimes the whole frame is black
  • device names are not shown in file-chooser
  • some menu names in german (Browser/Editor?)
  1. load mdl model
  2. Load the logical library and a model
  3. Import a SBML model + layout
  4. Save a model
  5. Export to SBML
  6. Export to Diana/Diva?
  7. Select a class, class + superclasses, class + dependencies, class + dependents, all classes
  8. Run script, test with default inputs for synthetic biology scripts
  9. change properties: icon, abstract, model (including undo)

visual inspection for:

  1. Start Visual Editor for a class
  2. Start Visual Explorer for a class
  3. ViewMathematicalModel (display of instance)
  4. Exit with Dialog for modified in Editor + Browser (change properties, load, import)
  5. Search class (+class for slot in class) dialog, model type is not important, so test with egf_model,

search egf_model (substring, class + slot; class) should return egf_model (class), egf_model_noint (class)
search proti (whole word, class + slot; slot) should return egf_model:proti (slot)
clear should remove displayed results;

Test results for ProMoT Visual Editor

all tests in editor passed

  • kolczyk
  • tests except 12: r8518; test 12: r8525
  • with development mode
  • Suse 10.1
  • VM-arguments: default from scripts

2009-07-27: All tests in Visual Editor passed, !JUnitTests not tested:

  • mirschel
  • r8599 (lisp),r8595 (java)
  • no development mode
  • openSUSE 10.3, note44
  • jre1.6.0_14, default options for vm
  1. Save a model (as)
  2. Close the editor
  3. Drag&Drop a class from the BrowserTree to the Modules-palette/ ConstructionArea
  4. Drag&Drop a class from the Modules-palette to the ConstructionArea
  5. Delete a class in the Modules-palette
  6. Dispose a slot in the ConstructionArea
  7. Open a further Visual Editor for the class of a slot
  8. Rename a slot (unconnected/connected)
  9. Connect two slots
  10. Translate a slot
  11. Propagate a terminal from a slots port (logical gate terminal, logical compound terminal, dynamic terminals)
  12. EditDetailsDialog (single changes/combination of changes)
  13. Copy&Paste a selection of slots (inside one/ between two editors)
  14. Elevate a modules content to the current level (de-modularization)
  15. Create a new class from a selection (modularization)
  16. Export graphics
  17. Set Map number
  18. Set module size
  19. Fit module size
  20. Apply a layout
  21. Test ShourtCuts
  22. Test Checker for logical and dynamic models

Test results for Promot Visual Explorer

2009-07-17: All tests in Visual Explorer passed:

  • mirschel
  • r8482 - r8510
  • with development mode
  • openSUSE 10.2
  • VM-arguments -Xms512m -Xmx1024m, LD_LIBRARY_PATH=../../lib/

2009-07-23: Reiterate tests 17-21, 26-27, all passed:

  • mirschel
  • r8556
  • with development mode
  • openSUSE 10.2
  • VM-arguments -Xms512m -Xmx1024m, LD_LIBRARY_PATH=../../lib/

2009-07-27: All tests in Visual Explorer passed, !JUnitTests not tested:

  • mirschel
  • r8599 (lisp),r8595 (java)
  • no development mode
  • openSUSE 10.3, note44
  • jre1.6.0_14, default options for vm

JUnit Tests

  1. Import node and edge attributes
  2. Load global scenarios
  3. Logical Network Parser for Scenario 'Logical Network'

Tests

  1. Import/export layout
  2. Export graphics
  3. Export logical model
  4. Edit scenarios, new/copy/rename/remove/mappings
  5. Load user-defined (local) scenarios
  6. Save user-defined (local) scenarios
  7. Exit with/without dialog

Visual Inspection

  1. Apply orthogonal layout to network
  2. Grid layer on/off
  3. Squiggle layer on/off
  4. Status layer on/off
  5. Overview layer on/off
  6. Legend layer on/off/correct mappings
    • Legend does not match loaded model mappings in some cases (e.g. terminal shapes not correct).
    • Legend is modal --> fixed.
  7. Navigation mode: Interactive Zoom
  8. Navigation mode: Hierarchy Zoom
  9. Navigation mode: Fisheye Zoom
    • In some cases when expand/shrink a node the intersection point (border, edge) is calculated not correctly (see general problems with calculation of intersection points).
    • Handle points are not considered in calculation.
  10. Navigation mode: Focus Zoom
  11. Editing mode: Editing (move/resize all/resize border/edit edge handles)
  12. Show (all) icons on/off
  13. Show (all) details on/off
    • 'Show (all) details' changed to 'Show (all) content'.
  14. Show (all) labels on/off
  15. Show (all) label boxes on/off
  16. Edge: Go to source
  17. Edge: Go to target
  18. Search for node/edge in network
  19. Check model type

Not tested/not critical/trivial

  1. Statistics dialog