wiki:PromotTestResults

Version 23 (modified by kolczyk, 16 years ago) (diff)

--

ProMoT Test Results

The numbering for test cases corresponds with the numbers in testplan.
Each test result should contain

  • the name of the test person,
  • the date of the actual testing,
  • the number of the build revision,
  • w/o development mode and
  • the type and version of the operating system.

JUnit Tests (development mode)

rempel 16.07. r8482 Vista: all passed
kolczyk 17.07. r8506 Suse10.1: all passed (VM-arguments -Xmx256 at least required, options editor: "show Terminal Names": ON, "Checker": ON)
mirschel 17.07. r8515 Suse10.2: all 35 tests passed (VM-arguments -Xmx256, options editor: "show Terminal Names": ON, "Checker": ON)

Test results for Promot Browser

functional tests: sbml import tested with curated models from current release (16.06.09) of biomodels, all models without delay (24, 25, 34, 154, 155, 196) could be imported, events are ignored so imported models are incorrect, some models (198, 199) result in errors for libsbml, but can be loaded still, for that reasons errors from libsbml are recorded but the models can be imported, error handling is done in lisp import or conversion (libsbml)

resulting mdl models (110 - 216) were exported to diana, problems with calculation of symbolic jacobian matrix for 161 and 171, 214 (both problem to get 2. derivative of mod) export works for all 3 models if calculation of symbolic jacobian is disabled

problems during import and export, import + layout to check models which did not work initially:

  • gui hang on BM110 (not reproduceable, most likely problem that signal that server has finished task is lost)
  • after exceptions (inconsistent model?) null pointer exception in checker for stacktrace see ExceptionsDuringTest
  • stacktraces for PromotUI start (everything worked afterwards, might be related to #163) for stacktrace see ExceptionsDuringTest
  • exceptions during layout (check of models with import/export problems probably most comprehensive test of editor so far ...) for stacktrace see ExceptionsDuringTest

2009-07-27: All tests in !ProMoT Browser passed, JUnitTests not tested:

  • mirschel
  • r8624
  • no development mode
  • openSUSE 10.3, note44
  • jre1.6.0_14, default options for vm
    Issues:
  • Test 12: In the export dialog the new entered path in the generation directory must be finished with <ENTER>, a simple !focusChanged event is not handled. Possibly an issue in other export dialogs too.

2009-07-28: All tests in !ProMoT Browser passed, JUnitTests not tested:

  • mirschel
  • r8624
  • no development mode
  • windows xp, note44
  • jre-1.6.0_14-b105, default options for vm Issues:
  • Test 18: Old fashioned search dialog in search of ViewMathModel, remove or update gui

2009-07-28: serious problems in test under windows xp(jre-6u14-windows-i586):

  • the whole !PromotUI-frame is black on startup, after resize the menubar is black.. (does not emerge with jre-6u7)

2009-07-29: serious problems in test under windows xp:

  • load mdl doesn´t work if further mdl files are included; on one laptop(Katrin) for all models with more than one file reproducible, on mpi-laptops only for some (toymodel_tutorial), EGF and parctical-bio can be loaded (works after r8637, tested for tymodel_tutorial, EGF, practical-bio)
  1. load mdl model
  2. Load the logical library and a model
  3. Import a SBML model + layout
  4. Save a model
  5. Export to SBML
  6. Export to Diana/Diva?
  7. Select a class, class + superclasses, class + dependencies, class + dependents, all classes
  8. Run script, test with default inputs for synthetic biology scripts
  9. change properties: icon, abstract, model (including undo)

visual inspection for:

  1. Start Visual Editor for a class
  2. Start Visual Explorer for a class
  3. ViewMathematicalModel (display of instance)
  4. Exit with Dialog for modified in Editor + Browser (change properties, load, import)
  5. Search class (+class for slot in class) dialog, model type is not important, so test with egf_model,

search egf_model (substring, class + slot; class) should return egf_model (class), egf_model_noint (class)
search proti (whole word, class + slot; slot) should return egf_model:proti (slot)
clear should remove displayed results;

Test results for ProMoT Visual Editor

all tests in editor passed

  • kolczyk
  • tests except 12: r8518; test 12: r8525
  • with development mode
  • Suse 10.1
  • VM-arguments: default from scripts

2009-07-27: All tests in Visual Editor passed, !JUnitTests not tested:

  • mirschel
  • r8599 (lisp),r8595 (java)
  • no development mode
  • openSUSE 10.3, note44
  • jre1.6.0_14, default options for vm

2009-07-28: All tests in Visual Editor passed, JUnitTests not tested:

  • mirschel
  • r8624
  • no development mode
  • windows xp, note44
  • jre-1.6.0_14-b105, default options for vm
    Issues:
  • Test 21: undo not working after creating several activation links

2009-07-29: serious problems in test under windows xp:

  • update problems after dispose of single nodes or selection
  • propagating of terminals leaves intermediate state (additional terminal and link)
  • refresh doesn't restore links
  • changing class in EditDetails?-dialog does not update editor

all these problems seen to be related, closing and reopening the editor achieve the expected result

  1. Save a model (as)
  2. Close the editor
  3. Drag&Drop a class from the BrowserTree to the Modules-palette/ ConstructionArea
  4. Drag&Drop a class from the Modules-palette to the ConstructionArea
  5. Delete a class in the Modules-palette
  6. Dispose a slot in the ConstructionArea
  7. Open a further Visual Editor for the class of a slot
  8. Rename a slot (unconnected/connected)
  9. Connect two slots
  10. Translate a slot
  11. Propagate a terminal from a slots port (logical gate terminal, logical compound terminal, dynamic terminals)
  12. EditDetailsDialog (single changes/combination of changes)
  13. Copy&Paste a selection of slots (inside one/ between two editors)
  14. Elevate a modules content to the current level (de-modularization)
  15. Create a new class from a selection (modularization)
  16. Export graphics
  17. Set Map number
  18. Set module size
  19. Fit module size
  20. Apply a layout
  21. Test ShourtCuts
  22. Test Checker for logical and dynamic models

Test results for Promot Visual Explorer

2009-07-17: All tests in Visual Explorer passed:

  • mirschel
  • r8482 - r8510
  • with development mode
  • openSUSE 10.2
  • VM-arguments -Xms512m -Xmx1024m, LD_LIBRARY_PATH=../../lib/

2009-07-23: Reiterate tests 17-21, 26-27, all passed:

  • mirschel
  • r8556
  • with development mode
  • openSUSE 10.2
  • VM-arguments -Xms512m -Xmx1024m, LD_LIBRARY_PATH=../../lib/

2009-07-27: All tests in Visual Explorer passed, !JUnitTests not tested:

  • mirschel
  • r8599 (lisp),r8595 (java)
  • no development mode
  • openSUSE 10.3, note44
  • jre1.6.0_14, default options for vm

2009-07-28: All tests in Visual Explorer passed, JUnitTests not tested:

  • mirschel
  • r8624
  • no development mode
  • windows xp, note44
  • jre-1.6.0_14-b105, default options for vm

JUnit Tests

  1. Import node and edge attributes
  2. Load global scenarios
  3. Logical Network Parser for Scenario 'Logical Network'

Tests

  1. Import/export layout
  2. Export graphics
  3. Export logical model
  4. Edit scenarios, new/copy/rename/remove/mappings
  5. Load user-defined (local) scenarios
  6. Save user-defined (local) scenarios
  7. Exit with/without dialog

Visual Inspection

  1. Apply orthogonal layout to network
  2. Grid layer on/off
  3. Squiggle layer on/off
  4. Status layer on/off
  5. Overview layer on/off
  6. Legend layer on/off/correct mappings
    • Legend does not match loaded model mappings in some cases (e.g. terminal shapes not correct).
    • Legend is modal --> fixed.
  7. Navigation mode: Interactive Zoom
  8. Navigation mode: Hierarchy Zoom
  9. Navigation mode: Fisheye Zoom
    • In some cases when expand/shrink a node the intersection point (border, edge) is calculated not correctly (see general problems with calculation of intersection points).
    • Handle points are not considered in calculation.
  10. Navigation mode: Focus Zoom
  11. Editing mode: Editing (move/resize all/resize border/edit edge handles)
  12. Show (all) icons on/off
  13. Show (all) details on/off
    • 'Show (all) details' changed to 'Show (all) content'.
  14. Show (all) labels on/off
  15. Show (all) label boxes on/off
  16. Edge: Go to source
  17. Edge: Go to target
  18. Search for node/edge in network
  19. Check model type

Not tested/not critical/trivial

  1. Statistics dialog