OT V2.4 Integration Test Plan

Документ взят из кэша поисковой машины. Адрес оригинального документа : http://www.eso.org/projects/dfs/team/OT2-4b2.html
Дата изменения: Thu Jul 18 12:53:19 2002
Дата индексирования: Sun Apr 13 22:57:15 2008
Кодировка:

DFS Group Home Page
OT V2.4beta2 Integration Test Report

Overall comments:

Following testcases are all to be executed on HP 11.0.

Environment(s)

OS: HP 11.0
Machine: wu0dhs
Login: service
JRE: 1.1.8
OT account(s): 0
Accessed DB: TESTSRV

Summary

Count of testcases entirely executed**

73 (97%)

Total specified testcases

**Be aware: this is a cumulative count considering ALL different platforms used during this testing session.

All new bugs and change requests originated on OT V2.4beta2 in one go
and
all bugs and change requests originated on OT V2.4beta1 but still not closed

Ticket details
* tickets still to be discussed with developers:
* tickets to be fixed (for next beta or release): (%)
* tickets suspended (because must never occur in operations): 0
* bug not reproducable (but confirmed): 0

standard testcases
specific testcases

Standard testcases

The following testcases correspond to the minimum set of tests to be run on every new OT release. They are not specific to a given release, but are to give some confidence about the fact that all basic functionalities of OT work fine, in nominal situations only. This means that all possible tricky or error situations, stress and performances tests as described in the complete OT Integration Test Plan are not verified since this is supposed to have been done with a previous testing session (for instance, all query and sorting criteria of the DB browser will not be re-verified here). Usually, a testing session starts first by running the standard testcases.
All standard testcases are run with the debug mode, and debug messages are checked.

1/ START OT

*Testcase number*	*Detailed description*	*Expected result*	*Effective result*	Symptoms	Conclusion
1.1/	- run in debug mode - check the initial debug messages about the configuration tool (which DB is accessed, which VLT CCS, JRE, external libraries/versions are used, which DB is accessed, path to the cache, impex, IPs, config reports, ...) - verify this against the config files which are under the .../config/ directory, and against the .ot.cf if any.	- no error - expected versions	GO
1.2/	- verify the layout: check every menu content (contain expected items ?, any strange layout ?)	- expected layout	BUG NORMAL	See corresponding bugzilla ticket
1.3/	- login not as super-user, quit - re-start as super-user, check the JRE process number	- no error	GO
1.4/	Backward compatibility: - start the previous version of OT. - select some OBs and queues. Note somewhere their definition. - run the new OT version. Select same OBs and queues, and verify the definition is the same	- no difference	GO

top of the page

2/ MANIPULATION OF QUEUES

*Testcase number*	*Detailed description*	*Expected result*	*Effective result*	Symptoms	Conclusion
2.1/	- create a new queue	- queue created	GO
2.2/	- open a queue	- queue opened	GO
2.3/	- append some OBs - save a queue	- queue saved: double stars (**) disappear	GO
2.4/	- name, save, rename, re-save a queue	- queue renamed	GO
2.5/	- delete a queue	- queue deleted	GO
2.6/	- create a new queue - append some OBs - name then save the queue - note somewhere the definition of this queue - quit OT - re-start OT, open previous queue, and verify the definition has not changed	- queue correctly saved	GO

3/ APPEND

*Testcase number*	*Detailed description*	*Expected result*	*Effective result*	Symptoms	Conclusion
3.1/	- append several Science OBs at the same time	- all OBs appended	GO
3.2/	- append several Science and Calibration OBs at the same time	- all OBs appended	GO

4/ QUEUE VIEW

*Testcase number*	*Detailed description*	*Expected result*	*Effective result*	Symptoms	Conclusion
4.1/	- from the DBB, change the status - re-run the QV query - check it's updated in the QV		GO
4.2/	- from the Queue View, change the status - re-run the query from the DBB - check it's updated in the DBB		GO
4.3/	- Copy/Paste an OB between 2 queues		GO
4.4/	COMMENT button: - add a comment to a queue, save the queue, quit and re-start OT: verify the comment is preserved. - change the status from there - change the QC grade from there	- comment correctly saved - Status correctly saved and displayed via the QV grid, and the DBB - QC grade correctly saved and displayed via the QV grid, and the DBB	BUG MINOR	See corresponding bugzilla ticket
4.5/	DESCRIPTION field: - edit it, quit OT without saving the queue. - re-start OT, and re-open the Queue	- description field is preserved	GO
4.6/	QV: Selected Columns: - run some queries selecting some or all possible columns	- expected columns are displayed in the QV grid	GO
4.7/	REVERT button: - open a queue - append a new OB - click on Revert	- OB is removed - double stars (**) disappear	GO

top of the page

5/ OB details

*Testcase number*	*Detailed description*	*Expected result*	*Effective result*	Symptoms	Conclusion
5.1/	- display a Science OB from the QV - check its content against the P2PP OB View - do the same with a Calib OB		GO
5.2/	- display a Science OB from the ExecSeq box - check its content against the P2PP OB View - do the same with a Calib OB		GO

6/ INTERFACE WITH BOB

*Testcase number*	*Detailed description*	*Expected result*	*Effective result*	Symptoms	Conclusion
6.1/	- fetch some OBs from BOB	- no error	BUG NORMAL	See corresponding bugzilla ticket
6.2/	- load some OBD files from BOB	- no error	GO

7/ EXECUTION SEQUENCE

*Testcase number*	*Detailed description*	*Expected result*	*Effective result*	Symptoms	Conclusion
7.1/	Add OBs to the ExecSeq from the QV		GO
7.2/	Add OBs to the ExecSeq from the DBB		GO
7.3/	See how EVMs run when adding OBs to the ExecSeq		BUG MAJOR	See corresponding bugzilla ticket

8/ REPORTS

*Testcase number*	*Detailed description*	*Expected result*	*Effective result*	Symptoms	Conclusion
8.1/	- run all kinds of Reports from the QV		BUG NORMAL	See corresponding bugzilla ticket

9/ MASK TRACKER

*Testcase number*	*Detailed description*	*Expected result*	*Effective result*	Symptoms	Conclusion
9.1/
9.2/
9.3/
9.4/
9.5/

10/ DB BROWSER

*Testcase number*	*Detailed description*	*Expected result*	*Effective result*	*Symptoms*	Conclusion
10.1/	- check several selected column	- no error	GO
10.2/	- check several selection criteria	- no error	BUG MAJOR	See corresponding bugzilla ticket
10.3/	- check several sorting criteria	- no error	BUG NORMAL	See corresponding bugzilla ticket
10.4/	- check several menu items	- no error	BUG MINOR	See corresponding bugzilla ticket

top of the page

Specific testcases

The following testcases correspond to the set of tests to be run on this specific OT release. In principle, here, every item mentioned in the Release Note is verified, in the nominal situation, and as far as it is possible, error situations as well.
Unless explicitely mentioned, all following specific testcases are run with the debug mode, and debug messages are checked.

11/ Release note item 1720:
new ~/.ot.cf file.

*Testcase number*	*Detailed description*	*Expected result*	*Effective result*	Symptoms	Conclusion
11.1/	- create an ~/.ot.cf file - verify all entries, in particular: * path to the IP * path to the IMPEX dir * path to the API tcl script	- every entry in ~/.ot.cf file supersedes the site.cf	BUG NORMAL	See corresponding bugzilla ticket
11.2/	- same as above but after moving away the site.cf file	- every entry in ~/.ot.cf file is correctly read	see 11.1/	see 11.1/

12/ Release note items 1377, 1433:
New OB export feature in QV and DBB.

*Testcase number*	*Detailed description*	*Expected result*	*Effective result*	Symptoms	Conclusion
12.1/	- export some OBs (at the same time) from the QV - import those OBs with P2PP	- *OBX files created - no error from P2PP	BUG NORMAL	See corresponding bugzilla ticket
12.2/	- export some OBs (at the same time) from the DBB - import those OBs with P2PP	- *OBX files created - no error from P2PP	see 12.1/

13/ Release note item ???:
Removed Dump button from main view, only in QV and DBB.

*Testcase number*	*Detailed description*	*Expected result*	*Effective result*	Symptoms	Conclusion
13.1/	- verify location of the Dump feature - activate such feature	- location as expected: new Reports called 'Display as OBD ...' in the QV and in the DBB - selected OBs dumped	GO

14/ Release note item 1643, 1102
DBB configuration is now modifiable.

*Testcase number*	*Detailed description*	*Expected result*	*Effective result*	Symptoms	Conclusion
14.1/	- update the .ot.cf file - new options menu available	- options saved and re-called with the next OT session	BUG NORMAL	See corresponding bugzilla ticket

top of the page

15/ Release note item 0333,1768
It is now possible to save a browser configuration with a name, then recall it (new Options menu). .

*Testcase number*	*Detailed description*	*Expected result*	*Effective result*	Conclusion
15.1/	A browser configuration includes all settings of the Column Selection, Row Selection, and Sorting areas.		see 14.1/
15.2/	Two new optional keywords were added to site.cf or ~/.ot.cf: REPOSITORYBROWSER.CONFIG.CONFIGMENU and QUEUEVIEW.CONFIG.CONFIGMENU		see 14.1/

16/ Release note item 1655
New [clear] option in DBB selected columns.

*Testcase number*	*Detailed description*	*Expected result*	*Effective result*	Symptoms	Conclusion
16.1/	Added standard [clear] option to multiple selection pulldown menus in the Repository Browser, which deselects all currently selected options. The current Ctrl-Click functionality remains available, to select/deselect individual options.		GO

17/ Release note item 1631,1426

*Testcase number*	*Detailed description*	*Expected result*	*Effective result*	Conclusion
17.1/	Font size is now configurable. The optional keyword FONT.OFFSET.SIZE was added to site.cf or ~/.ot.cf. It can take an integer value between -4 and 4, to increase or decrease font sizes in P2PP and OT .	- font size varies with value specified in the .ot.cf file	GO

18/ Release note item 1710
OBS.EXECTIME is re-introduced.

*Testcase number*	*Detailed description*	*Expected result*	*Effective result*	Conclusion
18.1/	Reintroduced OBS.EXECTIME keyword in OBD file to support FLAMES.		GO

19/ Release note item 1345
It is now possible to browse the repository by PI name.

*Testcase number*	*Detailed description*	*Expected result*	*Effective result*	Conclusion
19.1/	- enter a string - enter a number - enter mix char+numbers - enter specific char as ~\<><:"{ ...		GO

top of the page

20/ Release note item 1721
Added progress bar for VisiPlots.

*Testcase number*	*Detailed description*	*Expected result*	*Effective result*	Conclusion
20.1/	Added progress bar for VisiPlots		GO

21/ Release note item 1760
New handling for OB status "D" and "-".

*Testcase number*	*Detailed description*	*Expected result*	*Effective result*	Symptoms	Conclusion
21.1/	- try to queue an OB with status "D" or "-" - change an OB to status "-" or "D"	- can not Queue an OB with status "D" or "-" - changing an OB to status "-" or "D" will remove it from all queues.	GO

22/ Release note item 0388:
Solved "double CCS server" problem.

*Testcase number*	*Detailed description*	*Expected result*	*Effective result*	Symptoms	Conclusion
22.1/	- have a CCS server called "schedule" running - run a second OT server with that name	- error message - the second OT starts, but with no CCS connectiont	GO

23/ Release note item 1672:
DBB: new widget selection feature.

*Testcase number*	*Detailed description*	*Expected result*	*Effective result*	Symptoms	Conclusion
23.1/	In all browsers, to select a column one must now click on the widget itself. In the previous versions of the software one could click on a much larger area.		GO

top of the page

24/ Release note item 1650,0876:
Browser column width calculation reviewed.

*Testcase number*	*Detailed description*	*Expected result*	*Effective result*	Conclusion
24.1/	Browser column width calculation was reviewed; some columns should have a more reasonable size.		GO

25/ Release note item 1723:
Config reports grid improvement.

*Testcase number*	*Detailed description*	*Expected result*	*Effective result*	Symptoms	Conclusion
25.1/	Configuration Reports: first row is now always selected.		GO

26/ Release note item 1729:
Improved performance of some EVMs.

*Testcase number*	*Detailed description*	*Expected result*	*Effective result*	Conclusion
26.1/	Improved performance of some EVMs.		GO

27/ Release note item 1570:
Telescope name is now displayed in the main OT panel.

*Testcase number*	*Detailed description*	*Expected result*	*Effective result*	Symptoms	Conclusion
27.1/	Telescope name is now displayed in the main OT panel		GO

28/ Release note item 1696:
The OB detailed display window is cleared whenever selecting an OB.

*Testcase number*	*Detailed description*	*Expected result*	*Effective result*	Symptoms	Conclusion
28.1/	- The OB detailed display window is cleared whenever selecting an OB.		GO

29/ Release note item 1654,1749:
browsing and display support for new NACO constraint.

*Testcase number*	*Detailed description*	*Expected result*	*Effective result*	Symptoms	Conclusion
29.1/	- Introduced browsing and display support for new NACO constraint.		BUG NORMAL	See corresponding bugzilla ticket

top of the page

30/ Release note item :
Changed Repository Browser layout to move Selection menu items from command button bar to File or Reports menu.

*Testcase number*	*Detailed description*	*Expected result*	*Effective result*	*Symptoms*	Conclusion
30.1/	Changed Repository Browser layout to move Selection menu items from command button bar to File or Reports menu		BUG MINOR	See corresponding bugzilla ticket

31/ Release note item 1689:
OB's last-modification-date.

*Testcase number*	*Detailed description*	*Expected result*	*Effective result*	*Symptoms*	Conclusion
31.1/	- display the new date via DBB - modify an OB via P2PP, check the date is updated - dates are the same between P2PP and OT		GO	also See corresponding bugzilla ticket

32/ Release note item 1736:
new button "Move to top" in Execution Sequence.

*Testcase number*	*Detailed description*	*Expected result*	*Effective result*	*Symptoms*	Conclusion
32.1/	- Added new button "Move to top" in Execution Sequence		GO

33/ Release note item 1767:
Fixed bug: entries "Start Time" and duration in the Queue.

*Testcase number*	*Detailed description*	*Expected result*	*Effective result*	Symptoms	Conclusion
33.1/	- Fixed bug: entries "Start Time" and duration in the Queue View were offset by several hours w.r.t. the actual date/time written in the repository		GO

34/ Release note item 1765:
Definitions found in configuration file in home directory ($HOME/.ot.cf) were not overriding those of site.cf.

*Testcase number*	*Detailed description*	*Expected result*	*Effective result*	Symptoms	Conclusion
34.1/	Fixed bug: definitions found in configuration file in home directory ($HOME/.ot.cf) were not overriding those of site.cf		BUG NORMAL	See corresponding bugzilla ticket and See corresponding bugzilla ticket

top of the page

35/ Release note item 1332:
shift-clicking (to complete selection) was not working right after completing a query.

*Testcase number*	*Detailed description*	*Expected result*	*Effective result*	Symptoms
35.1/	Fixed bug: in a Database Browser, shift-clicking (to complete selection) was not working right after completing a query: one needed to first click, although one row was already selected.		GO

36/ Release note item 1722:
Fixed bug: VisiPlots was only using one Time Interval, even if several were defined.

*Testcase number*	*Detailed description*	*Expected result*	*Effective result*	*Symptoms*	Conclusion
36.1/	- create an OB attaching 3 TIs. This OB should be visible after the StartTime choosen for the VisiPlots, and within the 3 different TIs. - run the VisiPlot without 'TI' as constraint - run the VisiPlot without 'TI' as constraint - still running OT, modify one TI of the OB (via P2PP) so that it's not visible anymore. - re-run the VisiPlot without constraint - re-run the VisiPlot with constraint	- the OB is visible - the OB is visible. - the OB is visible - the OB is NOT visible anymore	GO	also see See corresponding bugzilla ticket

37/ Release note item 1657:
could not move mouse pointer on menu Selection->Mark when using the CDE .

*Testcase number*	*Detailed description*	*Expected result*	*Effective result*	Symptoms	Conclusion
37.1/	- Fixed bug: Repository Browser: could not move mouse pointer on menu Selection->Mark when using the CDE window manager.		GO ? (at least not reproducable)

38/ Release note item 1701:
wrong values in drop-down menu 'QC Grade'.

*Testcase number*	*Detailed description*	*Expected result*	*Effective result*	Symptoms	Conclusion
38.1/	- Fixed bug: there were wrong values in drop-down menu 'QC Grade'.		BUG MINOR	See corresponding bugzilla ticket

39/ Release note item 1694:
Fixed bug: was generating a (harmless) "Attempted to append to closed appender".

*Testcase number*	*Detailed description*	*Expected result*	*Effective result*	Symptoms	Conclusion
39.1/	- Fixed bug: was generating a (harmless) "Attempted to append to closed appender" error message when terminating the program.		GO

top of the page

40/ Release note item 1733:
execution time in Execution Sequence and Queue View was displayed in seconds instead of HH:MM:SS.

*Testcase number*	*Detailed description*	*Expected result*	*Effective result*	Symptoms	Conclusion
40.1/	- Fixed bug: execution time in Execution Sequence and Queue View was displayed in seconds instead of HH:MM:SS, as for other browsers.		GO

41/ Release note item 1745:
wrong shared library was referenced.

*Testcase number*	*Detailed description*	*Expected result*	*Effective result*	Symptoms
41.1/	- Fixed bug: wrong shared library was referenced.		GO

42/ Release note item :
Fixed problem with resising of QueuView on notebooks and a problem with the SplitterPane.

*Testcase number*	*Detailed description*	*Expected result*	*Effective result*	Symptoms	Conclusion
42.1/	- Fixed problem with resising of QueuView on notebooks and a problem with the SplitterPane.		Not tested (no notebooks available)

43/ Release note item 1671:
Reviewed generation of released database configuration files.

*Testcase number*	*Detailed description*	*Expected result*	*Effective result*	Symptoms	Conclusion
43.1/	- Reviewed generation of released database configuration files.		not tested (don't know exactly what to check)

44/ Release note item 1747:
Updated list of supported keyword categories.

*Testcase number*	*Detailed description*	*Expected result*	*Effective result*	Symptoms	Conclusion
44.1/	- create a FORS2 tsf file with the new COU DEL and ISS categories. - via P2PP, verify it (desactivate the EVM otherwise will complain), export it, and save it as OBD - back with OT, retrieve the OB and append it to a queue - put to ExecSeq, then fetch from BOB - also save as OBD, and export from OT - load the OBD produced by P2PP, and the one produced by OT - finally, again with P2PP, import the OBX produced by OT	No error	GO

45/ Release note item ???:
Strehl ratio is introduced.

*Testcase number*	*Detailed description*	*Expected result*	*Effective result*	Symptoms	Conclusion
45.1/	- Strehl ratio appears in the QV grid, in the Display box		GO
45.2/	- Strehl ratio appears in the ObsBlock reports		GO

top of the page