Difference between revisions of "201701 Patient Track Proposal"
Ron Shapiro (talk | contribs) |
Ron Shapiro (talk | contribs) |
||
Line 107: | Line 107: | ||
:Success Criteria: Subsequently querying for the patient - either searching by name or by Id - fails. | :Success Criteria: Subsequently querying for the patient - either searching by name or by Id - fails. | ||
+ | ==Format Testing== | ||
=== Level 2 - Formal Testing - Participants with FHIR experience === | === Level 2 - Formal Testing - Participants with FHIR experience === | ||
'''The following scenarios represent the formal testing scenarios that participants have been working to implement both prior to and during the Connectathon event. Execution of these scenarios will focus on automated testing with the public testing platforms and is expected to be performed with the other participants of this track as well as the [[Publicly_Available_FHIR_Servers_for_testing]]. Each of the scenarios are implemented as FHIR TestScript resources that include extensive assertions to provide a more comprehensive validation/verification of the systems under test conformance to the FHIR specification.''' | '''The following scenarios represent the formal testing scenarios that participants have been working to implement both prior to and during the Connectathon event. Execution of these scenarios will focus on automated testing with the public testing platforms and is expected to be performed with the other participants of this track as well as the [[Publicly_Available_FHIR_Servers_for_testing]]. Each of the scenarios are implemented as FHIR TestScript resources that include extensive assertions to provide a more comprehensive validation/verification of the systems under test conformance to the FHIR specification.''' | ||
Line 115: | Line 116: | ||
==== 1. Patient Registration/Creation ==== | ==== 1. Patient Registration/Creation ==== | ||
− | :'''FHIR Server''' | + | :'''FHIR Server (NOTE: Skip to the 99. test below to complete testing with a single TestScript)''' |
::Action: Use testing tool to create a new patient on the FHIR server | ::Action: Use testing tool to create a new patient on the FHIR server | ||
− | ::Precondition: | + | ::Precondition: TestScript will first delete the patient if it exists |
::Success Criteria: Testing tool passes all assertions and validations which include (a) HTTP status returned is 201 (Created), (b) returned format matches sent format, (c) patient can be retrieved and HTTP status 200 (OK) is returned, (d) retrieved patient format matches sent format and (e) conforms to base FHIR Patient profile. | ::Success Criteria: Testing tool passes all assertions and validations which include (a) HTTP status returned is 201 (Created), (b) returned format matches sent format, (c) patient can be retrieved and HTTP status 200 (OK) is returned, (d) retrieved patient format matches sent format and (e) conforms to base FHIR Patient profile. | ||
Line 127: | Line 128: | ||
==== 2. Patient Modification/Update ==== | ==== 2. Patient Modification/Update ==== | ||
:'''FHIR Server''' | :'''FHIR Server''' | ||
− | ::Action: Use testing tool to update an existing patient on the FHIR server | + | ::Action: Use testing tool to update an existing patient on the FHIR server with a new birth date |
− | ::Precondition: | + | ::Precondition: TestScript will first delete the patient if it exists and create a new patient resource to update |
− | ::Success Criteria: Testing tool passes all assertions and validations | + | ::Success Criteria: Testing tool passes all assertions and validations which include (a) HTTP status returned is 200 (OK), (b) HTTP Header Content-Type is returned with correct value, (c) updated patient can be retrieved and HTTP status 200 (OK) is returned, (d) retrieved patient conforms to base FHIR Patient profile. |
:'''FHIR Client''' | :'''FHIR Client''' | ||
Line 137: | Line 138: | ||
:'''FHIR Server''' | :'''FHIR Server''' | ||
::Action: Use testing tool to retrieve a patient from the FHIR server | ::Action: Use testing tool to retrieve a patient from the FHIR server | ||
− | ::Precondition: | + | ::Precondition: TestScript will first delete the patient if it exists and create a new patient resource to retrieve |
− | ::Success Criteria: Testing tool passes all assertions and validations | + | ::Success Criteria: Testing tool passes all assertions and validations which include (a) HTTP status returned is 200 (OK), (b) HTTP Header Content-Type is returned with correct value, (c) retrieved patient conforms to base FHIR Patient profile |
:'''FHIR Client''' | :'''FHIR Client''' | ||
Line 146: | Line 147: | ||
:'''FHIR Server''' | :'''FHIR Server''' | ||
::Action: Use testing tool to retrieve patient history from the FHIR server | ::Action: Use testing tool to retrieve patient history from the FHIR server | ||
− | ::Precondition: | + | ::Precondition: TestScript will first delete the patient if it exists and create a new patient resource and update it with a 2nd revision to be retrieved |
− | ::Success Criteria: Testing tool passes all assertions and validations | + | ::Success Criteria: Testing tool passes all assertions and validations which include (a) HTTP status returned is 200 (OK), (b) HTTP Header Content-Type is returned with correct value, (c) returned resource type is Bundle, (d) the returned Bundle conforms to the base FHIR Bundle profile, (e) the Bundle type is history, (f) the Bundle contains at least 2 entries and (g) the Bundle total value matches the number of entries. |
:'''FHIR Client''' | :'''FHIR Client''' | ||
Line 154: | Line 155: | ||
==== 5. Patient Version Read ==== | ==== 5. Patient Version Read ==== | ||
:'''FHIR Server''' | :'''FHIR Server''' | ||
− | ::Action: Use testing tool to retrieve specific patient | + | ::Action: Use testing tool to retrieve specific patient versions from the FHIR server |
− | ::Precondition: | + | ::Precondition: TestScript will first delete the patient if it exists and create a new patient resource and update it with a 2nd revision to be retrieved |
− | ::Success Criteria: Testing tool passes all assertions and validations | + | ::Success Criteria: Testing tool passes all assertions and validations for both versions of the patient which include (a) HTTP status returned is 200 (OK), (b) HTTP Header Content-Type is returned with correct value, (c) returned resource conforms to base FHIR Patient profile. |
:'''FHIR Client''' | :'''FHIR Client''' | ||
Line 164: | Line 165: | ||
:'''FHIR Server''' | :'''FHIR Server''' | ||
::Action: Use testing tool to search for patient on the FHIR server | ::Action: Use testing tool to search for patient on the FHIR server | ||
− | ::Precondition: | + | ::Precondition: TestScript will first delete the patient if it exists and create a new patient resource to search for by identifier, given and family name |
− | ::Success Criteria: Testing tool passes all assertions and validations | + | ::Success Criteria: Testing tool passes all assertions and validations which include (a) HTTP status returned is 200 (OK), (b) HTTP Header Content-Type is returned with correct value, (c) returned resource type is Bundle, (d) the returned Bundle conforms to the base FHIR Bundle profile, (e) the Bundle type is searchset, and (f) the Bundle total value matches the number of entries. |
:'''FHIR Client''' | :'''FHIR Client''' | ||
Line 173: | Line 174: | ||
:'''FHIR Server''' | :'''FHIR Server''' | ||
::Action: Use testing tool to delete patient on the FHIR server | ::Action: Use testing tool to delete patient on the FHIR server | ||
− | ::Precondition: | + | ::Precondition: TestScript will first delete the patient if it exists and create a new patient resource to be deleted |
− | ::Success Criteria: Testing tool passes all assertions and validations | + | ::Success Criteria: Testing tool passes all assertions and validations which include (a) HTTP status returned is 204 (No Content), (b) after attempting to read patient an HTTP status 410 (Gone) is returned, and (c) after attempting to search patient an HTTP status 200 (OK) is returned, the HTTP Content-Type is returned with the correct value, returned resource type is Bundle, and the returned Bundle contains no entries. |
:'''FHIR Client''' | :'''FHIR Client''' | ||
Line 180: | Line 181: | ||
==== 99. All Patient Operations Defined Above ==== | ==== 99. All Patient Operations Defined Above ==== | ||
− | :'''FHIR Server''' | + | :'''FHIR Server (use this TestScript to perform all steps at once)''' |
::Action: Use testing tool to perform all of the steps listed above on the FHIR server | ::Action: Use testing tool to perform all of the steps listed above on the FHIR server | ||
− | ::Precondition: | + | ::Precondition: TestScript will first delete the patient if it exists |
− | ::Success Criteria: Testing tool passes all assertions and validations | + | ::Success Criteria: Testing tool passes all assertions and validations which include those for each of the steps listed above |
:'''FHIR Client''' | :'''FHIR Client''' |
Revision as of 21:44, 4 January 2017
Return to January 2017 Proposals
Contents
- 1 Patient
- 1.1 Pre-Requisites
- 1.2 Level 1 - Introduction - New Participants/Systems
- 1.3 Level 2 - Formal Testing - Participants with FHIR experience
- 1.4 Submitting WG/Project/Implementer Group
- 1.5 Justification
- 1.6 Proposed Track Lead
- 1.7 Expected participants
- 1.8 Roles
- 1.9 Scenarios
- 1.10 Format Testing
- 1.10.1 Level 2 - Formal Testing - Participants with FHIR experience
- 1.10.1.1 1. Patient Registration/Creation
- 1.10.1.2 2. Patient Modification/Update
- 1.10.1.3 3. Patient Read
- 1.10.1.4 4. Patient History
- 1.10.1.5 5. Patient Version Read
- 1.10.1.6 6. Patient Searching via Multiple Criteria
- 1.10.1.7 7. Patient Deletion/Removal
- 1.10.1.8 99. All Patient Operations Defined Above
- 1.10.1 Level 2 - Formal Testing - Participants with FHIR experience
- 1.11 Help Links
- 1.12 TestScript(s)
Patient
Starting with the Connectathon 14 event in San Antonio this track will include additional levels of testing including a more formalized reporting of test results.
Pre-Requisites
For all levels of testing the required pre-requisite is the fundamental requirement that all FHIR servers SHALL support the capabilities interaction.
Level 1 - Introduction - New Participants/Systems
This has been and will remain the primary purpose of this track and provides a 'friendly introduction' for those new to FHIR. Attendees participate in this track using a simple scenario that can be met with limited domain knowledge and by those who have not had a lot of exposure to FHIR. It is quite feasible to complete the client side of the track within a day with only knowledge of a development environment and little to no previous FHIR knowledge. If creating a server, advanced preparation will be required, but this scenario should somewhat limit the effort involved.
Pre-connectathon testing is encouraged, but not required, where the participants can utilize the existing Publicly_Available_FHIR_Servers_for_testing.
Testing and test reporting at the Connectathon event will be self-attested using the Results tab of the Tracking Spreadsheet (link TBD) and primarily involve peer-to-peer execution between known FHIR clients and/or servers.
Level 2 - Formal Testing - Participants with FHIR experience
(Level 1 +) This level introduces a more formalized testing approach for those participants that have been working the FHIR specification for one or more Connectathon events and have systems that are in active development, or deployed or soon to be deployed into a production environment. Automated testing is significantly leveraged for both automated testing (testing tool to FHIR server) and surveliance of peer-to-peer testing (external FHIR client to external FHIR server).
Pre-connectathon testing is highly encouraged in order to be better prepared for the actual Connectathon event and become familiar with the public testing platforms that will be used for the formal testing.
Testing and test reporting will be done using the public testing platforms which will provide test results via the new FHIR TestReport resource type as well as any specific reporting capabilities of those testing platforms. These reports will provide qualitative and quantitative analysis of the system under test and its conformance to the FHIR specification.
Submitting WG/Project/Implementer Group
FHIR Management Group (FMG)
Justification
This is the Patient Track testing that is included in all FHIR Connectathons.
This track provides new participants with a friendly introduction to FHIR, using a simple scenario that can be met with limited domain knowledge and by those who have not had a lot of exposure to FHIR.
Proposed Track Lead
See Connectathon_Track_Lead_Responsibilities
Coordinator: Ron Shapiro
Test Support: Richard Ettema
Expected participants
Level 1
- Many of the new participants which typically make up 30% or more of Connectathon attendees.
- AEGIS - Touchstone tool and test scripts (optional)
- AEGIS - WildFHIR Public Test Server and Client
- Additional participants
See Tracking Spreadsheet (link TBD)
Level 2
- AEGIS - Touchstone tool and test scripts
- AEGIS - WildFHIR Public Test Server and Client
- Additional participants
See Tracking Spreadsheet (link TBD)
Roles
FHIR Client
This actor initiates the processing requests that enable the creation, deletion, manipulation and retrieval of Patient resource instances. The required, supported interactions are the defined basic CRUD operations: create, read, update and delete. Additional required, supported interactions are the operations: vread, history and search.
(Example FHIR Client CapabilityStatement here)
FHIR Server
This actor receives, processes and responds to the requests for creation, deletion, manipulation and retrieval of Patient resource instances. The implementation of this actor would normally provide for a repository storage mechanism along with corresponding maintenance and retrieval capabilities of the Patient resource instances. The required, supported interactions are the defined basic CRUD operations: create, read, update and delete. Additional required, supported interactions are the operations: vread, history and search.
(Example FHIR Server CapabilityStatement here)
Scenarios
Level 1 - Introduction - New Participants/Systems
The following scenarios represent the basic scenarios that participants will work to implement during the Connectathon event. Execution of these scenarios is expected to be performed with the other participants of this track as well as the Publicly_Available_FHIR_Servers_for_testing.
1. Register a new patient
- Action: FHIR client creates a new patient and save to FHIR server. The client can assign the Id.
- Precondition: Patient does not exist in FHIR server prior to action
- Success Criteria: Patient created correctly on FHIR server (use browser to inspect Patient)
- Bonus point: The Patient resource has an extension
>>Note: the resource Id can either be created by the client or the server (depending on the capability of the server). However, if the server assigns the Id, then the client will need to be able to retrieve the Id from the server response or by a patient query.
2. Update a patient
- Action: FHIR client updates the patient created in scenario #1 and updates to FHIR server. The patient is retrieved by Id.
- Precondition: Patient has been created
- Success Criteria: Patient updated on FHIR server (use browser to inspect Patient)
- Bonus Point #1: Update a patient that has extensions, but leaving the extension untouched.
- Bonus Point #2: Update a patient that has extensions, and update the extension also.
3. Retrieve Patient history
- Action: FHIR client searches the FHIR server for the history of a Patient
- Precondition: There is a patient that has at least one update
- Success Criteria: Patient's history displayed in interface. (use browser to query FHIR server)
- Bonus point: The UI allows the user to display previous versions of the Patient
4. Search for a patient on name
- Action: FHIR client searches the FHIR server for patients with a given name
- Precondition: Patients with that name have been created
- Success Criteria: patients displayed in interface. (use browser query to confirm)
5. Delete a patient
- Action: FHIR client deletes the patient with a given id
- Precondition: a Patients with that Id has been created
- Success Criteria: Subsequently querying for the patient - either searching by name or by Id - fails.
Format Testing
Level 2 - Formal Testing - Participants with FHIR experience
The following scenarios represent the formal testing scenarios that participants have been working to implement both prior to and during the Connectathon event. Execution of these scenarios will focus on automated testing with the public testing platforms and is expected to be performed with the other participants of this track as well as the Publicly_Available_FHIR_Servers_for_testing. Each of the scenarios are implemented as FHIR TestScript resources that include extensive assertions to provide a more comprehensive validation/verification of the systems under test conformance to the FHIR specification.
- All testing scenarios are performed by choosing FHIR TestScript resources that use:
- (a) XML or JSON
- (b) client or server assigned resource IDs
1. Patient Registration/Creation
- FHIR Server (NOTE: Skip to the 99. test below to complete testing with a single TestScript)
- Action: Use testing tool to create a new patient on the FHIR server
- Precondition: TestScript will first delete the patient if it exists
- Success Criteria: Testing tool passes all assertions and validations which include (a) HTTP status returned is 201 (Created), (b) returned format matches sent format, (c) patient can be retrieved and HTTP status 200 (OK) is returned, (d) retrieved patient format matches sent format and (e) conforms to base FHIR Patient profile.
- FHIR Client
- Action: FHIR client creates a new patient and saves to FHIR server. A testing tool is used as a proxy in order to validate that the transaction is processed correctly.
- Precondition: Patient does not exist in FHIR server prior to action
- Success Criteria: Testing tool passes all assertions and validations
2. Patient Modification/Update
- FHIR Server
- Action: Use testing tool to update an existing patient on the FHIR server with a new birth date
- Precondition: TestScript will first delete the patient if it exists and create a new patient resource to update
- Success Criteria: Testing tool passes all assertions and validations which include (a) HTTP status returned is 200 (OK), (b) HTTP Header Content-Type is returned with correct value, (c) updated patient can be retrieved and HTTP status 200 (OK) is returned, (d) retrieved patient conforms to base FHIR Patient profile.
- FHIR Client
- (Steps go here)
3. Patient Read
- FHIR Server
- Action: Use testing tool to retrieve a patient from the FHIR server
- Precondition: TestScript will first delete the patient if it exists and create a new patient resource to retrieve
- Success Criteria: Testing tool passes all assertions and validations which include (a) HTTP status returned is 200 (OK), (b) HTTP Header Content-Type is returned with correct value, (c) retrieved patient conforms to base FHIR Patient profile
- FHIR Client
- (Steps go here)
4. Patient History
- FHIR Server
- Action: Use testing tool to retrieve patient history from the FHIR server
- Precondition: TestScript will first delete the patient if it exists and create a new patient resource and update it with a 2nd revision to be retrieved
- Success Criteria: Testing tool passes all assertions and validations which include (a) HTTP status returned is 200 (OK), (b) HTTP Header Content-Type is returned with correct value, (c) returned resource type is Bundle, (d) the returned Bundle conforms to the base FHIR Bundle profile, (e) the Bundle type is history, (f) the Bundle contains at least 2 entries and (g) the Bundle total value matches the number of entries.
- FHIR Client
- (Steps go here)
5. Patient Version Read
- FHIR Server
- Action: Use testing tool to retrieve specific patient versions from the FHIR server
- Precondition: TestScript will first delete the patient if it exists and create a new patient resource and update it with a 2nd revision to be retrieved
- Success Criteria: Testing tool passes all assertions and validations for both versions of the patient which include (a) HTTP status returned is 200 (OK), (b) HTTP Header Content-Type is returned with correct value, (c) returned resource conforms to base FHIR Patient profile.
- FHIR Client
- (Steps go here)
6. Patient Searching via Multiple Criteria
- FHIR Server
- Action: Use testing tool to search for patient on the FHIR server
- Precondition: TestScript will first delete the patient if it exists and create a new patient resource to search for by identifier, given and family name
- Success Criteria: Testing tool passes all assertions and validations which include (a) HTTP status returned is 200 (OK), (b) HTTP Header Content-Type is returned with correct value, (c) returned resource type is Bundle, (d) the returned Bundle conforms to the base FHIR Bundle profile, (e) the Bundle type is searchset, and (f) the Bundle total value matches the number of entries.
- FHIR Client
- (Steps go here)
7. Patient Deletion/Removal
- FHIR Server
- Action: Use testing tool to delete patient on the FHIR server
- Precondition: TestScript will first delete the patient if it exists and create a new patient resource to be deleted
- Success Criteria: Testing tool passes all assertions and validations which include (a) HTTP status returned is 204 (No Content), (b) after attempting to read patient an HTTP status 410 (Gone) is returned, and (c) after attempting to search patient an HTTP status 200 (OK) is returned, the HTTP Content-Type is returned with the correct value, returned resource type is Bundle, and the returned Bundle contains no entries.
- FHIR Client
- (Steps go here)
99. All Patient Operations Defined Above
- FHIR Server (use this TestScript to perform all steps at once)
- Action: Use testing tool to perform all of the steps listed above on the FHIR server
- Precondition: TestScript will first delete the patient if it exists
- Success Criteria: Testing tool passes all assertions and validations which include those for each of the steps listed above
- FHIR Client
- (Steps go here)
Help Links
Here are some links to assist implementers:
- REST API in the Specification.
- Patient resource in the Specification.
- Open_Source_FHIR_implementations.
- Publicly Available FHIR Servers for testing.
- Step by step tutorial and sample projects.
TestScript(s)
The supporting TestScripts and corresponding fixtures will be committed to the FHIR SVN.