4. Submitter workflow

4.1. Submitter dashboard

The Submitter Dashboard provides access to files that the Submitter has recently worked on, or that have upcoming deadlines for action, along with a summary of their status.

Screenshot of Submitter Dashboard

Fig. 4.1 Submitter Dashboard

4.2. Uploading files

Files must adhere to the correct format and file naming convention to be successfully uploaded.

Files are automatically checked for record integrity validation and consistency validations as they are uploaded.

After the file is uploaded and the validation process is complete, an email is sent to the Submitter informing them of the file’s status and providing a link to the online validation reports.

Screenshot of Uploads page

Fig. 4.2 Uploads page

Screenshot of File upload page

Fig. 4.3 Upload a new file page

4.2.1. File format

Files are uploaded in .DAT format. Files can also be uploaded in .ZIP format, however these files can not be password protected. The upload link is encrypted, protecting information in the file throughout the submission process.

4.2.2. Data file naming convention

The data file must have a formal name consistent with the format of Tsssyyyybbbbb.DAT. Note that the filename is case sensitive. The T, sss, yyyy, and bbbbb components are defined as:

T - File type (CMHC, MHE, NOCC, RMHC, or SKL)

sss - Jurisdiction code (ACT, NSW, NTE, QLD, SAU, TAS, VIC, or WAU)

yyyy - Year of the end of the financial year for the batch submission

bbbbb - Yearly incremental batch number (leading zeros present) indicating the sequence number of the submission. Note that successive quarterly files and any resubmitted files must have a batch number greater than all preceding files for that year.

Example

Suppose that the ACT submitted quarterly data files to AMHOCN in respect of the 2020-21 financial year, then submitted a final submission; their first NOCC data file would be named NOCCACT2021000001.DAT, whilst the second would be named NOCCACT202100002.DAT, and so on. If no resubmissions were made the final submission for that year would be named NOCCACT202100005.DAT. If that file then had to be resubmitted for some reason, then it would be named NOCCACT202100006.DAT. Their first submission for the 2021-22 financial year would then be named NOCCACT202200001.DAT.

4.3. Pre-proposal review

Submitters can access detailed reports on the validity of their submissions before proposing the files for review.

During this stage, Submitters can:

The Online Validator provides two types of validation: record integrity validation and consistency validation. Record integrity validation issues may prevent a file from being proposed; please see Record integrity report for more information.

Screenshot of File Details page pre-submission

Fig. 4.4 File details page; pre-submission

4.3.1. File cannot be proposed for review?

If Structural errors are present, the Submitter must replace the file with a corrected version. Structural validations ensure:

  • that records have the correct number of fields, as well as valid data within those fields.

  • that records specify valid hierarchical entities. For example, an organisation with a region specifies a valid corresponding region record.

  • that organisations have valid identifiers.

The Record Integrity Summary Table and Line Status report indicates if there are Malformed, Barren, Duplicate, Orphaned or Miscoded error types.

4.3.2. File cannot be deleted?

The most common reasons you will be unable to delete a file are:

  • File has already been deleted (refresh your page to ensure you are seeing the most recent information)

  • File is still validating

  • File has already been proposed for review (you will need to follow the instructions in propose a replacement file instead)

  • File has been proposed as a replacement (will need to wait on file to be accepted or reject for review)

  • Filename has been used as part of a submission at any time

4.3.3. Sharing

A Submitter may choose to share access to an uploaded file, that they own, with other users at any time. Recipients of shared files must be registered in the system, and be either from the Submitter’s jurisdiction or from the Commonwealth (DoH or AIHW). Sharing options are accessed via the File Details page.

Screenshot of File Details page share

Fig. 4.5 File details page; share

4.3.4. Post-validation

At this stage, the Submitter can either:

  • leave the upload in the private workspace (which may contain multiple files);

  • delete the upload, completely removing it from the system; or

  • propose the file for review.

When a file is proposed for review, the relevant Acceptors and Reviewers are notified, and the file cannot be deleted.

4.4. Proposing a file for review

The proposal of files for review is analogous to posting a physical file; it is a formal activity that can only be undone with assistance from the intended recipient.

After a file is proposed for review, it can automatically be viewed by other jurisdictional users with access to the same dataset. Users with identical access privileges as the file’s Submitter can comment, delete and propose new files for review.

Reviewers are notified of file submissions via email. Reviewers will then undertake a ‘pre-acceptance review’.

Screenshot of File details page

Fig. 4.6 File details page

4.5. Pre-acceptance checks by Reviewer/Acceptor

Once a file is proposed for review, Reviewers and Acceptors conduct pre-acceptance checks. These checks aim to ensure the supplied information doesn’t contain obvious and significant errors that necessitate a re-submission of the file. Examples of these errors include:

  • Incorrect number of variables

  • Mismatch between data and variable types

  • Incorrect formatting of date fields

  • Incomplete information

  • Duplication of key fields

  • Missing link(s) to parent records

During this phase, the Submitter can:

  • View file contents and check validation issues;

  • View resolution codes previously assigned to individual issues.

Files with the status of Proposed for Review are effectively in control of the Reviewer(s), and can not be un-proposed by the Submitter. If the Submitter needs to replace the file, they must contact the Reviewer(s), advising them to cease work on the file, and request that the Reviewer rejects the file.

4.6. Accepted for review

If the file is accepted, submitters are notified via email. Control over issue resolution coding transfers to the Submitter, and the Review process is started.

4.7. Rejected for review

When a file is rejected by the Acceptor the Submitter will be notified and must follow the steps outlined in this document to upload a replacement file.

If a file is rejected, control reverts to the Submitter, who is notified that a new file upload is required. Rejection of a file recommences the submission process. Submitters are unable to upload a file that has previously been proposed for review.

4.8. Replacing a file

Submitters may propose a replacement for a file that was previously proposed for review and either accepted or rejected, if it becomes apparent that updated information should be supplied.

When a replacement submission is accepted, all matching issue resolution statuses and comments are copied to the new submission, preserving the information pertaining to each generation of files.

If a replacement submission is rejected, the proposal review process will revert back to the file with the highest batch number that has already been accepted.

The replacement file must meet the following criteria:

  • Successfully uploaded and validated

  • Batch number must be higher than the current proposed file

  • No other file can be pending as a replacement. If you have already proposed a file, you will need to have it accepted or rejected before you can propose another.


Step 1 - Successfully upload and validate your replacement file

Screenshot of File upload page

Fig. 4.7 Submission Workspace - Upload Files


Step 2 - On the replacement files Details page click Propose for review button

Screenshot of File details page

Fig. 4.8 Submission Workspace - File Details


Step 3 - Reviewers have now been notified of the proposed replacement file.

Screenshot of File Details - File under review

Fig. 4.9 File Details - File under review

4.9. Review and issue resolution for Submitters

The purpose of the Review is to identify, and explain or rectify inconsistent, anomalous and exceptional issues. During this process the Submitter and Reviewer may assign control over the list of issues to each other as many times as necessary. Assigning control in this manner prevents the Reviewer and Submitter from having write access simultaneously, maintaining the integrity of notes throughout the issue resolution process.

During this phase, the Submitter can:

  • View file contents and check validation issues

  • Map entity changes across time (SKL files only)

  • View resolution codes and comments assigned to individual issues

  • If the Submitter has control they can also:

    • assign issue resolution codes and / or comments to individual issues;

    • assign control of the issue resolution log to the Reviewer; and

    • propose a replacement for the file under review.

4.9.1. Issue resolution list (Submitters)

The Issue resolution list identifies and explains all inconsistent, anomalous and exceptional issues.

Screenshot of Issue resolution list

Fig. 4.10 Issue resolution list

Clicking on an issue brings up the Issue details modal, via which Submitters assign control over issues to the Reviewer, and vice versa, as many times as necessary. Assigning control in this manner prevents the Reviewer and Submitter from having write access simultaneously, maintaining the integrity of notes throughout the issue resolution process.

Screenshot of Issue details modal

Fig. 4.11 Issue details modal

4.10. Entity mapping tool - SKL only

The Entity Mapping Tool enables entities to be mapped across time in the SKL files. This in turn enables the Online Validator to suppress ‘child’ issues that are caused by entity changes. For example, a change to an organisation’s name and ID will generate an issue for that change, and for each of that organisation’s ‘children’, whose parent ID has now also changed. Mapping the organisation to its historical name and ID will then suppress the issues against the organisation’s children.

4.10.1. Using the entity mapping tool

1. Select Entity Mapping report for the relevant SKL file:

Screenshot of Submissions Workspace Details page

Fig. 4.12 Submissions Workspace File Details page

2. Select entities that map directly across the submission years (currently, only 1:1 mappings are possible). Click Connect two entities:

Screenshot of Submissions Workspace Entity Mapping for Org Record Type

Fig. 4.13 Submissions Workspace Entity Mapping for Org Record Type

3. The display will indicate that the entities have been mapped, and provide the option to Unmap the entities:

Screenshot of Submissions Workspace Entity Mapping 'Unmap' button

Fig. 4.14 Submissions Workspace Entity Mapping ‘Unmap’ button

4. Continue connecting entities. Note that in the screenshot below the number of unmapped AMBU entities is now 1, rather than 3:

Screenshot of Submissions Workspace Entity Mapping Summary of Record Types Mapped

Fig. 4.15 Submissions Workspace Entity Mapping Summary of Record Types Mapped

5. The HOSP display shows that some entities have been auto-mapped when ORG entities were manually mapped:

Screenshot of Submissions Workspace Entity Mapping Auto-mapped entities

Fig. 4.16 Submissions Workspace Entity Mapping Auto-mapped entities

4.11. Completion of the submission process

The submission process is considered complete when all issues have been corrected and/or clarified, and comments and proposed resolutions against each issue are accepted. At this stage, data is marked by an Acceptor as Finalised and is regarded as being suitable for reporting. The data can be manually or automatically transferred to an external data warehouse or reporting system.

Acceptors are able to Finalise a submission at any point after accepting a file for review. Generally, any issues requiring resolution are addressed first, as once finalised, no further file versions will be accepted as replacements, and issue resolution is locked.

If required, a finalised submission can be re-opened by an Acceptor, allowing for issues to be edited again, and replacement files can be proposed.

4.11.1. File revalidation

Generally results remain static when a file has been uploaded and validated, however an exception to this is when ALL of the following occur in relation to a file:

  • the MDS Rules for the file type use historical data;

  • a historical file was not found at the time of the original upload; and

  • a historical file was uploaded at a later date.

In those circumstances, a facility exists to revalidate the file.

Users will see a warning explaining that historical checks have not yet been performed, and a button will be present offering revalidation now.

4.11.1.1. Revalidation after software updates

Software updates may also necessitate revalidation. These are usually performed as part of the upgrade, however they can be manually initiated by administrative staff.