Combined Assessment Reports

  1. A Summary report and Full Assessment report are generated for every completed learning package review. These reports are made available to reviewers in their respective dashboards under Combined Reviews -> Summaries.
  2. The Combined Assessment Summary Report displays the results of the Combined Assessment and includes the learning package details, the awarded badges for each domain and the overall badge awarded to the course. A Full Report contains the detailed set of scores at the success indicator level.
  3. Reports are emailed to the Course Submitter via the TELAS email notification system.
  4. Reports are not generated when the Reviewers are unable to agree on one or more scores during a Combined Assessment.  In this case, the course assessment is referred to the TELAS Administrator and to a third reviewer for completion.
  5. If a learning package fails to meet the minimum score for badge eligibility or the institution wants to gain a badge at a higher level, the institution can consider the feedback and resubmit within eight weeks to enact a condensed TELAS accreditation re-review.
  6. Where applicable, the TELAS Administrator issues a Course Accreditation Certificate and badge to the institution via the Course Submitter.

Using a Course Assessment Form

  1. The assessment form is divided into separate pages to make the screen layout of forms more user friendly. View this diagram for a description of the different elements in the assessment form layout.
  2. Assessment forms contain the following hierarchy of elements:
    Standards: There are 8 standards in the form – two for each of the four domains.
    Performance Criteria: Each standard contains a number of performance criteria.
    Success indicators: Each performance criteria contains a number of success indicators.
    Measure of Performance: the individual score for each success indicator.
    Overall Score: the summary score for each performance criteria.
    Comments: available at the end of each standard.
  3. When you open an assessment form, you will find a Course Details Summary panel displayed at the top of the page displaying critical information about the course.
  4. As you can see from the diagram, each page on the assessment form displays several Performance Criteria. The Success Indicators for each Performance Criteria are displayed by selecting the dropdown arrow visible on the left of each Performance Criteria.
  5. You score each Success Indicator by selecting one of four choices – Yes, Yes But, No But or No. Selected scores are colour coded when clicked.
  6. You must also select the Overall Score for each Performance Criteria. The Overall Score is a “summary” score you assign to each Performance Criteria and its Success Indicators. For example, if you selected Yes, Yes and No for three Success Indicators, you could assign a Yes But score to the Overall Score.
  7. Admin Reviewer scores are displayed in dark grey to differentiate them from your own scores which are marked in blue. You cannot edit the Admin Reviewer’s individual scores but you are responsible for assessing the Overall Scores for those Performance Criteria scored by the Admin Reviewer.
  8. The Form has a progress bar to indicate which standard you have completed. 
  9. If the assessment displays less than 100% at the end of your assessment, visible on the standards row above the assessment, it means you have missed one or more scores.  Missed scores are identified by the X symbol in a circle on the the standards row.   Select that Standard with the X and then drill-down to identify the performance criteria that has not been scored, which is also displayed with an X next to the criteria description. 
  10. A comment field is available at the end of each standard in the form.  A prefix user type identifier is automatically added to each comment once the assessment is saved, i.e. [Admin-Reviewer], [First Reviewer] or [Second Reviewer].  Names are not added, only the reviewer type.  Reviewers should include a ref number as to which success indicator their comment applies.
  11. Navigation buttons are displayed at the bottom of each page, including Back and Next.   Once Standard 8 is displayed, you will see Save and Mark Complete.  To cancel an assessment, simply exit the page without saving in which case all input will be lost.
  12. Assessments can be saved at any point and you are able to return later to complete the assessment.  Once complete, the reviewer must select Mark Complete.

Certified Reviewer Emails

  1. Certain actions by users in TELAS trigger auto generated emails to users.   Many of these emails contain details of assigned courses and instructions.
  2. As a Certified Reviewer, you can expect to receive the following emails:
    • An email to confirm your registration.
    • An email whenever you are assigned a course to assess.
    • If you are the First Reviewer, you will receive an email asking you to contact the Second Reviewer to arrange an online meeting to conduct a Combined Review. If you are the Second Reviewer, you will be contacted by the First Reviewer once you have completed your individual assessment.
  3. Emails are sent to the email you submitted in your User Profile. 
  4. All emails to users are sent from admin@telas.edu.au and subject lines are preceded by the word [TELAS].

How to conduct a Combined Assessment

The Combined Assessment is undertaken by both the First and Second Reviewer in an online meeting or face-to-face. In most cases, these meetings will be conducted online using separate workstations with both reviewers logged in to TELAS. As the lead reviewer, the First Reviewer is responsible for entering scores for the Combined Assessment in consultation with the Second Reviewer during the online meeting.

  1. First Reviewer role:  From your dashboard, select Combined Reviews -> Assigned -> Course Title -> Combined Assessment.  This view allows you to enter new scores agreed to by you and your second reviewer during your meeting.
  2. Second Reviewer role: From your dashboard, select Combined Reviews -> Comparative -> Course Title -> Comparative Assessment.   This view displays both the First and Second Reviewer individual scores side by side for comparison and reference purposes. It is only displayed in user dashboards after the First and Second Reviewers have both completed their individual assessments.
  3. Self-Assessment results: You will be emailed a copy of the institution’s Self-Assessment results for the course and which you both should compare to your own results. You are asked to comment on any significant difference between your individual assessments and the results of the institution’s assessment. Note that the institution’s self-assessment will have been conducted using a hard copy of the TELAS Framework.
  4. Suggested workflow: Although both reviewers have access to the Comparative Assessment, it may be more convenient for the Second Reviewer to view the Comparative Assessment while the First Reviewer views and enters the new scores in the Combined Assessment. Using this approach, the Second Reviewer can identify and flag differences in their respective scores, discuss these with the First Reviewer and agree on the Combined Assessment score – which the First Reviewer then inputs in the Combined Assessment form.
  5. Closing an assessment: Once Standard 8 is displayed in the combined assessment form, you will see three options – Pending, Save and Mark Complete. Save is selected if the assessment is incomplete and a subsequent meeting is required to continue with the assessment. Mark Complete generates the Combined Assessment Summary Report showing the level of eligibility for course accreditation and indicates you have finished the assessment. Pending is selected in the event that the First and Second Reviewers fail to agree on one or more success indicators. View a sample of the report here.
  6. Pending assessments: The course assessment Pending option is selected when the assessment is intentionally incomplete and must be referred to the TELAS Administrator because the First and Second Reviewers have failed to agree on the scores for one or more success indicators. If this happens, the First Reviewer must do three things prior to saving the assessment:
    – Select Unmark for any success indicators that are in question.
    – Add a comment below the relevant Performance Criteria describing your different positions as reviewers regarding those indicator(s) in question.
    – Select Pending to save and close the assessment which will then be referred to a third reviewer to score the blank Success Indicator(s) by taking into consideration the First and Second Reviewers individual assessments and comments.
  7. Summary Reports: Once a Combined Assessment is completed and saved, the First and Second Reviewers will find a Combined Assessment Summary Report in their respective dashboards under Combined Reviews -> Comparative -> Course Title -> Summaries. The Summary Report is also emailed to the institution’s Course Submitter and this report signals the end of the course assessment process, with the exception of the TELAS Administrator issuing a Course Accreditation Certificate.

Using an individual Assessment Form

  1. The assessment form is divided into separate pages to make the screen layout of forms more user friendly. View this diagram for a description of the different elements in the assessment form layout.
  2. Assessment forms contain the following hierarchy of elements:
    Standards: There are 8 standards in the form – two for each of the four domains.
    Performance Criteria: Each standard contains a number of performance criteria.
    Success indicators: Each performance criteria contains a number of success indicators.
    Measure of Performance: the score for each success indicator.
    Overall Score: the overall score for each performance criteria.
    Comments: available at the end of each standard.
  3. When you open an assessment form, you will find a Course Details Summary panel displayed at the top of the page displaying critical information about the course.
  4. As you can see from the diagram, each page on the assessment form displays several Performance Criteria. The Success Indicators for each Performance Criteria are displayed by selecting the dropdown arrow visible on the left of each Performance Criteria.
  5. You score each Success Indicator by selecting one of four choices – Yes, Yes But, No But or No. Selected scores are colour coded when clicked.
  6. You must also select the Overall Score for each Performance Criteria. The Overall Score is a summary score you assign to each Performance Criteria and its Success Indicators. For example, if you selected Yes, Yes But and Yes for the three Success Indicators, you may wish to assign Yes But or Yes to the Overall Score whereas if you selected Yes But, No and No But for the three Success Indicators, you may wish to assign No or No But to the Overall Score.
  7. Admin Reviewer scores are displayed in dark grey to differentiate them from your own scores which are marked in blue. You cannot edit the Admin Reviewer’s individual scores but you are responsible for assessing the Overall Scores for all Performance Criteria in the assessment. Admin Reviewers cannot select Overall Scores.
  8. The Form has a progress bar above the Standards row to indicate which standard you have completed and how far you have progressed in the assessment.
  9. The Standards row also displays the percentage completed on the far right. If the % indicated is less than 100% at the end of your assessment, it means you have missed one or more scores somewhere in your assessment. Missed scores are identified by clicking each of the Standards on the Standards row until you locate an underlined Performance Criteria description. Dropdown the underlined Performance Criteria and you will see which Success Indicators have not been marked. Mark these and you should then see 100% displayed on the Standards row with a Mark Complete button available below your assessment.
  10. A comment field is available at the end of each standard in the form.  A prefix user type identifier is automatically added to each comment once the assessment is saved, i.e. [Admin-Reviewer], [First Reviewer] or [Second Reviewer]. Do not add your name to any comment but do include a reference number as to which success indicator your comment applies.
  11. Assessments can be saved at any point and you are able to return later to complete the assessment.  Once complete, you must select Mark Complete.

Certified Reviewer Dashboard

  1. As a Certified Reviewer, you have access to a user dashboard that lists any and all courses they have been assigned to you along with the status of each course assessment.
  2. Your user dashboard is only populated when a course assessment has been assigned to you.
  3. Your individual course assessments are accessed from the Assessments tab in the sidebar under either Assigned, In-Progress or Completed depending on the stage you are at in the assessment.
  4. New courses that have been assigned to you are accessed from the sidebar under Assessments -> Assigned.
  5. Course assessments that you have partially completed are accessed from the sidebar under Assessments -> In-Progress.
  6. Course Assessments that you have completed are accessed from the sidebar under Assessments -> Completed.
  7. The Combined Review tab has six tabs:
    Assigned, In-Progress and Completed tabs that reflect the status of each Combined Assessment.
    Comparative tab that displays the First and Second Reviewer course assessment scores side by side. This view is referred to during a Combined Assessment to compare the two reviewer scores. It is only made available once the First and Second Reviewers have both completed their respective assessments.
    Summaries tab displays Combined Assessment Summary Reports with eligible badges.
    Accredited tab displays a list of the courses that you have assessed and which have been accredited.

Certified Reviewer Workflow

  1. Certified Reviewers are assigned learning packages to review by the TELAS Administrator.
  2. Before commencing an assessment, you will need to enroll in the course and verify that you have access to the learning package. The guest login details for the course will be included in the email that you receive which assigns you the course.
  3. The TELAS Administrator will assign courses to you by email as either a First Reviewer or Second Reviewer and you are asked to complete any assigned reviews within a reasonable time frame.
  4. If you are unable to review an assigned learning package you should reply to the administrator as soon as possible so that an alternative reviewer may be assigned.
  5. You are deemed to have accepted an assignment unless you reply to your notification email and inform the TELAS Administrator that you are unable to accept the assignment. 
  6. An Admin Review will be completed prior to the learning package being assigned to a Certified Reviewer. You cannot edit the success indicators of a course reviewed by the Admin Reviewer. However, you are expected to select an Overall score for all Performance Criteria in the assessment.
  7. Your completed assessment reports are displayed in your user dashboard where they are available for printing.
  8. Certified Reviewers complete individual assessments of the learning package and then undertake a Combined Assessment of the learning package.
  9. The First Reviewer is designated as the lead reviewer with responsibility for ensuring all of the designated review tasks are completed.
  10. If you are the First Reviewer, you will be provided with the contact details of the Second Reviewer once you have both completed your individual assessments.

Interim Reviewer Guidelines

Interim Reviewer requirements

As an Interim Reviewer your are required to complete several test assessments to a satisfactory standard before the TELAS Administrator can change your user role to that of a Certified Reviewer.

Guidelines for conducting Test Assessments

  1. When you have been approved as an Interim Reviewer, you may login to complete the test assessments which you will find in your user dashboard.  
  2. As an Interim Reviewer you are assigned course reviews by the TELAS Administrator by email with the expectation that you will be able to complete the assigned reviews as soon as possible. 
  3. Please contact the TELAS Administrator if you are unable to complete the assignments in a reasonable time frame.
  4. You are deemed to have accepted an assignment unless you reply to your notification email and inform the TELAS Administrator that you are unable to accept the assignment.
  5. The TELAS system records the assigned and completed dates for all assessments.
  6. Admin reviews are always completed prior to you assessing the two courses assigned to you. You cannot edit those components of a course that have been assessed by the Admin Reviewer.  However, you will be required to select the summary totals for each standard in the assessment.
  7. Your completed test assessments are displayed in your user dashboard.
  8. Once your reviews are complete, they will be evaluated by TELAS and if you have achieved an adequate score, the TELAS Administrator will be notified and your role will be changed from Interim Reviewer to Certified Reviewer. 
  9. You will be notified by email of the results of your assessments and the change in role to Certified Reviewer.
  10. Before commencing an assessment, you will need to enroll in the course and verify that you have access to the learning package. The guest login details for the course will be included in the email that you receive which assigns you the course.

How your status as an Interim Reviewer is changed to a Certified Reviewer

  1. You will receive an email notification once you have completed your test assessments and been approved as a Certified Reviewer.
  2. Once your TELAS role has changed to Certified Reviewer, your next login will direct you to a Certified Reviewer’s dashboard which has additional tabs that were not available to you as an Interim Reviewer.  At that point you may refer to the Help section for details on how to proceed as a Certified Reviewer.

Your user dashboard

  1. Once you are registered as an Interim Reviewer, you will have access to a user dashboard that lists any and all courses they have been assigned to you.
  2. Your user dashboard is only populated when a course assessment has been commenced.
  3. Courses that have been assigned to you will be listed in the assigned tab. If you partially complete an assessment and save it, you will find it later listed under the “in-progress” tab. Assessments that you mark as completed will be displayed under the completed tab.
  4. Dashboard lists are dynamic and change according to the data input by users in their online sessions.

Email notifications

  1. Certain actions by users in TELAS trigger auto generated emails to users.  As an Interim Reviewer, you receive an email confirmation when registering and you can expect to receive an email when a course is assigned to you for assessment. You will also receive an email if and when your roles changes to that of a Certified Reviewer.
  2. Emails are sent to the email address you submitted in your User Profile. 
  3. All emails to users are sent from admin@telas.edu.au and subject lines are preceded by the word [TELAS].

Admin Reviewer Guidelines

The role of an Admin Reviewer is to assess the measures of performance related to the administrative components of a course.  Admin reviews are always completed prior to a course being assigned to an Interim or Certified Reviewer.

  1. Before commencing an assessment, you will need to enroll in the course and verify that you have access to the learning package. The guest login details for the course will be included in the email that you receive which assigns you the course.
  2. As an Admin Reviewer you are assigned course reviews by the TELAS Administrator by email with the expectation that you will be able to complete the assigned review within a reasonable time frame.  Please contact the TELAS Administrator immediately if you are unlikely to be able to do this.
  3. You are deemed to have accepted an assignment unless you reply to your notification email and inform the TELAS Administrator that you are unable to accept the assignment.
  4. Admin reviews are always completed prior to a course being assigned to an Interim or Certified Reviewer.  Once you have completed your review, the TELAS Administrator will assign the course to the next Reviewer.
  5. As an Admin Reviewer, you can assess courses from any institution assigned by the TELAS Administrator.

How to use a course Assessment Form

  1. The assessment form is divided into separate pages to make the screen layout of forms more user friendly. View this diagram for a description of the different elements in the assessment form layout.
  2. Assessment forms contain the following hierarchy of elements:
    Standards: There are 8 standards in the form – two for each of the four domains.
    Performance Criteria: Each standard contains a number of performance criteria.
    Success indicators: Each performance criteria contains a number of success indicators.
    Measure of Performance: the individual score for each success indicator.
    Overall Score: the “summary” score for each performance criteria.
    Comments: available at the end of each standard.
  3. When you open an assessment form, you will find a Course Details Summary panel displayed at the top of the page displaying critical information about the course.
  4. As you can see from the diagram, each page on the assessment form displays several Performance Criteria. The Success Indicators for each Performance Criteria are displayed by selecting the dropdown arrow visible on the left of each Performance Criteria.
  5. You only need to assess those Performance Criteria that are underlined.
  6. You score each Success Indicator by selecting one of four choices – Yes, Yes But, No But or No. Selected scores are colour coded when clicked.
  7. You cannot select the Overall Scores indicated at the end of each Performance Criteria as these will be selected by the First and Second Reviewers when they undertake their reviews of the course after you have finished your part of the assessment.
  8. First and Second Reviewers will see your Success Indicator scores in dark grey to differentiate them from their own scores which are marked in blue.
  9. First and Second Reviewers cannot edit your scores.
  10. The Form has a progress bar to indicate which standard you have completed.
  11. The Standards row also displays the percentage completed on the far right. If the % indicated is less than 100% at the end of your assessment, it means you have missed one or more scores somewhere in your assessment. Missed scores are identified by clicking each of the Standards on the Standards row until you locate an underlined Performance Criteria description. Dropdown the underlined Performance Indicator and you will see which Success Indicators have not been marked. Mark these and you should then see 100% displayed on the Standards row and the Mark Complete button will now be displayed below your assessment.
  12. A comment field is available at the end of each standard in the form. A prefix user type identifier is automatically added to each comment once the assessment is saved, i.e. [Admin-Reviewer], [First Reviewer] or [Second Reviewer]. Names are not added, only the reviewer type. Reviewers should include a ref number as to which success indicator their comment applies.
  13. Navigation buttons are displayed at the bottom of each page, including Previous and Next. Once Standard 8 is displayed, you will see Save and Mark Complete. To cancel an assessment, simply exit the page without saving in which case all input will be lost.
  14. Assessments can be saved at any point and you are able to return later to complete the assessment. Once complete, the reviewer must select Mark Complete.

Your user dashboard

  1. Once you are registered as an Admin Reviewer, you will have access to a user dashboard that lists any and all courses they have been assigned to you.
  2. Your course assessments are displayed in your dashboard as either assigned, in-progress or completed.   If you partially complete an assessment and save it, you will find it later listed under the “in-progress” tab.
  3. Dashboard lists are dynamic and change according to the data input by users in their online sessions.

Email notifications

  1. Certain actions by users in TELAS trigger auto generated emails to users.   As an Admin Reviewer, you receive an email confirmation when registering and you can expect to receive an email when a course is assigned to you for assessment.
  2. Emails are sent to the email address you submitted in your User Profile and the TELAS administrator is copied in on all auto generated emails to users. 
  3. All TELAS emails to users are sent from admin@telas.edu.au and the subject line always contains the word [TELAS] so that you may easily recognise them.

Course Submitter Guidelines

Prior to submitting your learning package for review, you should already have completed the Prerequisites Form and uploaded your completed self-assessment of the learning package and organised student access details (login credentials) for the TELAS reviewers. If you have not done so, please complete these steps at your earliest convenience and then submit the learning package for review.

Completing the Course Submissions Form

  1. Completing a Course Submissions Form indicates you are ready to submit the learning package for review. The informaiton you enter in the form will provide the context for Reviewers during their assessment process.
  2. Once the form has been submitted, the details are automatically linked to course assessment forms for the duration of the assessment workflow and displayed above assessment forms for Reviewers.
  3. Course Submitters cannot submit courses for institutions other than their own.
  4. In the Submit for Accreditation field on the form, please select Formal Review.
  5. You will receive an email with a copy of the course details you submitted and you will also receive copies of the assessment reports once the review is complete.
  6. You will also be emailed a Course Accreditation Certificate if eligible; provided the institution has paid the applicable fee.
  7. When the assessment results are insufficient to achieve TELAS accreditation, your institution may use the assessment reports to re-evaluate and modify elements of the course and resubmit the course at a later date for re-assessment.
  8. The TELAS decision and those of TELAS Certified Reviewers are final regarding the course assessment results.

Your user dashboard

  1. When you login to TELAS, you will have access to a user dashboard. Dashboard lists are dynamic and change according to the data you input.
  2. Your user dashboard will list all the courses you have submitted, including any courses submitted by others at your institution.
  3. Your dashboard will display completed assessment reports for learning packages submitted by your institution.
  4. Your dashboard will allow you to print completed assessment reports.

Email notifications

  1. Certain actions by users in TELAS trigger auto generated emails to users.
  2. Emails are sent to the email address you submitted in your User Profile. 
  3. All emails to users are sent from admin@telas.edu.au and subject lines are preceded by the word [TELAS].