- EDIT
- 11. External LTI (Learning Tools Interoperability) exercises and services
- 11.4 MATLAB Grader exercises
MATLAB Grader exercises¶
This documentation explains how to create a new exercise with the proprietary MATLAB Grader service. MATLAB Grader is developed by MathWorks and it is connected to learning management systems via the standard LTI protocol, version 1.1.
MATLAB Grader¶
One may log in directly to the MATLAB Grader at https://grader.mathworks.com/ using a MathWorks account. It is possible to host MATLAB courses there without using any LMS, but this documentation is about using it with A+. Nonetheless, teachers may create MATLAB problems in the MATLAB grader before using any LMS. When the problems are stored in a collection in the MATLAB Grader, the teacher may just copy those existing exercises when integrating the A+ LMS to the MATLAB Grader. By doing that, the teacher could first concentrate on creating the exercises and only afterwards integrate them into A+. The teacher may also use the exercises in other LTI-compatible learning management systems when they are created in MATLAB Grader collections.
Study the official MATLAB Grader help documentation to learn more of its features.
Launching a MATLAB Grader exercise from A+¶
In the A+ course, you may add new LTI exercises manually or the configurations may be imported from the MOOC grader (see previous chapters). The following describes how to add them manually under the "edit course" menu.
Add a new learning object
Choose 'LTI Exercise'
Enter the exercise settings and select 'MATLAB Grader' (https://lms-grader.mathworks.com/launch) as the LTI Service. LTI-specific settings "context id", "resource link id", "resource link title", and "service url" can be left empty in order to use the defaults.
Launch the exercise
When a teacher launches the exercise for the first time, it initializes the exercise editor in the MATLAB grader. The teacher may create a new problem or copy an existing problem from the A+ course or a MATLAB Grader collection (exercises created directly in the MATLAB Grader site without A+). In order to copy an exercise from a collection, it is necessary to link to the MathWorks account (the link for doing that should be at the bottom of the 'Add problem' page when launching the MATLAB Grader from A+). The MATLAB Grader exercise must be saved as final in order to open it to students. Exercises in the draft mode are not available to students.
Creating MATLAB Grader exercises¶
The official MATLAB Grader help documentation provides more details about creating exercises, but this section gives a brief summary.
Defining the exercise parameters in MATLAB grader¶
The MATLAB grader provides an easy-to-use user interface for teachers to develop exercises. In the MATLAB grader, there are multiple fields to define for the exercise:
Title
Problem Description and Instructions
Files Referenced
Problem Type (script or function)
Code (Reference Solution and Learner Template)
Assessment
More help is available by clicking ?
icon next to each field name.
Next, set up required values.
In Learner template, it is possible to lock some rows (click the lock icon). It is helpful when there should be some rows that are not allowed to be edited by the student.
Setting up the assessment¶
Assessment can be executed with four different type:
Variable Equals Reference Solution (compares a certain variable to the same variable in the reference solution)
Function or Keyword is Present (for example, the student's code should have an if-statement)
Function or Keyword is Absent (for example, the student's code should not have a for-loop)
MATLAB code (Assessment system includes three built-in functions to check if answer is correct (assessVariableEqual, assessFunctionPresence, assessFunctionAbsence)).
Examples of these methods can be found in the 'Examples' section below.
Use 'Validate Reference Solution' to check that the reference code and assessments are really working.
The image shows an example of assessment written in MATLAB code for a function type exercise.
The student's function is called newton
and it is called one hundred times with random input parameters.
The return value is compared to the return value of the reference solution.
Examples¶
Some examples of different exercise types:
Example of function: https://plus.cs.hut.fi/test/matlab-test/round1/newtonA/
Example of script working with function given as a file: https://plus.cs.hut.fi/test/matlab-test/round1/newtonB/
Example of script to handle images: https://plus.cs.hut.fi/test/matlab-test/round1/kuvankasittely/
Notes¶
There are currently some issues with grader.
LaTeX doesn't support
\matrix
, but matrices can be inserted to the problem description using the LaTeX editor like this:mat=\left\lbrack \begin{array}{cc} 1 & 2\\ 3 & 4\\ 5 & 6 \end{array}\right\rbrack
The matrix above is rendered like this:
\[\begin{split}mat=\left\lbrack \begin{array}{cc} 1 & 2\\ 3 & 4\\ 5 & 6 \end{array}\right\rbrack\end{split}\]Syntax check in the beginning of assessment would be nice. Now syntax errors trigger the first assessment defined by the teacher, which is a little misleading since the syntax error in the submission probably has nothing to do with the first assessment test.