Date & Time: Wednesday, 23 February 2022 from 4.00 – 5.00 p.m.

Conductors: Mr. Anawach Jatuprayoon, General Manager of SOFTEVER Co.,LTD.

The Strategy and Academic Development Section under the OAA and the EdTech Unit organized its 5th workshop of academic year 2021-2022, entitled ‘Information Session on Testimate’. The purpose of this workshop was to introduce participants to a new online assessment management system that simulates physical exams using cloud-based technology, together with online customized- tools to create a stable and secure environment for exam takers, and help teachers operate and administer the exam smoothly and successfully.

Testimate is a full-fledged platform developed to support remote exam. Its features cover three areas: exam creation, proctoring, and scoring report. Its exam features support various types of questions-making, ranging from simple to complex. The teachers are provided with options to use questions of single choice, multiple choice, multiple choice reason, matrix table, complex multiple choice, short answer, subjective, etc. The product comes with a question bank, where you can easily import and store questions, and reuse the same set of questions for other exams. Apart from basic functions, Testimate’s useful features include separating the exam room with different URl, restricting the exam-room access to certain people, and providing a different test suite for each individual (i.e. random exam selection, random question, random choice).

Testimate supports a number of smart devices, whether on Android or IOS. Exam takers can check their exam progress, and go back and forth between questions. To take an exam, students get access to the test suite via the provided URL. An embedded calculator is also provided within the product, availability depends on setting. 

When it comes to ‘proctoring’, this platform offers flexibility as much as its exam-making functions. Testimate provides facility to capture pictures of remote exam takers using student’s live webcam feed, which helps to identify if a student is appearing for the exam without any external help. It also identifies the exam takers’ location (longitude, latitude), and IP address, to inform the proctor where they actually are. The system works as a tracking tool for each individual, and displays their status in real-time on the proctoring dashboard. All progress data is also shown in infographic/table/picture format. In addition, the scoring system works immediately after each question has been answered. The system also comes with a prevent-cheating function which allows the proctor to check a student’s activity log, get an instant alert and flag when they do something that is not allowed in the exam i.e. switch screen to YouTube or other prohibited application. 

 The system allows to set the criteria (range of number that presents the level of achievement students had performed) to be used for report results. Scoring can be done automatically or manually. The answers can be exported individually or in a big chunk, together with attached files and timestamps. When analyzing the exam, the system creates two reports; audit trail and custom report. First report uses data collection from demographic and personal behavior, while the later collects data from individual and subject results to generate an analysis.

Audit trail report comprises demographics and behavior data. Meaning that besides general information of test takers such as id, name, last name, photo, date of birth, gender, department, exam room, ip address, physical location, etc, the system will document the students’ start/submit time, time-spent on each question, answer pattern/order, and answer changing record, and activity log that examine their behavior during the exam such as mouse clicking, keyboard typing through screen capture function, including recognize any device connected i.e. keyboard, mouse, and usb drive.

Custom report involves collecting data from exams and question results. The system looks into individual and class performance in each exam in regards to total score, average/minimum/maximum score, question types, answering time-spent, percentage of student answered correctly/wrongly, to detect relationship between group or a correlation between variables.

The platform is operated under Thailand’s Personal Data Protection Act (PDPA), which is predominantly based on GDPR of the European Union, and certified by Privacy Information Management Systems ISO/IEC 27701. Personal data of exam takers including name-surname, IP address, location: latitude and longitude, activity log, exam taker’s image, screen, exam answer, and score for each exam, are encrypted and stored securely, and allowed accessibility only to authorized person (teacher) and Testimate’s analyzing system.