Master Research
Visitor Study Assistant
%E5%8F%AF%E7%B7%A8%E8%BC%AF%EF%BC%BFpc2020-43.png)
Visitor Study Assistant, a tool to help curators explore the visitor experience through blinking and context.
此為碩士論文研究「以眨眼特徵與觀展情境來輔助策展人探索觀眾體驗」的產出作品，是一款透過眨眼資訊與實際影像來幫助策展人深入探索觀眾體驗的工具。
Visitor study can help curators examine the design of the exhibition space, understand the behavior of visitors and enhance curators’ ability. many curators observe visitors’ behavior and attention during the visiting process to understand the details of the visitor's experience. However, the use of observation methods often requires an amount of time and human resources costs, and the information collected is also less objective.
觀眾研究可以幫助策展人檢視展示空間的設計安排是否得當，同時幫助策展人更了解觀眾行為，以作為策展人的經驗提升。因此許多策展人透過觀察，發現觀眾在觀展過程中的行為與專注狀態變化，以了解觀眾的觀展體驗細節。然而觀察法的使用往往需要耗費相當多的時間與人力成本，且搜集的資訊也較缺乏客觀性。
Therefore, we combined JINS MEME glasses and a micro-video recorder to develop a semi-automatic system which called “Visitor Study Assistant” for assisting visitor study.This system can select several special moments based on the blinking features, and curators can use these special moments combine with the visit context from the video clips, to identify the key points in the exhibition process and use the information according to their own needs to conduct interviews with the visitor.
因此本研究結合了JINS MEME 眼鏡與微型錄影器，開發了一款半自動輔助觀眾研究的工具：Visitor Study Assistant (VSA) 。此系統會根據眨眼特徵的變化挑出數個特殊區段，策展人可以搭配情境錄影，有效找出觀展過程的關鍵點，並依照自身需求使用這些資訊。
Expert C01 (Female)
Lecturer & Curator.
Department of Fine Arts, Tunghai University
Experience：11 years
Expert C02 (Male)
Project host.
DENKII Design
Experience：14 years
Expert C03 (Male)
Associate Researcher & Director.
National Museum of Natural Science
Experience：14 years
In addition to the literature review to understand the visitor study in the museum, this study also interviewed three local experts and compiled the interview results as a reference for system development.
以文獻回顧和專家訪談的方式了解觀眾研究。接觸了多位專家後，選擇三位具有博物館（美術館）策展經驗的專家，作為訪談對象。他們分別來自美術、空間設計、博物館背景。
Expert Interview
%E5%8F%AF%E7%B7%A8%E8%BC%AF%EF%BC%BF2020-39.png)
%E5%8F%AF%E7%B7%A8%E8%BC%AF%EF%BC%BF2020-40.png)
%E5%8F%AF%E7%B7%A8%E8%BC%AF%EF%BC%BF2020-41.png)
Pain Point
" It is difficult for museum to send enough researcher to perform visitor study. The reason is that not all researchers in the museum are familiar with visitor study."
「並不是每個執行觀眾研究的人員都有受過相關訓練，所以要派出足夠且可以勝任的人去執行觀眾研究是有難度的。」
Goal
Helping curators or researchers to conduct visitor study more effectively and objectively
改善當前研究人力的挑戰
More Objective
Reduce the subjective judgment errors from researchers.
Multi-disciplinary
More comprehensive conduct visitor research
More Effective
Save time on manpower observations
Visitor Study Assistant
Mini Video
Recorder
Context
JINS MEME
Eye blinking
+
Reseacher
Interview
Semi-automati visitor research
System Development
This study used the SQ11 MINI DV camera and JINS MEME eyewear as the device to record the visitor's visit context. The camera is mounted directly in the center of JINS MEME glasses by clay, to achieve real viewing angle.We use the SDK provided by JINS MEME to develop a mobile application: MEME Record, that records eye movement data. The data captured by JINS MEME glasses will be connected to the MEME Record on the mobile phone via Bluetooth. After the visitor finished their visit, the eye movement data stored in the mobile phone and the video of visit context stored in the micro video recorder are transferred to the same folder in the computer.
這是實驗裝置的佩戴方式。一台微型錄影器和一隻 JINS MEME 眼鏡。微型錄影器被固定在眼鏡中間，以貼近實際的視野。另外，我們透過 JINS MEME 官方提供的SDK，開發了一款叫MEME Record的手機應用程式。它可以透過藍芽連接到JINS MEME眼鏡，然後將眼動資訊儲存在手機裡。之後將手機和錄影機用USB線連接到電腦，就可以把所有的資訊匯入電腦中的分析程式。
SQ11 MINI DV Camera
JINS MEME Eyewear
Weighs : 20 g
Wide angle : 140 degrees
File format : AVI format
Weighs : 36g.
3-Direction accelerometer
3-Gyroscope sensor
(total 6-aixs sensors)
3-point EOG sensor
MEME Record
JINS MEME eyewear data will be import to MEME Record app on the mobile phone via Bluetooth.
%E5%8F%AF%E7%B7%A8%E8%BC%AF%EF%BC%BF2020-45.png)
%E5%8F%AF%E7%B7%A8%E8%BC%AF%EF%BC%BF2020-44.png)
%E5%8F%AF%E7%B7%A8%E8%BC%AF%EF%BC%BF2020-47.png)
%E5%8F%AF%E7%B7%A8%E8%BC%AF%EF%BC%BF2020-34.png)
%E5%8F%AF%E7%B7%A8%E8%BC%AF%EF%BC%BF2020-45.png)
%E5%8F%AF%E7%B7%A8%E8%BC%AF%EF%BC%BF2020-58.png){kind=small}
%E5%8F%AF%E7%B7%A8%E8%BC%AF%EF%BC%BF2020-44.png)
%E5%8F%AF%E7%B7%A8%E8%BC%AF%EF%BC%BF2020-47.png)
%E5%8F%AF%E7%B7%A8%E8%BC%AF%EF%BC%BFpc2020-43.png)
Context Video
Eyemovement Data
MEME Journey Software
Longer line：Stronger blink strength or saccade
Denser lines（red color）：More frequent blinks or saccade
Step 1. Import Data
Step 2. Select the Section
Step 3. Add section and notes
%E5%8F%AF%E7%B7%A8%E8%BC%AF%EF%BC%BFp2020-24.png)
Section
Record
Context Video
Blinking
Strength
Saccade
Range
Time
Line
1
%E5%8F%AF%E7%B7%A8%E8%BC%AF%EF%BC%BFp2020-25.png)
2
%E5%8F%AF%E7%B7%A8%E8%BC%AF%EF%BC%BF2020-51.png)
3
2
1
%E5%8F%AF%E7%B7%A8%E8%BC%AF%EF%BC%BF2020-54.png)
3
4
%E5%8F%AF%E7%B7%A8%E8%BC%AF%EF%BC%BF2020-57.png)
2
%E5%8F%AF%E7%B7%A8%E8%BC%AF%EF%BC%BF2020-55.png)
1
System Verification
Before the visit
During the visit
After the visit
Field Survey
於平面圖上註記展列區、作品分佈，列出記號與其意義。
Observate &
Record
維持約十公尺的距離，進行觀察紀錄。
Interview 1
根據平面圖上的觀察紀錄，對觀展者進行一對一訪談。
取得系統挑出的特殊區段。
Interview 2
根據VSA系統挑出的區段，再進行一次一對一訪談。
Expert
%E5%8F%AF%E7%B7%A8%E8%BC%AF%EF%BC%BF2020-42.png)
Check in
簽署實驗同意書，聽實驗流程說明並穿戴實驗裝備。
visit freely
Be interviewed
Be interviewed
Visitor
VSA System
Put on VSA tools
VSA analysis
將搜集的眨眼數據與錄影匯入電腦。
將特殊區段交給專家
Use VSA in
interview
%E5%8F%AF%E7%B7%A8%E8%BC%AF%EF%BC%BF2020-38.png)
Expert Manuscript
%E5%8F%AF%E7%B7%A8%E8%BC%AF%EF%BC%BF2020-35.png)
Color Transcript of Expert Manuscripts
%E5%8F%AF%E7%B7%A8%E8%BC%AF%EF%BC%BF2020-37.png)
%E5%8F%AF%E7%B7%A8%E8%BC%AF%EF%BC%BF2020-36.png)
Sections and Videos of VSA Program
Color Transcript of VSA Sections
Expert Manuscripts
+
VSA Sections
%E5%8F%AF%E7%B7%A8%E8%BC%AF%EF%BC%BF2020-48.png)
Qualitative Interview Assessment
Conclusion
After the system was completed, we invited the curators who participated in the expert interviews to verify the functions of the system through experiments and interviews. As the result, it was found that the special moments which picked from the system can covered the key moment which picked from the curator during the observation. From the curators’ feedback, we found that although this system cannot replace the value of interviews, but it can help in observation stage. The system can examine the visitors’ behavior in more objective way. Therefore, in the future, this system will have the opportunity to replace the manpower of the observations, and also provide objective evidence for the adjustment of the exhibition planning.
本研究在系統完成後，邀請策展人參與實驗和訪談，對其功能進行驗證。結果發現，根據眨眼特徵挑出來的特殊片段有涵蓋策展人在執行觀察中發現的關鍵區段。從策展人的回饋中也發現，此系統雖然無法取代訪談價值，但在觀察階段可以提供很好的幫助。系統能以更微觀、客觀的方式來檢視觀眾狀態。因此將來此系統有機會取代執行觀察所需要的人力，並也為展示規劃的調整提供客觀的佐證。