Tag Archives: yuichiro-f

IEEE Virtual Reality International Conference2014 (VR2014) Report:(Fujimoto)

Hello there, this is Fujimoto (D3).

At first, let me introduce the main motivation of this blog.
This blog aims to report lab members’ activities (e.g. conference participation)
and lab’s event.
I’m really delighted if you could know the atmosphere of our lab through this blog!

I attended the international conference about virtual reality, IEEE VR which was held in Minneapolis, Minnesota, USA. It was very cold and snowing!
I attended it both as a oral presenter and a research demonstration presenter(so hard! `_`).

participants: 350?
Submission : 116

Long paper :18
Short paper :10
Poster :31
Research demo:13


Conference venue


Most conference has some sessions that a famous researcher gives a talk
, which is called “keynote”.
First keynote speaker is Prof. Henry Fuchs at North Carolina univ.
His talk is always very impressive and energetic. At this time, he mentioned about that Oculus VR, Inc. was bought by facebook inc. and this might be a big chance to appeal “Virtual Reality” to various field and markets.
Second keynote speaker, Prof. Hunter Hoffman at HIT lab told that the immersive virtual reality is valuable as an adjunctive non-pharmacologic analgesic for people with severe burn wounds suffering from uncontrolled pain during wound care.
Practical systems he mentioned made me re-recognize that VR has the various potential.


Favorite papers:

I will show you some paper I’m interested in
Mixed Reality Virtual Pets to Reduce Childhood Obesity,
Kyle Johnsen, Sun Joo Ahn, James Moore, Scott Brown, Thomas P. Robertson, Amanda Marable, and Aryabrata Basu

This research aims to reduce the high rates of childhood obesity in the developed world by virtual pet. It won the best paper award in this conference!
A mixed reality system that allowed children to exercise, play with, and train a virtual pet using their own physical activity as input was constructed.
The author conducted a user study with 60 participants and evaluated effectiveness of this system.

Global Localization from Monocular SLAM on a Mobile Phone,
Jonathan Ventura, Clemens Arth, Gerhard Reitmayr, and Dieter Schmalstieg

The author targets a hand-held device (e.g. phone with a camera) and proposes the combination of a keyframe-based monocular SLAM system and a global localization method.
The server side has large number of 3D point in advance and global localization can be conducted by 3D-3D matching between 3D point in the server and 3D point calculated by SLAM process of the client side (hand-held device).
Evaluations highlight the advantages of SLAM localization over a model-based approach which uses single-image localization on each frame.

My presentation

Oral presentation for the long paper

I can not decide whether my presentation is good or not but I think it was so-so.
I always had a same feeling after the presentation but my English in the Q & A session was poor.
I wonder I may be able to answer to questions fluently if I try to think about my research topic and its logic regularly for the practice.

Demo presentation

The proposed demonstration is the projection for a T-shirt shaped white cloth.
A retro-reflective marker pattern is attached onto the surface of the T-shirt shaped white cloth
and using this information, the texture image is projected onto the its surface so as to change the appearance of the T-shirt.
Because my system did not work properly last time, I did my best to improve the system this time.
Then system worked well and I could let many people see our demo.

Some famous researchers came and saw my demo but I could not explain about advantages of our method properly.
Keep in there, my English skill!

Most of visitors gave us the following same comment.
“Why doesn’t this system work in real-time?”
Too many such kind of comments made me get motivated!
I will make this system work in real time for the next step, probably next time.


My impression after the conference is as follows.

  • I will learn English much harder
  • If the presenter can clarify how his or her research make the world change in the presentation, the presentation will be strongly impactive.
    As our professor always mentioned, it is crucial to continue to consider the technology is finally used for what, by whom, and how, if we develop some technologies

  • Other topics


    Japanese style bar: I had Japanese dishes three more times in this week!


    Play Origami at the banquet


    Surprisingly we watched NBA!

    Augmented Human International Conference2014 (AH2014) Report (Fujimoto)

    Is it my turn again?!
    This is Yuichiro Fujimoto (D2).

    I would like to report about Augmented Human International Conference 2014 (AH2014) held at Kobe, from March 7th-9th.
    AH is subject to extend the capabilities of the human by science and technology.

    The followings are main topics.
    It seems that this conference covers a large research filed!

    Augmented and Mixed Reality
    Internet of Things
    Augmented Sport
    Sensors and Hardware
    Wearable Computing
    Augmented Health
    Augmented Well-being
    Smart artifacts & Smart Textiles
    Augmented Tourism and Games
    Ubiquitous Computing
    Bionics and Biomechanics
    Training/Rehabilitation Technology
    Brain Computer Interface
    Augmented Context-Awareness
    Augmented Fashion
    Augmented Art
    Safety, Ethics and Legal Aspects
    Security and Privacy
    Participants 100 ?
    Submission : 87
    Acceptance rate for long/short paper: 36% (last year 55%)

    Long paper :13
    Short paper :19
    Poster :18
    Demo :8
    This conference always has many Japanese participants.
    In this time, in particular, because of the conference venue,
    the rate of Japanese is over than 70%!
    This is my second time to attend AH.
    While I have no presentation, I attended to just hand out my business card.
    Impressive research

    Around Me: A System for Providing Sports Player’s Self-images with an Escort Robot – Junya Tominaga, Kensaku Kawauchi, Jun Rekimoto
    This research aims to improve his/her jogging form, which is essential for performance and for injury prevention. A display attached to an escort robot that runs in front of the user and captures the user’s posture from the front and recognizes his/her position relative to the robot. The user can check his or her form by looking at the display attached to the robot. This won the best paper in this conference!

    Carrier Pigeon like Sensing system: Animal Computer Interface Design for Opportunistic Data Exchange Interaction for a Wildlife Monitoring Application
    Keijiro Nakagawa, Hiroki Kobayashi, Kaoru Sezaki
    The authors takes advantages of wild animals’ behaviors in order to conduct
    information transmission in the place where it is impossible to conduct information transmission normally (e.g. in the mountain).
    The devices for the information transmission are attached to wild animals.
    These devices have to be small enough and energy saving because the replacement of these can not be conducted after the installation.
    The author explained me that he attached some sensors to his dog and conduct a dog study in order to find a way of saving energy consuming.


    An Interface for Unconscious Learning using Mismatch Negativity Neurofeedback
    Ming Chang, Hiroyuki Iizuka, Yasushi Naruse, Hideyuki Ando, Taro Maeda
    As you know, the recognizing the difference between sounds of ‘R’ and ‘L’ is difficult for Japanese. However, This research’s professor said that even if we can not notice this kind of difference consciously, we can actually distinguish them in our brain unconsciously.
    With this fact, this study aims to make a user learn such kind of differences the unconsciously using visual feedback and unconscious repeated learning.
    I am not familiar with this kind of researches, but this work is amazing!


    Pseudo- Transparent Tablet based on 3D Feature Tracking – Makoto Tomioka, Sei Ikeda, Kosuke Sato
    This research proposes geometrically consistent image rendering method that realizes pseudo-transparency in tablet-based augmented reality.
    This is the research by Tomioka-san, Ikeda-sensei who I saw many times at conferences or other events and achieved the best demo award.




    Tsukamoto/ Terada Lab’s (Kobe Univ.) mascot, Tukabo!
    The picture shows the new character, Lab-RIN (I don’t know the correct ).

    Banquet was held in the large ship. Delicious Tanba-beef was served!! The view of the Kobe City from the ship was excellent. My hometown is here. But, it is not the reason for the compliments.

    Hand out my business card
    This is the main and only theme for me this time! 
    I remade my business card for this conference. I added some images of my research on backside of the business card so that people who get this card can easily know my research. I also prepared to show videos of my research on the iPad as Prof. Kato advised me.
    At last, I could talk with many Professors, researchers, and students who I had not talked before.
    I always said the following but repeat it again. Let’s attend the conference, everyone!
    It’s interesting and I am sure it will positively stimulate your research activity!

    Report of staying at Oulu university (Fujimoto)

    Hello there,
    This is a D2 student, Yuichiro Fujimoto.

    I have been staying at Oulu University for one month and a half. I would like to report this stay.

    But, most things about this university and the daily life here have been already written in articles by members of my laboratory who stayed at the university. So, instead of them, I would like to write what I am thinking and feeling during this stay.

    ・I as a foreign student and Oulu university’s students.
    More than half students are foreign students in my laboratory of NAIST. So I always have a chance to talk with them in Japan. Conversely, I am a foreign student in this university here.
    I found it a good opportunity to reconsider how I get along with foreign students in Japan.

    In this university, a weekly event for people who are interested in other country’s culture is held. This event is called “Café lingua”. At this event, we can talk about our culture and language freely and can make some friends. Friends who I meet at this event always invite me for a drink or other events. Before coming to this country, I thought if I had to spend alone all weekend, I tried not to cry…
    So, this was really good for me.

    After going back to Japan, I will become kinder for foreign students.
    I decided so again.

    ・Stay-time in the laboratory
    Please note that the following is just my opinion.

    Most students at this university stay at labs from 9:00 (or 10:00) to 17:00 (or 16:00). They also value weekends and make time for themselves. Most of them do not come to the lab on weekends. I think this style is really good and effective but cannot judge whether this style is the best.

    In Japan, there is a tendency that longer you stay at the lab is better (in my opinion). I think this is also good in order to evaluate the process or the attitude for our own research even if we cannot make a good progress. However, this tendency may lead to unnecessary stays at the lab despite he or she does not want to stay at the lab long time. We have to care about that.

    International Symposium on Mixed and Augmented Reality (ISMAR2013): (Fujimoto)

    What is ISMAR?:

    It is the premier international conference on research into the science, technology, applications and uses of Mixed and Augmented Reality.

    Date: October 1st-4th 2013
    Place: University of South Australia, Adelaide, Australia
    Participants: 250?
    Oral presentations: 26
    Poster presentations:30

    Hello, this is Yuichiro Fujimoto, PhD student (D2).
    ISMAR2013… this day finally came again. I was back!
    This year I could not submit my paper for the ISMAR because the speed of my research progress was too slow (Stupid!). But, I was able to attend this conference again as a demo presenter.

    This year’s conference was held at the University of South Australia where Prof. Smith and Prof. Thomas who we have been working on the same project, are.



    Industry day:
    This is the event that companies which sell products using the AR technology make a presentation about their products and applications. Famous companies (Metaio, BOEING, NVDIA etc.) attended to this event. One of my favorite topics is the HMD (Head Mounted Display) which has been presented in this year’s SIGGRAPH, “Near-Eye Field Display”. This HMD enables user’s natural stereoscopic vision by making lenses attached to the HMD control the focus as the same way which human’s eyes conduct naturally.



    Tracking session:
    The paper which I’m interested in is about the tracking method for a human’s liver which is a deformable object.
    Image-guided Simulation of Heterogeneous Tissue Deformation for Augmented Reality During Hepatic Surgery, Nazim Haouchine, Jeremie Dequidt, Igor Peterlik, Erwan Kerrien, Marie-Odile Berger, Stephane Cotin
    The proposed method in this paper assumes the situation that the surgery for the liver is conducted by an endoscope without a large incision. In this case, surgeons have to conduct a surgery using only 2D image captured by an endoscope. This research aims to assist surgeons in such kind of situations using overlaying 3D model of a liver with AR. One of contributions of this paper is to enable the tracking for a liver which deforms in the surgery by the usage of biomechanical models of the liver and restrictions of the deformation of the liver. You must watch this research’s video!




    About me (demonstration )
    As a result, I have to feel responsible for the failure again. I hope that my blog article is of use for readers in order to avoid same mistakes and failures.

    Preparation for our demo

    Preparation for our demo

    I assumed many accidents which likely occur before the demonstration day.
    In addition, I asked a person who was responsible for local arrangements and checked our system worked the way it should in the venue before the day. However, two problems happened.

    Problems One:
    On the day, I found that when some participants walked near our system, floors shakes and the gray-code pattern projection was failed. I should have noticed it on the day when I checked our system and changed the demo location. However, I managed to show participants the system worked well by conducting the gray-code pattern projection when no one walked near our system.

    Problems Two:
    But another problem happened on the way. All electrical power supply was completely shut down near the spot of our demonstration! Of course, demo presenters who used projectors (include me) could not continue their demonstrations. After 30-40 minutes, the power supply problem was fixed. But the 3D measurement process was not succeeded for any reason. I still do not know an actual reason on it now. I am still investigating about it.

    What is the main problem?
    After all, it was required “ to make a more robust system”. I found again that systems which work with effort in the laboratory is not enough for the demonstration out of the laboratory.


    This year’s best award is
    “Augmented Reality Binoculars”
    by Taragay Oskiper, Mikhail Sizintsev, Vlad Branzoi, Supun Samarasekera, Rakesh Kumar
    This paper proposed the AR binocular system using a wide-field of view camera, a narrow filed of view camera, an IMU (inertial measurement unit) and the GPS.

    And, Prof. Kawai (Yokoya-lab.) won the best poster award honorable mention! Congratulation!
    “Diminished Reality Considering Background Structures”
    by Norihiko Kawai, Tomokazu Sato, Naokazu Yokoya

    Australian food
    It was DYNAMIC! (as we expected). The steak restaurant where I was took by Prof. Kato serves really large steaks (minimum: 350g!, Maximum: 800g!). Of course, Prof. Kato ordered an 800g steak. Prof. Kato and Prof. Saito (Keio Univ.) were excellent enough to treat me. I would like to thank awesome Prof. Kato and marvelous Prof. Saito again.

    Oyster is justice!

    Oyster is justice!

    Of course, beef is also justice!

    Of course, beef is also justice!

    Australian wine was really nice. So many people said “this wine was really nice!”, which made me come to like wine. This was my best thing in this conference!


    As a result, ISMAR was really nice conference! Next year’s ISMAR will be held in Germany on September and deadlines of the paper / poster submissions are March. One Japanese Professor said “Currently, there are only few oral presentations by Japanese per a year. Let’s do our best for the next conference so as to get more acceptances for oral presentations!.” Well, let’s submit 100 papers for next year’s ISMAR from our laboratory!

    Demo using pro-cams

    Demo using pro-cams

    Demo for making the inside of the body visible

    Demo for making the inside of the body visible

    VRSJ2013 (Fujimoto)

    The 18th Annual Conference of the Virtual Reality Society of Japan

    Date: September 18-20th 2013

    Place:Grand Front Osaka, Osaka.

    Participants: 500

    Hello, this is Yuichiro Fujimoto, PhD student (D2).
    The participation for this conference was the second time for me.
    At this time, the conference was held at Grad Front Osaka which was built on this year’s April.

    Panel Discussion: Reconsideration about HMD
    Presenters were discussing about a new head mounted display, “Oculus Rift”(http://www.oculusvr.com/) which was on sale lately.
    I had regarded this HMD as a new type of HMD with the high-FOV (about 90 deg).
    However, researchers or developers participated in this discussion told that there has been many such kind of HMDs
    and they felt a sense of nostalgia by this HMD.
    They also told that there were many problems about both the software and the hardware of current HMDs.
    We have to consider about it in our researches, not just expecting developments of new cool HMDs in specific companies.


    First keynote speakers is Masanobu Endo who created really famous and cool video games (XEDIOUS, The tower of Druaga, and so on, do you know?).
    He made a presentation about the process to imagine new things and create it actually and put it out into the world.
    Second keynote speaker is Zenichiro Kawasaki, a emeritus professor of Osaka Univ. who has been working on the research about the thunder and the lightning for 34 years.
    I found him really love his research by his talk and thought that researchers who could love his or her own researches like him could become a famous researcher.


    The demonstration of IVRC (International collegiate Virtual Reality Contest) was also held at the venue. My favorite demonstrations are follows.

    Virtual Rope Slider:
    This system makes users a virtual experience using one of athletic facilities, a rope slider.
    This system consists of a HMD with the high FOV, a chair for the vibration and an electric fan for making air, which makes the high reality.
    Many people were waiting in the line in order to experience this demo.


    Gravitomin-Acid: a flavoring to change the weight of foods
    This system can change the weight that users feel by foods.
    At first, users shake the bottle of Gravitomin-Acid (an imaginary flavoring).
    Then the location of the weight in a folk which user glabs gradually changes depending on the intensity of the shaking.
    So users feel as if the weight of the food changes.
    The concept of this demo is really attractive for me!


    Next my blog is about ISMAR2013.