Monthly Archives: October 2013

International Symposium on Mixed and Augmented Reality (ISMAR2013): (Fujimoto)

What is ISMAR?:

It is the premier international conference on research into the science, technology, applications and uses of Mixed and Augmented Reality.

Date: October 1st-4th 2013
Place: University of South Australia, Adelaide, Australia
Participants: 250?
Oral presentations: 26
Poster presentations:30

Hello, this is Yuichiro Fujimoto, PhD student (D2).
ISMAR2013… this day finally came again. I was back!
This year I could not submit my paper for the ISMAR because the speed of my research progress was too slow (Stupid!). But, I was able to attend this conference again as a demo presenter.

This year’s conference was held at the University of South Australia where Prof. Smith and Prof. Thomas who we have been working on the same project, are.



Industry day:
This is the event that companies which sell products using the AR technology make a presentation about their products and applications. Famous companies (Metaio, BOEING, NVDIA etc.) attended to this event. One of my favorite topics is the HMD (Head Mounted Display) which has been presented in this year’s SIGGRAPH, “Near-Eye Field Display”. This HMD enables user’s natural stereoscopic vision by making lenses attached to the HMD control the focus as the same way which human’s eyes conduct naturally.



Tracking session:
The paper which I’m interested in is about the tracking method for a human’s liver which is a deformable object.
Image-guided Simulation of Heterogeneous Tissue Deformation for Augmented Reality During Hepatic Surgery, Nazim Haouchine, Jeremie Dequidt, Igor Peterlik, Erwan Kerrien, Marie-Odile Berger, Stephane Cotin
The proposed method in this paper assumes the situation that the surgery for the liver is conducted by an endoscope without a large incision. In this case, surgeons have to conduct a surgery using only 2D image captured by an endoscope. This research aims to assist surgeons in such kind of situations using overlaying 3D model of a liver with AR. One of contributions of this paper is to enable the tracking for a liver which deforms in the surgery by the usage of biomechanical models of the liver and restrictions of the deformation of the liver. You must watch this research’s video!




About me (demonstration )
As a result, I have to feel responsible for the failure again. I hope that my blog article is of use for readers in order to avoid same mistakes and failures.

Preparation for our demo

Preparation for our demo

I assumed many accidents which likely occur before the demonstration day.
In addition, I asked a person who was responsible for local arrangements and checked our system worked the way it should in the venue before the day. However, two problems happened.

Problems One:
On the day, I found that when some participants walked near our system, floors shakes and the gray-code pattern projection was failed. I should have noticed it on the day when I checked our system and changed the demo location. However, I managed to show participants the system worked well by conducting the gray-code pattern projection when no one walked near our system.

Problems Two:
But another problem happened on the way. All electrical power supply was completely shut down near the spot of our demonstration! Of course, demo presenters who used projectors (include me) could not continue their demonstrations. After 30-40 minutes, the power supply problem was fixed. But the 3D measurement process was not succeeded for any reason. I still do not know an actual reason on it now. I am still investigating about it.

What is the main problem?
After all, it was required “ to make a more robust system”. I found again that systems which work with effort in the laboratory is not enough for the demonstration out of the laboratory.


This year’s best award is
“Augmented Reality Binoculars”
by Taragay Oskiper, Mikhail Sizintsev, Vlad Branzoi, Supun Samarasekera, Rakesh Kumar
This paper proposed the AR binocular system using a wide-field of view camera, a narrow filed of view camera, an IMU (inertial measurement unit) and the GPS.

And, Prof. Kawai (Yokoya-lab.) won the best poster award honorable mention! Congratulation!
“Diminished Reality Considering Background Structures”
by Norihiko Kawai, Tomokazu Sato, Naokazu Yokoya

Australian food
It was DYNAMIC! (as we expected). The steak restaurant where I was took by Prof. Kato serves really large steaks (minimum: 350g!, Maximum: 800g!). Of course, Prof. Kato ordered an 800g steak. Prof. Kato and Prof. Saito (Keio Univ.) were excellent enough to treat me. I would like to thank awesome Prof. Kato and marvelous Prof. Saito again.

Oyster is justice!

Oyster is justice!

Of course, beef is also justice!

Of course, beef is also justice!

Australian wine was really nice. So many people said “this wine was really nice!”, which made me come to like wine. This was my best thing in this conference!


As a result, ISMAR was really nice conference! Next year’s ISMAR will be held in Germany on September and deadlines of the paper / poster submissions are March. One Japanese Professor said “Currently, there are only few oral presentations by Japanese per a year. Let’s do our best for the next conference so as to get more acceptances for oral presentations!.” Well, let’s submit 100 papers for next year’s ISMAR from our laboratory!

Demo using pro-cams

Demo using pro-cams

Demo for making the inside of the body visible

Demo for making the inside of the body visible

SIG-MR 2013 (Jarkko)

This is Jarkko (D2), I visited the SIG-MR workshop on September, 26-27th. The workshop was held in Rishiri island, northern part of Hokkaido. I presented our paper ”User Interface Design of a SLAM-based Handheld Augmented Reality Work Support System.”

This was the first time for me to make a presentation in a workshop in Japan. I was quite nervous and I think it showed. Still, it got good experience in making a presentation. My topic  was a little bit different from others presentations, but I still got useful feedback related to this SLAM-based system project and how to present guidelines. The workshop had several interesting topics, but unfortunately all other presentation were in Japanese so my understanding was very limited. But at least abstracts were in English.

20130927-IMG_6560 20130927-IMG_6557

I have not visited Rishiri island before and the place was probably the most remote one where I have ever been. Inside Japan that is. Many shops and restaurants were closed even at noon and it was almost dead silent. This made the selecting of a restaurant, where to eat lunch, very easy: go to the first place you see that is open. Rishiri island being near the north most point of Japan, weather was of course colder than in Nara.  And it felt really good.

All the presentations were finished in the early afternoon on 27th so we had some time for sightseeing. We rented a car and went for a short road trip around the island with Taketomi-sensei and also Yokoya-sensei and Okura-san Yokoya lab joined us. Scenery around the island was very beautiful. It takes around 1 hour to drive around the island but of course we had many breaks to take pictures.  Also on 27th, we went to eat ramen in a restaurant which has been awarded one Michelin star in 2012. Ramen was good, but michelin-star-good? Hard to say.. probably not the best one what I have eaten. 🙂

20130927-IMG_6630 20130927-IMG_6563

Report of staying Oulu university

Hyvää päivää!

Minä olen Naoto Bando!



My name is Naoto Bando!


I learned some clean Finnish. And I’m writing this article in the night train to Helsinki.




I have already stayed laboratory in Oulu for almost 4 weeks.

The day when I go back to Japan is coming soon.

Then!!! I’ve got a pain in my teeth…

I got the lesson here. “Health is really priceless.”


Anyway! below is report of staying Oulu!


<strong>I’ve met Zeeshan again in Oulu!!</strong>


Zeeshan who researched in interactive media laboratory came back to Oulu university.

Three, two, one, smile!


To meet friends in foreign country made me happy and strange nice feeling.

He came back to Oulu through Turkey. And he said “It was too long…” with a bitter smile.





<strong>About the laboratory</strong>

During my stay, a visitor came. And one researcher in lab held a demonstration.

His research is to develop the navigation system for a blind person.

This system navigate a blind person by using a stick set a magnet to the tip and the magnet buried in the sidewalk.

And I heard the prototype system which inform them to an intersection by vibrate the magnet buried in the sidewalk.



One shot as a memory!



<strong>About Oulu university</strong>

The building of Oulu university is very colorful. I was surprised at that color.

Every color has high intensity. It is like a Composition of Mondrian.

Especially the stairs from 1st floor to laboratory’s floor is covered with yellow.

When it is fine, the floor becomes so bright that I’m dazzled.






<strong>Debonair people in the bar</strong>

There are many bars and cafes. On Saturday, a lot of people are drinking at the terrace.

Drinking debonair people sometimes talk to me. The ecology of this kind of people is almost same as Japan.


By the way, for that people, Japanese is unusual. One person said “In my working place, there are some Chinese but there is no Japanese”.



And then he slowly a p  p   r    o    a     c      h        e        d……………..





He kissed my cheeks…………




I felt danger. So I quickly went out.

This is the most dangerous experience in my staying…………


<strong>So Fujimoto-san, please pay attention</strong>



<strong>About Oulu</strong>

The townscape of Oulu is very beautiful. There is the sea near the town.

I could enjoy the nature.

If I go a little ways out of the urban area, I felt trees and cityscape live together.




By the way, there was japanese event named Japan Days.

As introduction of japanese culture, there was cosplay show…..

Is cosplay japanese culture???


Then the completion of the event, all staff did Bon Dance…

I saw the really strange something…..




Anyway the person of Finland is very kind.

When I met inhabitant on the stairs, everyone say “Hei!” with smiling.


This is the very small thing. But I think this kind of behavior keeps the mental health.

In my staying, I study the importance of it.

So when I was in Japan, I was rude. But henceforth I want to be sincerely.