Vol.3
RICOH THETA Developer Interview
What are function extensions?
Ask the developer.

FukuiA wireless reception terminal that plugs into an HDMI terminal on a TV such as a wireless display adapter that supports Miracast. It’s a system that receives wireless communication and mirrors the smartphone screen (displays the exact same screen). We plan to sequentially release information about compatible equipment on the THETA V support website.

People expect THETA to connect to a smartphone. This made us wonder how far we could take the camera if a smartphone wasn’t available. As a trial for this, we added a function to playback videos and images using the camera. This is the Remote Playback. It is a first in the history of THETA. It is also the world’s first function for consumer orientated spherical cameras (based on Ricoh research).

TakadaTHETA is a very simple photographic device. It was developed as a camera with a single function that specialized in shooting 360-degree images. From the beginning when we sold the first camera model, we certainly received many requests from our users such as they said “It would be nice if we could also take 360-degree images in addition to taking normal photos”. However, we made a clear decision to make a product that could “just take 360-degree images”.

While deciding on this feature of simplicity, we also carefully researched and examined how to make the camera multi-functional and highly functional by evolving the hardware. Although, trying to add every desirable function would create problems in that it would become difficult to operate. So what can we do to balance the easy to use aspect with various functions? We arrived at the decision to use the plug-in, which is a software that adds new functions, to increase the camera’s extensibility.

FukuiTHETA is freely customizable by adding functions you want to use through the use of plug-ins. We want to provide this kind of enjoyment to all of our users so we planned to have function extensions. From now we are planning to prepare a variety of Ricoh genuine plug-ins. The Remote Playback function, as the first plug-in, will be installed in the camera and provided by default.

TakadaAs I said earlier, we were not sure what would happen if we just went ahead and added every type of function to the camera. That’s my point. For example, just giving the camera the Remote Playback function, a single function, makes the procedure for using the camera increasingly difficult to understand. So, we thought it would be easier to use if we completely separated it from the functions of the camera and activate it as an extended function. We thought this would make it possible to add new functions while maintaining the ability to “quickly shoot images and quickly view them”, a feature of THETA passed on from the first camera model.

Fukui If people decide they “won’t use” the function, they can replace it with another function. I believe plug-ins increase the level of freedom for the user.

We have also been providing extended functions using firmware updates for THETA up until now. Actually this kind of extended function will add functionality to the camera. However, some users may not want some of the functions. This is why we thought it best to use plug-ins so that user can select which function to use or discard. As of now, with the popularity of smartphones, the situation is such that a culture has taken root in which people can decide for themselves which app they want to install. This is additional background on our decision to use plug-ins.

TakadaFunctions that we want most customers to use are put into the camera as main functions. We will prepare plug-ins separately for customers who show a strong demand for a function even if there are only a few of these customers. I think it’s best to think of it in these terms.

FukuiWhen we planned THETA V so it was about one and a half years ago. We made significant changes to the internal system by supporting 4K video this time. The existing image processing engine was not powerful enough to record 4K video so we had to make a new engine. Along with this, we changed to a new operating system, and while thinking of ideas about what we could do, we came up with the idea of adding plug-ins.

FukuiWe are currently working on implementing a scheme for this. Until this is implemented, functions will be included in the firmware updates for the camera to add to the camera in the same way as for previous camera models. Eventually, we want to create a scheme in which users can select and add functions separately.

TakadaIt’s easier to understand if you imagine it to be like a smartphone App Store and Google Play. A concept to create a scheme where you can install a function at a plug-in store similar to those mentioned.

FukuiThe store concept is still a step ahead of us. As of now, we have not set a time for it.

TakadaFirst, a function to shoot normal images that are not 360-degrees will probably be brought up. That is, shooting images using a single lens on THETA and narrowing the angle of view.

Also, a function that embeds a stamp-like image within the camera. THETA is a camera that will at times accidentally capture the photographer’s hand in the shot on a large scale. So, adding a stamp to hide their hand or something. This type of proposal came up.

TakadaIf THETA could connect directly to the Internet, it would be possible to upload images and videos to the cloud the moment they were taken. We also provide a cloud service called “Keenai”. The biggest feature is to be able to save videos without any compression at all.

It is now possible to capture 4K video using THETA V. However, this means the size of files will be large. The method for saving videos will probably become an issue for all of our users. When this happens, we would like them to use “Keenai” as storage. We are thinking of adding a function that allows you to directly upload videos in the future.

TakadaI would say it’s building the architecture (the structure and design) more than anything. That’s because it’s brand-new and something that has not existed before. We are planning to support plug-ins developed by our users in the future. When the time comes, it will be necessary to develop and improve the architecture with the assumption that the plug-in is not created by Ricoh.

TakadaTalking on a specialized level, THETA has released the API and SDK through developer websites in the past. That is, we provided a means of development support to people who say they “want to create smartphone apps”. This is also the same for plug-ins, it will not be at the same time as THETA V goes on sale but we plan to release the API and SDK when we can choose a good time to do so.

TakadaThis is purely a personal goal but I would like to release them around spring 2018. At the stage they are released, they will be made available to everyone around the world.

TakadaThis is a service we are considering in the distant future but I cannot say anything about its relationship with function extensions. We have been proposing a way of shooting images using THETA and a DSLR camera simultaneously by combining them. This is referred to as “Multi-imaging technology” and is a new technology at the stage of being reference exhibited at exhibition shows.

To explain what it is, it is equipment that connects THETA to a digital DSLR camera to shoot images with THETA at the same time as shooting images with the DSLR camera. After shooting images, the images shot with both types of equipment are automatically processed using a computer. This is a technology that allows you to display high resolutions when enlarging images because locations shot using the DSLR camera are composited in the 360-degree image.

Using this function will allow you to capture in a single shot an image displayed in the DSLR camera resolution of a subject you want to focus on from a 360-degree image as a whole.

TakadaI think it will be something you use every day. I would want to use it when shooting a scene with my children. The scene is important but what I want to have most is a clear photo of my children. There are things you will want to focus on in particular within an image shot in 360-degrees.

FukuiAn “eye” at the center of IoT (Internet of Things). It would be nice for THETA to be a type of device based on a cycle of THETA being used everywhere, people being able to share images and videos with everyone, and creating new value from this.

TakadaI have been involved in the development of all THETA models from the first camera model to the current one. Throughout the course of its development, I have been aiming to “create a new video culture”. I think development has been going so well up to THETA SC in regard to this. However, I also feel that it has not yet expanded enough.

With the current THETA V, we have implemented such things as adding 4K video, 360-degree spatial audio, and BLE (Bluetooth® Low Energy). Adding function extensions is sure to steadily expand THETA’s world view. It will probably show its presence more as a tool for creating a new video culture.