최근 VR(Virtual Reality)에 대한 사람들의 관심이 높아짐에 따라 주변기기 또한 많은 발전이 이루어졌다. VR 환경에서 그 환경내의 사물과 인터랙션 할 수 있는 여러 인터페이스 장치와 룸 단위의 스캐닝을 통한 VR 환경 구성까지 많은 연구가 이루어지고 있다. 현재 VR의 동향을 보았을 때 가정에서의 VR 활용법은 여러 햅틱 인터페이스를 이용하여 VR 환경 내에 구성된 사물들과 인터랙션 하는 것이 많으며 룸 스캐닝을 이용한 방법으로 공간상의 제약을 어느 정도 벗어나기도 하며, 트레킹 장비를 이용하여 실제 사물들과의 인터랙션을 하기도 한다. 3D 프린터의 발전으로 상업용 3D 프린터와 가정용 3D 프린터의 보급이 활성화 되었으며, 3D 프린팅 업체 또는 가정에서 쉽게 3D 프린터를 통해 자신이 원하는 모형을 만들 수 있게 되었다. 위 두 가지를 고려하였을 때 VR 환경 에서 사람들이 쉽게 만들 수 있는 모형을 가지고 직접 인터랙션을 할 때 사람들이 느끼는 모형의 물체감과 VR 환경상에서 구성된 모형의 물체감 사이의 차이점에 대한 연구가 필요하다고 느껴진다. 따라서 이 논문에서는 3D 프린터로 제작한 사물을 VR 공간 내에 구현하고 실제로 구현된 그 사물과의 사용자 테스트를 통해 실제 사물과 인터랙션 할 때와 다른 일반 인터랙션 장비를 사용할 때의 차이에 대한 연구를 하고자 한다.
This paper presents development of the new haptic device for virtual wall collision test. Mathematical model of the proposed system considering virtual wall collision is developed and tuned by comparing force responses from simulation and experiment with free motion. To verify the effectiveness of the proposed model, a range of collision tests against virtual wall are accomplished, conditioned on different collision speeds to virtual wall. In addition, hybrid PI control scheme is applied to improve the performance of the proposed haptic system in virtual wall collision experiments.
In this paper, the learnability of haptic icons was tested as a way of conveying turn-by-turn directions to users involved in navigation interactions with commercial smartphones. To do this, six most distinctive haptic icons were identified from those having different duration of each pulse, interval between pulses, and rhythm. Associations between the selected haptic icons and 3 pairs of navigation directions were analyzed using data gathered from 30 subjects by 7 point Likert scale. The haptic icons were then assigned to proper directions based on the results from that stereotype analysis. The results showed that the commercial smartphone with one linear motor at a fixed location is not capable of making hapticons to have clear directional stereotypes. The hapticons with poor stereotypes has no advantage in learnability compared to those of random assignment.
There are half million dentists in the world and 20,000 dentists in Korea. One of the typical operation among dentist is implantation. The 10% of the dentist in U.S.A. and 70% of dentist in Korea conduct implantation. However many problems are occurred in Korea because many dentists in Korea learn this operation skill from private research center rather than authorized institute like U.S.A. This research develops system of implantation education for dentist using Haptic simulation system to solve such a problem. This system improves education effectiveness through experiencing overall operation procedure and eyes, which expect to lead us 4D virtual reality and provide safe method for patient.
This paper proposes a low-cost robotic surgery system composed of a general purpose robotic arm, an interface for daVinci surgical robot tools and a modular haptic controller utilizing smart actuators. The 7 degree of freedom (DOF) haptic controller is suspended in the air using the gravity compensation, and the 3D position and orientation of the controller endpoint is calculated from the joint readings and the forward kinematics of the haptic controller. Then the joint angles for a general purpose robotic arm is calculated using the analytic inverse kinematics so that that the tooltip reaches the target position through a small incision. Finally, the surgical tool wrist joints angles are calculated to make the tooltip correctly face the desired orientation. The suggested system is implemented and validated using the physical UR5e robotic arm.
Haptic systems have been widely used for both virtual reality and augmented reality application including game, entertainment, education and medical sectors. Clothing designers and retailers initiated using AR and VR technologies to help the consumers find style with the perfect fit. Most of the developed augmented reality shopping is implemented by overlapping the image of the clothes on the customer so that he/she can find the fit. However, those are only visual information and the customer cannot experience the real size and the stiffness of the clothes. In this paper, we present the haptic upper garment which provides the haptic feedback to the user using cables. By controlling the length of the cable, the size of the clothes is set and by stiffness control, the compliance of the fabric is implemented. The haptic garment is modeled for precise control and the distributed controller architecture is described. With the haptic upper garment, the user’s experience of the virtual clothes is greatly enhanced.
본 논문은 기존 립모션 장비에 홀로그램과 햅틱 장비를 결합함으로써 향상된 몰입감과 사용 용이성을 제공할 수 있는 사용자 인터페이스를 제시한다. 립모션은 사용자 손동작의 물리적 행 동이 직접 가상의 화면상에 영향을 주는 장치인데, 화면상의 가상 손모양을 제어해야 한다는 점과 가상환경에서의 영향을 사용자에게 전달할 수 없다는 한계를 가진다. 우리는 홀로그램을 립모션과 결합시켜 사용자로 하여금 실제 손과 가상 화면을 같은 공간에 배치함으로써 몰입감 을 향상시킨다. 아울러 사용자의 손에 촉각을 전달할 수 있는 햅틱 장비를 장착하여 감각의 상 호 작용을 실현하는 프로타입을 제시한다.
In robotic surgery, a surgeon checks only a surgical site of patient in the progress of surgery by vision and sound information. In order to solve this limited information, the haptic function is necessary. And haptic surgical robot is also necessary to design a haptic master device. The master device for laparoscope operation with cable-conduit was developed in previous research to give haptic function. It suggested a possibility of developing a master device by using the cable-conduit. However, it is very inconvenient to use. Therefore, this paper suggests a new mechanism design structure to solve the problems of the previous work by new forming a new master device. And it has proved that it’s usability is better than previous one. Furthermore it has also experimented and analyzed that a backlash of new master device is compensated by smooth backlash inverse algorithm.
This paper presents a robotic system that provides telepresence to the visually impaired by combining real-time haptic rendering with multi-modal interaction. A virtual-proxy based haptic rendering process using a RGB-D sensor is developed and integrated into a unified framework for control and feedback for the telepresence robot. We discuss the challenging problem of presenting environmental perception to a user with visual impairments and our solution for multi-modal interaction. We also explain the experimental design and protocols, and results with human subjects with and without visual impairments. Discussion on the performance of our system and our future goals are presented toward the end.
Since its introduction (e.g., [4, 6]), virtual coupling technique has been de facto way to connect a haptic device with a virtual proxy for haptic rendering and control. However, because of the single dependence on spring-damper feedback action, this virtual coupling suffers from the degraded transparency particularly during contact tasks when large device/proxy-forces are involved. In this paper, we propose a novel virtual coupling technique, which, by utilizing passive decomposition, reduces device-proxy position deviation even during the contact tasks while also scaling down (or up) the apparent inertia of the coordinated device-proxy. By doing so, we can significantly improve transparency between multiple degree of freedom (possibly nonlinear) haptic device and virtual proxy. In other to use passive decomposition, disturbance observer of [3] is adopted to estimate human force with some dead-zone modification to avoid “winding-up” force estimation in the presence of device torque saturation. Some preliminary experimental results are also given to illustrate efficacy of the proposed technique.
In this paper we propose a haptic interaction system that physically represents the underlying geometry of objects displayed in a 2D picture, i.e., a digital image. To obtain the object’s geometry displayed in the picture, we estimate the physical transformation between the object plane and the image plane based on homographic information. We then calculate the rotated surface normal vector of the object’s face and place it on the corresponding part in the 2D image. The purpose of this setup is to create a force that can be rendered along with the image without distorting the visual information. We evaluated the proposed haptic rendering system using a set of pictures of objects with different orientations. The experimental results show that the participants reliably identified the geometric configuration by touching the object in the picture. We conclude this paper with a set of applications.
We present six-degree-of-freedom (6DoF) haptic rendering algorithms using translational (PDt) and generalized penetration depth (PDg). Our rendering algorithm can handle any type of object/object haptic interaction using penalty-based response and makes no assumption about the underlying geometry and topology. Moreover, our rendering algorithm can effectively deal with multiple contacts. Our penetration depth algorithms for PDt and PDg are based on a contact-space projection technique combined with iterative, local optimization on the contact-space. We circumvent the local minima problem, imposed by the local optimization, using motion coherence present in the haptic simulation. Our experimental results show that our methods can produce high-fidelity force feedback for general polygonal models consisting of tens of thousands of triangles at near-haptic rates, and are successfully integrated into an off-the-shelf 6DoF haptic device. We also discuss the benefits of using different formulations of penetration depth in the context of 6DoF haptics.
This paper presents a new miniature haptic display to convey ample haptic information to a user of a handheld interface. There are buttons on interfaces or general electronic devices, but existing buttons provide haptic feedback of only one passive pattern to a user. Because humans perceive tactile and kinesthetic information simultaneously when they handle objects the proposed actuator provides both sensations at once. It is able to generate various levels of kinesthetic sensations when pressing a button under diverse situations. Also, vibrotactile feedback can be delivered for exciting haptic effects with numerous patterns. Its performance was evaluated in accordance with the resistive force by changing the intensity of the input current. Experiments show that the proposed actuator has the ability to provide numerous haptic sensations for more realistic and complex haptic experiences.
When using commercialized robot assisted laparoscopic, surgeon has met some problems to depend only on image of the surgical field. To solve it, there were various researches. The previous study showed that it is possible to estimate the operation force on the commercialized instrument inside patient without sensors. To apply the estimated force to a haptic master console for the laparoscopy surgical robot system, the light haptic master console should be designed. This paper suggests the design of lighter master console handle to reduce a weight of the console whose structure can match with the joint and DOF of an instrument. A cable-conduit mechanism is designed to make light structure to perform a delicate manipulation. The cable-conduit mechanism removes the weight and inertia of link caused by haptic actuator and encoder which is separated from handle link of a manipulator.
In modern society, people spend most of their time on various types of chairs. However, it is not easy for a designer to design a comfortable chair because satisfaction with the chair depends not only on the quantitative elements such as size, but also on the qualitative element such as the user’s feeling. To deal with these problems, there have been many studies on designing ergonomic chairs. This paper proposes the haptic-aided design (HAD) system to design an ergonomic chair. Based on the HAD system, the designer can experience whether the chair is comfortable or not through the haptic device, and also can modify the design parameters instantaneously. The haptic chair capable of controlling the design parameters in real time was proposed as a haptic simulator. The controllable parameters, such as seat height, reclining angle, stiffness of the backrest, and so on were selected based on the previous research related to ergonomic chairs. The proposed methodology will help reduce the development cost and time by replacing the process of making the real mock-ups and prototypes with the haptic chair.
유아의 감성, 인지 발달을 위해서는 시각, 청각, 그리고 촉각 등의 감각통합이 필요하다. ICT의 발전 덕택에 유아는 학습과정 중에 다양한 감각을 사용할 수 있는 더 많은 기회를 갖게 되었다. 그러나, ICT 교육법은 단지 시청각에 중점을 두고 있어 통합인지가 부족하며, 이러한 사실은 ICT가 왜 주교보재로 사용될 수 없는지를 보여준다. 따라서 본 연구에서는 컴퓨터 퍼즐게임을 이용한 wUbi-Pen(촉각펜)의 인지 효과를 평가하였다. 실험 결과, wUbi-Pen을 이용해 햅틱 퍼즐 놀이를 한 경우 햅틱 기능이 없는 펜을 이용해서 퍼즐 놀이를 한 경우보다 K-WPPSI의 5개 동작성 평가 중 모양 맞추기, 미로, 빠진 곳 찾기 등 3개 영역에서 유의미한 차이를 보였다. 이러한 결과는 ICT 교재의 개발에 있어 촉각 기능의 필요성을 제시하고, 더 나아가 인지에 관련된 다양한 증상에 효과적인 교보재로 사용될 수 있음을 보여준다.
We present the initial results of on-going research for building a novel Mobile Haptic Interface (MHI) that can provide an unlimited haptic workspace in large immersive virtual environments. When a user explores a large virtual environment, the MHI can sense the position and orientation of the user, place itself to an appropriate configuration, and deliver force feedback, thereby enabling a virtually limitless workspace. Our MHI (PoMHI v0.5) features with omnidirectional mobility, a collision-free motion planning algorithm, and force feedback for general environment models. We also provide experimental results that show the fidelity of our mobile haptic interface.
This paper presents offline estimation of equivalent physical damping parameter in haptic interaction systems where damping is the most important parameter for stability. Based on the previous energy bounding algorithm, an offline procedure is developed in order to estimate the physical damping parameter of a haptic device by measuring energy flow-in to the haptic device. The proposed method does not use force/torque sensor at the handgrip. Numerical simulation and experiments verified effectiveness of the proposed method.