Development of augmented reality system for AFM-based nanomanipulation

Using atomic force microscopy (AFM) as a nanomanipulation tool has been discussed for more than a decade. However, its lack of real-time visual feedback during manipulation has hindered its wide application. Fortunately, this problem has been overcome by our recently developed augmented reality system. By locally updating the AFM image based on real-time force information during manipulation, not only can this new system provide real-time force feedback but also real-time visual feedback. The real-time visual display combined with the real-time force feedback provides an augmented reality environment, in which the operator not only can feel the interaction forces but also observe the real-time changes of the nano-environment. This augmented reality system capable of nanolithography and manipulation of nano-particles helps the operator to perform several operations without the need of a new image scan, which makes AFM-based nano-assembly feasible and applicable.