Several key technologies for AIAugSurgery, an image guided surgery with artificial intelligence and augmented reality, have been developed. For AIAugSurgery system, we develop a marker based flexible 6-DoF high precision camera pose estimation technique. We also propose an end-to-end deep model to perform single-image blind inpainting to remove the specular highlights for endoscope imaging. Moreover, for the computing platform of AIAugSurgery, we have developed processors for super-resolution and image deblurring used for AR-aided surgical auxiliary systems. A high-throughput, energy-area-efficient CIM for neural network circuits for surgical information processing is also developed.