We develop an asynchronous framework across user and kernel spaces for deep learning applications on the improvement of Wi-Fi performance and implement it in the driver of commodity Intel Wi-Fi cards. Under this framework, we apply deep reinforcement learning to developing an intelligent rate adaptation (RA) algorithm (DRL-RA), which can achieve the highest throughput in varying channel conditions given many rate options of current Wi-Fi technologies. Its on-learning capability can learn how to efficiently approach the best rate from the experiences of its common usage pattern and environment.