AAP members along with Kejriwal set to leave for Patel Nagar