Uttar Pradesh police late on Thursday successfully rescued 23 children held hostage by a murder accused in Farrukhabad.