A fire broke out at a garment factory in southeast Delhi's Okhla Phase 1 on Friday evening, an official said.