We present the cases of two infants with complications following accidental button battery ingestion with delayed presentations to medical care. Both cases had button batteries recognized as oesophageal foreign bodies and removed appropriately but the time delay resulted in significant morbidity as they developed spinal erosion and tracheo-oesophageal fistula, respectively. Close follow up is required of all children with delayed removal of button batteries as the injury initiated by the battery can lead to a chronic inflammation with significant injury to the surrounding structures.