You also can take an over-the-counter pain reliever, such as Advil or Motrin (ibuprofen) and Aleve (naproxen), for comfort. A breast boil will often drain on its own. Never pop or squeeze a breast ...