'03 Mach 1 fuel pump

[JTS71 Mach1]

Yeah they do that occasionally. I've had them quit like that. Sometimes using a rubber mallet, and thumping the tank near where the pump sits, usually the lowest part of the tank. Will usually get one working. Don't cave it in. I've seen them stick, and once loose run for years. Then again I've seen them fail immediately after being shut off. So it's basically a crap shoot. For piece of mind change the pump. I would use a Carter or Walbro, pump as they were the ones who supplied them to Ford originally. I've had several issues with the cheaper "generic" / China junk over the years, so don't waste your money. I would check Rock Auto, as they will show all the pumps they carry, and each brand is clearly listed. If shipping doesn't eat you up it'll be cheaper also. 

Good Luck, Hope it helps.  

JTS