Open Question: Can buying a foreclosed home get rid of PMI?

My question is this: I have $21,000 and I'm wondering if I buy a foreclosed home that is appraised at $250,000 but is selling for $220,000...