Or, it doesn't stop and you develop a stress fracture. It certainly sounds like you may have at least a stress reaction ( very beginning of a developing stress fracture ). Take a few weeks off of running or impact activities ( try cycling, swimming or other non-impact activity ) then resume slowly. If pain still persists, then you would probably want to see your physician.