I always allow take backs unless that game state was changed, as in, the player was made privy to information that he was not aware of before. Changes in the game state=seeing your deck, drawing cards, taking a prize, being made aware of a ruling on a poke-body/poke-power, etc.
Most commonly...