What is the origin of the idiom "pull a rabbit out of the hat" and when to use it?

The idiom "pull a rabbit out of the hat" is derived from the world of magic and conjuring tricks. Magicians often perform the act of producing a rabbit from a top hat, a classic and surprising trick that astounds audiences. It is used to describe a situation where someone manages to achieve a remarkable or unexpected success, find a clever solution, or produce a surprising result when facing adversity or challenges.