I have been itching to let a Pokemon go, but I don't think I should.
No, if you release a Pokémon you can not get it back. The only way would be to turn off the game without saving.