Don't you have a room or 2 that are "babyproofed??" With my first daughter, we gated off the living room and it was pretty much a padded cell with only stuff in it that would not hurt her and that she could use to make a mess and play. By the time #2 came, we had moved and this was no longer possible, but we then just gated the rooms that were off limits (my husband's office, the laundry area, etc) and removed all cleaning fluids, sharp objects, and even some tippable bookshelves. Yes, she did make messes with toys, pots and pans, etc. but you can hear that happening, and decide whether to stop it or clean it up later.
I agree, this is the hardest time in your life, until he is about 2 1/2 or 3, but this is also the time in his life that you need to train him on what is OK and not OK.
Just figure out whether you can make one safe room for him to be gated into or else gate off all the areas where you DONT want him to be. You should be able to leave the room for a few minutes, but not more than 5 minutes without the supervision of at least a quick peek. Oh, and please take down the crib.