If you want a real travel experience go ahead and splurge on that $10 a night hostel.
First thing I do when I arrive and throw my bags on my bed is to head out to the local market.
Make sure to check the bed first before putting your bag on it. Many hostels in Asia and even some in Europe have had cases of bedbugs. You do not want them to take up residence in your bags.