Hey guys, yesterday Plex Media Streamer became available for Ouya. You can find it in the App section.
Amazon Instand Video and Hulu didn't work for me, but maybe the servers aren't working right now. I'll post here when I get them working. However, YouTube does work and streams up to 1080p over Wifi.
I made a video on how to set up channels and specifically - YouTube