Hd 5770 OC problem? Helpp?

Obviously, that means you've overclocked *way* further than the card can go. I also don't recommend overclocking both the core and the mem at the same time when you're first testing possible overclocks. Only combine core and mem overclocks after you know each one works alone.