Using UTF-8 in Memory Reading/ Apps (c#)

[luciferc]

So i am trying to get to read UTF-8 Characters etc. from Wow for diffrent lang Packs.

And from websites as well.

So far i have

UTF8Encoding utf8 = new UTF8Encoding();

Byte[] byteArray = utf8.GetBytes(web.DownloadString("http://ru.wowhead.com/");
string rusdata = utf8.GetString(byteArray); //Convert to String again

"<title>Wowhead: **ŸÑ€**¸**º******»Ñ‹ **œÑƒ**»**³****Ñ€**° **±**µ**· ч**°Ñ‚**° **² **œÑƒ**»**³****Ñ€**µ.</title>" 

This is what it returns from the title

bunch of Mojibake

-Any help appreciated.

[Apoc]

You want to do this;

byte[] responseBuffer = Encoding.ASCII.GetBytes(web.DownloadString("http://ru.wowhead.com/"));
string rusData = Encoding.UTF8.GetString(responseBuffer);

web.DownloadString returns it as ASCII. So you need to break it down to bytes via the ASCII encoding, and return it to a string via the UTF8 encoder.

Edit: I must be really tired... anyway... the PROPER way to do this is as follows;

byte[] responseBuffer = web.DownloadData("http://ru.wowhead.com/");
string rusData = Encoding.UTF8.GetString(responseBuffer);

This avoids any byte shifting due to the encoding. (Downloading raw byte data never does any encoding conversions, so you don't lose anything.)

[bouh2]

That my function :

        private string Encode(string s)
        {
            byte[] l = Encoding.Default.GetBytes(s);
            return Encoding.UTF8.GetString(l);

        }

Example :

        public virtual string ObjectName
        {
            get { return Encode(WowReader.ReadASCIIString(WowReader.ReadUInt(WowReader.ReadUInt(BaseAddress + 0x1F4) + 0x078), 1024)); }
        }

(Yeah it's the same code xD)

[Apoc]

That my function :

        private string Encode(string s)
        {
            byte[] l = Encoding.Default.GetBytes(s);
            return Encoding.UTF8.GetString(l);

        }

Example :

        public virtual string ObjectName
        {
            get { return Encode(WowReader.ReadASCIIString(WowReader.ReadUInt(WowReader.ReadUInt(BaseAddress + 0x1F4) + 0x078), 1024)); }
        }

(Yeah it's the same code xD)

Mmmm... you actually have that reversed.

WoW uses UTF-8 encoding internally. Most (actually, I think all) Windows machines use ASCII as the default encoding. ASCII doesn't have the 'funky characters' that WoW uses for certain names in CN/RU/KR/etc. Always read your strings in as UTF-8, then convert them to ASCII if you need to. (Though, you're best off just leaving it as UTF-

[bouh2]

I did not understand everything but I need this function because when I search a unit name with accents (ex : Le déchireur) I read "Le d@/chireur" with ASCII encode (or others chars)

[Apoc]

I did not understand everything but I need this function because when I search a unit name with accents (ex : Le déchireur) I read "Le d@/chireur" with ASCII encode (or others chars)

Which proves what I just said. WoW uses UTF-8 encoding. You should be reading strings in as UTF-8, not as ASCII. Using BlackMagic, it will do the encoding for you, so you get the exact string as it's represented in WoW.

[bouh2]

Ok I did understand, Thank's for you ^^

[guizmows]

Thx it help me too.

[suicidity]

Erm..

Copy+Pasta from my Lib; This would return a utf-8/unicode string.

            public string ReadUnicode(Process Proc, int Address) //>> Returns a Unicode string <<
            {
                try
                {
                    ReadProcessMemory(Proc.Handle, Address, bytes, bytes.Length, 0);
                    return UnicodeDecoder(bytes);
                }
                catch { return null; }
            }

            string UnicodeDecoder(byte[] bytes) //>> The function that returns a string from bytes in a Unicode format <<
            {
                UnicodeEncoding unicode = new UnicodeEncoding();
                string _s = unicode.GetString(bytes, 0, bytes.Length);
                if (_s.IndexOf("\0") != -1)
                    _s = _s.Remove(_s.IndexOf("\0"), _s.Length - _s.IndexOf("\0")); //>> Remove any of our invalid positions <<
                return _s;
            }

[Cypher]

Erm..

Copy+Pasta from my Lib; This would return a utf-8/unicode string.

            public string ReadUnicode(Process Proc, int Address) //>> Returns a Unicode string <<
            {
                try
                {
                    ReadProcessMemory(Proc.Handle, Address, bytes, bytes.Length, 0);
                    return UnicodeDecoder(bytes);
                }
                catch { return null; }
            }

            string UnicodeDecoder(byte[] bytes) //>> The function that returns a string from bytes in a Unicode format <<
            {
                UnicodeEncoding unicode = new UnicodeEncoding();
                string _s = unicode.GetString(bytes, 0, bytes.Length);
                if (_s.IndexOf("\0") != -1)
                    _s = _s.Remove(_s.IndexOf("\0"), _s.Length - _s.IndexOf("\0")); //>> Remove any of our invalid positions <<
                return _s;
            }

My strings have embedded nulls. What now bitch! WHAT NOW!

[Nesox]

My strings have embedded nulls. What now bitch! WHAT NOW!

Nullable types a la C++!? kekeke

[Cypher]

Nullable types a la C++!? kekeke

No you nub, a string with embedded nulls (i.e. one that isn't null terminated but 'size' terminated).

[suicidity]

I wasn't expecting that response.

[Nesox]

No you nub, a string with embedded nulls (i.e. one that isn't null terminated but 'size' terminated).

Ok

using (var fillah = new Fillzor())
{
while(true){}
}

[Cypher]

Ok

using (var fillah = new Fillzor())
{
while(true){}
}

Lolwtf.

(filler)