Reading string encoded as bytes object

Question

I'm trying to mask a string by encoding it like this:

>>> 'monkey'.encode('utf-16')
b'\xff\xfem\x00o\x00n\x00k\x00e\x00y\x00'

I then copy \xff\xfem\x00o\x00n\x00k\x00e\x00y\x00 and paste it into a file file.txt.

Then I want to read that file in and decode it.

>>> with open('file.txt', 'rb') as f:
>>>     bytes_object = next(f).strip() # assume file has only one line
>>> bytes_object
b'\\xff\\xfem\\x00o\\x00n\\x00k\\x00e\\x00y\\x00'

The \'s are being escaped... not what I want.

Decoding does not work as expected.

>>> bytes_object.decode('utf-16')
'硜晦硜敦屭へ漰硜〰屮へ欰硜〰履へ礰硜〰'

Clearly I am not understanding something here. Is there any way to read and decode a file that has the text \xff\xfem\x00o\x00n\x00k\x00e\x00y\x00?

Because if you copy and paste it copies the representation not the actual bytes. — juanpa.arrivillaga
– juanpa.arrivillaga, Commented May 8, 2017 at 23:51
Instead of copy-pasting into a text file, write the bytes directly to a file using Python. — juanpa.arrivillaga
– juanpa.arrivillaga, Commented May 8, 2017 at 23:54
Thanks @juanpa.arrivillaga, what I was looking for was eval(bytes_object).decode('utf-16') — Alex
– Alex, Commented May 9, 2017 at 4:18

Robᵩ · Accepted Answer · 2017-05-08 23:54:21Z

2

Copying and pasting the representation of the bytes object isn't a useful thing to do. If you want to create a UTF-16 file, try this:

with open('file.txt', 'wb') as fp:
    message = 'monkey'.encode('UTF16')
    fp.write(message)

answered May 8, 2017 at 23:54

Robᵩ

170k20 gold badges251 silver badges323 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

Alex Over a year ago

Thanks Rob, this is absolutely the right way to write the bytes to a file (as opposed to what I am doing above)

Francis Potter · Accepted Answer · 2017-05-09 00:26:36Z

1

The other answers are accurate, in that writing the bytes themselves to a file is more straightforward than copying and pasting the repr() form (with the backslash-x's).

But your question was about how to parse that form, and it is possible using eval(), which is basically the opposite of repr(). Here's an interactive version that doesn't use the file write/read but performs the operations in question.

>>> s = 'monkey'
>>> e = s.encode('utf-16')
>>> x = str(e)
>>> x
"b'\\xff\\xfem\\x00o\\x00n\\x00k\\x00e\\x00y\\x00'"
>>> eval(x)
b'\xff\xfem\x00o\x00n\x00k\x00e\x00y\x00'
>>> eval(x).decode('utf-16')
'monkey'

answered May 9, 2017 at 0:26

Francis Potter

1,6391 gold badge17 silver badges19 bronze badges

Collectives™ on Stack Overflow

Reading string encoded as bytes object

2 Answers 2

1 Comment

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

1 Comment

Comments

Your Answer

Sign up or log in

Post as a guest

Related