Re: CVS and unicode

[Pierre Asselin]

Christian Hujer <address@hidden> wrote:

> [ ... ]  The CRLF byte sequences are:
> ASCII: 0x0D 0x0A.
> UTF-8: 0x0D 0x0A.
> UTF-16 LE: 0x0D 0x00 0x0A 0x00.
> UTF-16 BE: 0x00 0x0D 0x00 0x0A.

> CVS will not interfer with any of these.
> UTF-16LE sequence will be split within the LF char. But since the next line 
> will be split at exactly the same point, this is not a problem for line 
> diffs.

An UTF-16 file can contain octet sequences like (xx 0D)(0A yy) that
CVS will mistake for line endings.  It will confuse diff, and if
a Windows client strips the "0D" upon commit and a Unix client
tries to update, the contents will look seriously scrambled...


-- 
pa at panix dot com