Re: UTF-8 related display problem

[Marc Wilhelm Küster]

> In article <5.1.0.14.2.20021007210058.031a7818@pop.puretec.de>, Marc 
> Wilhelm Küster <kuester@saphor.net> writes:
> > Please find attached a version of the file that has all ASCII letters 
> (a-z,
> > A-Z) transformed into a's. All non-ASCII letters are left intact. The bug
> > still occurs.
>
> > Just open the file as a UTF-8 text file. Note that the display ends right
> > in a Hebrew passage on line 2883 (the line begins with <a><?aaaa ^@-0?>
>
> I found a bug that is revealed typically by decoding large
> utf-8-dos file (your case).
>
> I've just installed the attached fix in HEAD and RC.  Could
> you please try it?

Thanks a lot! That is fabulous. I downloaded the head and tried it out 
(took me a bit of time because I didn't notice INSTALL-CVS at first...). 
The file now displays as it should.

Best regards,

Marc Küster


> ---
> Ken'ichi HANDA
> handa@m17n.org
>
> 2002-10-08  Kenichi Handa  <handa@m17n.org>
>
>         * coding.c (code_convert_region): When we need more GAP for
>         conversion, pay attention to the case that coding->produced is not
>         greater than coding->consumed.
>
> Index: coding.c
> ===================================================================
> RCS file: /cvs/emacs/src/coding.c,v
> retrieving revision 1.259
> retrieving revision 1.260
> diff -u -c -r1.259 -r1.260
> cvs server: conflicting specifications of output style
> *** coding.c    30 Sep 2002 06:28:31 -0000      1.259
> --- coding.c    8 Oct 2002 00:57:59 -0000       1.260
> ***************
> *** 5696,5704 ****
>                 REQUIRE + LEN_BYTE = LEN_BYTE * (NEW / ORIG)
>                 REQUIRE = LEN_BYTE * (NEW - ORIG) / ORIG
>              Here, we are sure that NEW >= ORIG.  */
> !         float ratio = coding->produced - coding->consumed;
> !         ratio /= coding->consumed;
> !         require = len_byte * ratio;
>           first = 0;
>         }
>         if ((src - dst) < (require + 2000))
> --- 5696,5714 ----
>                 REQUIRE + LEN_BYTE = LEN_BYTE * (NEW / ORIG)
>                 REQUIRE = LEN_BYTE * (NEW - ORIG) / ORIG
>              Here, we are sure that NEW >= ORIG.  */
> !         float ratio;
> !
> !         if (coding->produced <= coding->consumed)
> !           {
> !             /* This happens because of CCL-based coding system with
> !               eol-type CRLF.  */
> !             require = 0;
> !           }
> !         else
> !           {
> !             ratio = (coding->produced - coding->consumed) / 
> coding->consumed;
> !             require = len_byte * ratio;
> !           }
>           first = 0;
>         }
>         if ((src - dst) < (require + 2000))

*************************
Marc Wilhelm Küster
Saphor GmbH

Fronländer 22
D-72072 Tübingen

Tel.: (+49) / (0)7472 / 949 100
Fax: (+49) / (0)7472 / 949 114