Re: UTF-8 related display problem

[Kenichi Handa]

In article <5.1.0.14.2.20021007210058.031a7818@pop.puretec.de>, Marc Wilhelm 
Küster <kuester@saphor.net> writes:
> Please find attached a version of the file that has all ASCII letters (a-z, 
> A-Z) transformed into a's. All non-ASCII letters are left intact. The bug 
> still occurs.

> Just open the file as a UTF-8 text file. Note that the display ends right 
> in a Hebrew passage on line 2883 (the line begins with <a><?aaaa ^@-0?>

I found a bug that is revealed typically by decoding large
utf-8-dos file (your case).

I've just installed the attached fix in HEAD and RC.  Could
you please try it?

---
Ken'ichi HANDA
handa@m17n.org

2002-10-08  Kenichi Handa  <handa@m17n.org>

        * coding.c (code_convert_region): When we need more GAP for
        conversion, pay attention to the case that coding->produced is not
        greater than coding->consumed.

Index: coding.c
===================================================================
RCS file: /cvs/emacs/src/coding.c,v
retrieving revision 1.259
retrieving revision 1.260
diff -u -c -r1.259 -r1.260
cvs server: conflicting specifications of output style
*** coding.c    30 Sep 2002 06:28:31 -0000      1.259
--- coding.c    8 Oct 2002 00:57:59 -0000       1.260
***************
*** 5696,5704 ****
                REQUIRE + LEN_BYTE = LEN_BYTE * (NEW / ORIG)
                REQUIRE = LEN_BYTE * (NEW - ORIG) / ORIG
             Here, we are sure that NEW >= ORIG.  */
!         float ratio = coding->produced - coding->consumed;
!         ratio /= coding->consumed;
!         require = len_byte * ratio;
          first = 0;
        }
        if ((src - dst) < (require + 2000))
--- 5696,5714 ----
                REQUIRE + LEN_BYTE = LEN_BYTE * (NEW / ORIG)
                REQUIRE = LEN_BYTE * (NEW - ORIG) / ORIG
             Here, we are sure that NEW >= ORIG.  */
!         float ratio;
! 
!         if (coding->produced <= coding->consumed)
!           {
!             /* This happens because of CCL-based coding system with
!                eol-type CRLF.  */
!             require = 0;
!           }
!         else
!           {
!             ratio = (coding->produced - coding->consumed) / coding->consumed;
!             require = len_byte * ratio;
!           }
          first = 0;
        }
        if ((src - dst) < (require + 2000))