Re: [Nmh-workers] scan - Funky output with utf-8

[valdis . kletnieks]

On Tue, 21 Mar 2017 12:02:51 -0000, Ralph Corderoy said:
(I appear to have only replied to Ralph.  Trying again)

> May we please have the output of
>
>     scan -version

% scan -version
scan -- nmh-1.6+dev [compiled on turing-police.cc.vt.edu at Tue Mar 21 01:01:40 
EDT 2017]

Did a 'git pull' before I built it..

>     locale
LANG=en_US.UTF-8
LC_CTYPE="en_US.UTF-8"
LC_NUMERIC="en_US.UTF-8"
LC_TIME="en_US.UTF-8"
LC_COLLATE=C
LC_MONETARY="en_US.UTF-8"
LC_MESSAGES="en_US.UTF-8"
LC_PAPER="en_US.UTF-8"
LC_NAME="en_US.UTF-8"
LC_ADDRESS="en_US.UTF-8"
LC_TELEPHONE="en_US.UTF-8"
LC_MEASUREMENT="en_US.UTF-8"
LC_IDENTIFICATION="en_US.UTF-8"
LC_ALL=


> > (Attaching a .png, cut-n-paste didn't quite get things right)
>
> A simple test here doesn't show the fault.
>
>     $ scan -version
>     scan -- nmh-1.6 [compiled on orac at 2016-11-15 11:46:57 +0000 Tue]
>     $
>     $ for w in 7 8 9; do
>     >     printf '%s\n' '' Beau£iful. |
>     >     scan -forma '<<%{body}>>' -file /dev/stdin -width $w
>     > done
>     <<Beau
>     <<Beau£
>     <<Beau£i
>     $

It appears to be in the same class of faults as another bug I reported a while
back with handling of null bytes in mhfixmsg - the failure symptoms appear to
be dependent on the amount of input.  You don't see a problem, when I try with
the entire mail it overruns by 400 bytes - I trim it down to just 40-50
chars past where the problem hits, it only overruns by 60 chars or so...

> It would be handy to have just the start of the undecoded body so we can
> reproduce the same UTF-8 runes, e.g. the quoted-printable or base64 of
> 867285's body.

Am attaching the form file and the problematic mail...

[~] scan -width 137 -form /tmp/timely -file /tmp/badmail
     1      *  Fri 17Mar       0 ??               Re: [PATCH v1 6/7] arm64: 
dts: rockchip: add dts file for RK3328 evaluation board <<? 2017?03?17? 00:18, 
Andre Przywara ??: > Hi Chen, > > On 16/03/17 01:45, address@hidden wrote: >> 
From: Chen Liang <address@hidden> >> >> This patch add rk3328-evb.dts for 
RK3328 evaluation board. >> Tested on RK3328 evb. >> >> Signed-off-by: Chen 
Liang <address@hidden> >> --- >> arch/arm64/boot/dts/rockchip/Makefile | 1 + >> 
arch/arm64/boot/dts/rockchip/rk3328-evb.dts | 57 +++++++++++++++++++++++++++++ 
>> 2 files changed, 58 insertions(+) >> create mode 100644 arch/

badmail
Description: badmail

timely
Description: timely