RE: [Koha-zebra] Re: Unimarc, marc21, Unicode, and MARC::File::XML

[Tümer Garip]

Hi Adam,
You seem a bit offended that was not my intention, just frustation
sometimes
makes me use harsh words and translanting them to english may be too
harsh.

I do not need to send you any config+examples cause I tested this with
your default config files. I am attaching an xml record in utf-8

Briefly I had default configuration files and build zebra with xml
records. When I noticed the problem
I used yaz-client to see what was going on. On my log I could see data
going in the zebra was with encoding utf-8
While yaz client was returning xml with headers saying iso-8859-1 while
I could actually see the utf-8 characters as they show as hex in yaz
client.

I have retried this procedures just now and it seems the same. Just
adding encoding:UTF-8 to zebra.cfg and restarting the server you get
correct heading and correct data. Please note that server has to be
restarted but zebradb does not have to be rebuilt.

Thanks
Tumer

-----Original Message-----
From: Adam Dickmeiss [mailto:address@hidden 
Sent: Tuesday, March 21, 2006 9:00 PM
To: Tümer Garip
Cc: address@hidden; address@hidden
Subject: Re: [Koha-zebra] Re: Unimarc, marc21, Unicode, and
MARC::File::XML


Tümer Garip wrote:
> Hi,
> 
> This problem if I understood it correctly has got nothing to do with 
> mysql or perl it has to do with ZEBRA unless it is to do with UNIMARC 
> which I am not familiar with. As you know (Paul) I have an utf-8 
> version working.
> 
> I had the same problem from records coming from zebra and found out 
> that it is not doing what it is supposed to do unless you explicitly 
> set it to utf-8. You have to explicitly put "encoding utf-8" in all 
> your zebra config files especially the zebra.cfg and your .abs . 
> Otherwise unlike the documentation saying that zebra character code is

> automatically set by the xml encoding it DOES NOT.
I can't reproduce this (bug). Care to share a a config+example that 
illustrates this (Inserts an XML record from Perl in UTF-8) ?

> Perl send xml to zebra with encoding utf-8 on the header and utf-8 
> data in it. Zebra saves all the data in utf-8 but returns an xml 
> saying encoding iso8859-1 at the header and utf-8 characters in data. 
> No module can correct this as it is stupid.
Just need to know when the stupidity starts:-)

/ Adam

> I corrected the problem by adding encoding:UTF-8 in zebra.cfg, 
> record.abs, sort-string.chr
> 
> Hope it solves yours,
> 
> Tumer
> 
> 
> 
> _______________________________________________
> Koha-zebra mailing list
> address@hidden 
> http://lists.nongnu.org/mailman/listinfo/koha-zebra
>