From ys148558@sac.sfbay.sun.com Mon Jul 7 00:20:02 2008 Received: from sunmail3mpk.sfbay.sun.com (sunmail3mpk.SFBay.Sun.COM [129.146.11.52]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id m677K1s7002485 for ; Mon, 7 Jul 2008 00:20:01 -0700 (PDT) Received: from nwk-avmta-1.SFBay.Sun.COM (nwk-avmta-1.SFBay.Sun.COM [129.146.11.74]) by sunmail3mpk.sfbay.sun.com (8.13.7+Sun/8.13.7/ENSMAIL,v2.2) with ESMTP id m677K1q5014998; Mon, 7 Jul 2008 00:20:01 -0700 (PDT) Received: from pmxchannel-daemon.nwk-avmta-1.sfbay.Sun.COM by nwk-avmta-1.sfbay.Sun.COM (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0K3M00005KDBTB00@nwk-avmta-1.sfbay.Sun.COM>; Mon, 07 Jul 2008 00:19:59 -0700 (PDT) Received: from dm-sfbay-02.sfbay.sun.com ([129.146.11.31]) by nwk-avmta-1.sfbay.Sun.COM (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0K3M00M7WKDAXSE0@nwk-avmta-1.sfbay.Sun.COM>; Mon, 07 Jul 2008 00:19:58 -0700 (PDT) Received: from sac.sfbay.sun.com (new-sac.SFBay.Sun.COM [129.146.175.65]) by dm-sfbay-02.sfbay.sun.com (8.13.8+Sun/8.13.8/ENSMAIL,v2.2) with ESMTP id m677JvvG009525; Mon, 07 Jul 2008 00:19:57 -0700 (PDT) Received: from sac.sfbay.sun.com (localhost [127.0.0.1]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id m677JtZG002473; Mon, 07 Jul 2008 00:19:55 -0700 (PDT) Received: (from ys148558@localhost) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8/Submit) id m677Jt7f002469; Mon, 07 Jul 2008 00:19:55 -0700 (PDT) Date: Mon, 07 Jul 2008 00:19:55 -0700 (PDT) From: Yong Young Sun Subject: Adding Malaysian, Indonesian, Vietnamese UTF-8 locales [PSARC/2008/420 FastTrack timeout 07/11/2008] To: PSARC-ext@sun.com Cc: indiana-g11n@sun.com, wei.xue@sun.com Message-id: <200807070719.m677Jt7f002469@sac.sfbay.sun.com> Content-transfer-encoding: 7BIT X-PMX-Version: 5.4.1.325704 Status: RO Content-Length: 5767 Template Version: @(#)sac_nextcase 1.66 04/17/08 SMI This information is Copyright 2008 Sun Microsystems 1. Introduction 1.1. Project/Component Working Name: Adding Malaysian, Indonesian, Vietnamese UTF-8 locales 1.2. Name of Document Author/Supplier: Author: Wei Xue 1.3 Date of This Document: 07 July, 2008 2. Project Summary 2.1. Project Description: Add the following South East Asia locales support to current OpenSolaris. Malaysian: ms_MY.UTF-8 Indonesian: id_ID.UTF-8 Vietnamese: vi_VN.UTF-8 Add VISCII and TCVN code conversion feature in iconv library. So that the bidirectional conversion between VISCII,TCVN, and UTF-8/UCS4(2) will be supported in iconv(1) and iconv(3). 3. Business Summary 3.5. Opportunity Window/Exposure: Solaris Nevada Project Indiana 4. Technical Description 4.1. Details: 1> To create a new locale support in Solaris, following locale data need to be defined. LC_CTYPE LC_COLLATE LC_NUMERIC LC_TIME LC_MONETARY LC_MESSAGE Because CLDR(Unicode's Common Locale Data Repository)[1] is so far the largest and most extensive standard repository of locale data. The new UTF-8 locales: ms_MY.UTF-8, id_ID.UTF-8 and vi_VN.UTF-8 will be created with standard locale data according to CLDR. The l10n(localization) messages of these three locale languages are not covered by this project. As a reference, here are some information about l10n messages status for these three languages: * CLI (Command Line Interface) messages: The localization for Solaris system libraries and utilities in Malaysian, Indonesian and Vietnamese are not available. * L10N status for major GUI components by communities Malaysian Indonesian Vietnamese -------------------------------------------------------------- Gnome[3] Yes Yes Yes Firefox [10] N/A Yes N/A Thunderbird [11] N/A N/A N/A Openoffice [14] Yes [12] N/A Yes [13] The localization contents for these three languages of gnome had been integrated in package SUNWgnome-l10nmessages-extra on Solaris. 2> To enhance iconv modules for Vietnamese encodings: The most popular encoding standards for Vietnamese are : VISCII [8] TCVN(5712) [7] CP1258 [9] CP1258 is the standard of Microsoft Windows. It is supported by current Solaris iconv. If Vietnamese locale is supported, the VISCII, TCVN encoding conversion should be supported as well. It includes details as following: VISCII <-> UTF-8/UCS-4/UCS-4BE/UCS-4LE/UCS-2/UCS-2BE/UCS-2LE TCVN <-> UTF-8/UCS-4/UCS-4BE/UCS-4LE/UCS-2/UCS-2BE/UCS-2LE VISCII <-> TCVN (Note: <-> means from and to.) Since Malaysia and Indonesia language characters belong to ISO8859-1[2] standard, they do not need extra iconv modules. 4.5. Interfaces: 1> For function: iconv_t iconv_open(const char *tocode, const char *fromcode) The parameters tocode and fromcode will support: VISCII, TCVN(TCVN5712). 2> For utility: iconv [-cs] -f frommap -t tomap [file]... "frommap" and "tomap" will support VISCII, TCVN(TCVN5712). 4.6. Doc Impact: None. 4.7. Admin/Config Impact: None. 4.8. HA Impact: None. 4.9. I18N/L10N Impact: No impact to current XI18N. 4.10. Packaging & Delivery: locale enabling packages (new packages): SUNWlang-ms SUNWlang-id SUNWlang-vi iconv packages (updated packages): SUNWiconv-extra SUNWiconv-unicode 4.11. Security Impact: None. 4.12. Dependencies: 5. Reference Documents: [1] Unicode CLDR Project: Common Locale Data Repository http://unicode.org/cldr [2] ISO/IEC 8859-1:1998: http://anubis.dkuug.dk/JTC1/SC2/WG3/docs/n411.pdf [3] Gnome l10n message language list: http://l10n.gnome.org/languages/ [4] Vietnamese Unicode FAQ: http://vietunicode.sourceforge.net/ [5] Vietnamese encoding conversion-tables: http://www.haible.de/bruno/charsets/conversion-tables/Vietnamese.html [6] The TCVN 6909 standard: http://www.informatik.uni-leipzig.de/~duc/software/misc/tcvn6909.pdf [7] TCVN 5712:1993 standard: http://www.informatik.uni-leipzig.de/~duc/software/misc/tcvn.txt [8] rfc1456 - Conventions for Encoding the Vietnamese Language http://tools.ietf.org/html/rfc1456 [9] Windows 1258 reference: http://www.microsoft.com/globaldev/reference/sbcs/1258.mspx [10] Firefox is available in over 45 languages: http://www.mozilla.com/en-US/firefox/all.html [11] Available Thunderbird languages: http://www.mozilla.com/en-US/thunderbird/all.html [12] Malaysian openoffice website: http://ms.openoffice.org/ [13] Vietnamese openoffice website: http://vi.openoffice.org/ [14] Language localization status of openoffice http://wiki.services.openoffice.org/wiki/Languages 6. Resources and Schedule 6.4. Steering Committee requested information 6.4.1. Consolidation C-team Name: Globalization 6.5. ARC review type: FastTrack 6.6. ARC Exposure: open From roland.mainz@nrubsig.org Mon Jul 7 02:35:37 2008 Received: from sunmail4.singapore.sun.com (sunmail4.Singapore.Sun.COM [129.158.71.19]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id m679Zapw007022 for ; Mon, 7 Jul 2008 02:35:37 -0700 (PDT) Received: from brm-avmta-1.central.sun.com (brm-avmta-1.Central.Sun.COM [129.147.4.11]) by sunmail4.singapore.sun.com (8.13.4+Sun/8.13.3/ENSMAIL,v2.2) with ESMTP id m679ZYkU008475; Mon, 7 Jul 2008 17:35:36 +0800 (SGT) Received: from pmxchannel-daemon.brm-avmta-1.central.sun.com by brm-avmta-1.central.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0K3M00407QN9YB00@brm-avmta-1.central.sun.com>; Mon, 07 Jul 2008 03:35:33 -0600 (MDT) Received: from brmea-mail-4.sun.com ([192.18.98.36]) by brm-avmta-1.central.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0K3M001YZQN99P10@brm-avmta-1.central.sun.com>; Mon, 07 Jul 2008 03:35:33 -0600 (MDT) Received: from relay13i.sun.com (ip123.net129179-4.block1.us.syntegra.com [129.179.4.123]) by brmea-mail-4.sun.com (8.13.6+Sun/8.12.9) with ESMTP id m679ZW2i001970; Mon, 07 Jul 2008 09:35:33 +0000 (GMT) Received: from mmp14es.mmp.us.syntegra.com ([160.41.208.14] [160.41.208.14]) by relay13i.sun.com with ESMTP id BT-MMP-791720; Mon, 07 Jul 2008 09:35:32 +0000 (Z) Received: from relay11i.sun.com (relay11i.sun.com [129.179.4.121]) by mmp14es.mmp.us.syntegra.com with ESMTP id BT-MMP-30517; Mon, 07 Jul 2008 09:35:32 +0000 (Z) Received: from mail-in-10.arcor-online.net ([151.189.21.50] [151.189.21.50]) by relay1i.sun.com with ESMTP id BT-MMP-9949983; Mon, 07 Jul 2008 09:35:31 +0000 (Z) Received: from mail-in-19-z2.arcor-online.net (mail-in-19-z2.arcor-online.net [151.189.8.36]) by mail-in-10.arcor-online.net (Postfix) with ESMTP id DE2121F50A0; Mon, 07 Jul 2008 11:35:20 +0200 (CEST) Received: from mail-in-13.arcor-online.net (mail-in-13.arcor-online.net [151.189.21.53]) by mail-in-19-z2.arcor-online.net (Postfix) with ESMTP id C97DF6BD92; Mon, 07 Jul 2008 11:35:20 +0200 (CEST) Received: from jupiterb48.nrubsig.org (dslb-084-059-055-037.pools.arcor-ip.net [84.59.55.37]) by mail-in-13.arcor-online.net (Postfix) with ESMTP id 0819631D8E3; Mon, 07 Jul 2008 11:35:15 +0200 (CEST) Received: from nrubsig.org (localhost [127.0.0.1]) by jupiterb48.nrubsig.org (8.13.8+Sun/8.13.8) with ESMTP id m679ZCfU001093; Mon, 07 Jul 2008 11:35:13 +0200 (CEST) Date: Mon, 07 Jul 2008 11:35:12 +0200 From: Roland Mainz Subject: Re: Adding Malaysian, Indonesian, Vietnamese UTF-8 locales [PSARC/2008/420FastTrack timeout 07/11/2008] Sender: gisburn@jupiterb48.nrubsig.org To: Yong Young Sun Cc: PSARC-ext@sun.com, indiana-g11n@sun.com, wei.xue@sun.com Message-id: <4871E350.A1C40541@nrubsig.org> MIME-version: 1.0 X-Mailer: Mozilla 4.76 [en] (X11; U; SunOS 5.11 sun4u) Content-type: text/plain; charset=us-ascii Content-transfer-encoding: 7BIT X-Accept-Language: en X-PMX-Version: 5.4.1.325704 X-Brightmail-Tracker: AAAAAA== X-Virus-Scanned: ClamAV 0.93/7407/Mon Jun 9 04:21:00 2008 on mail-in-13.arcor-online.net X-Virus-Status: Clean X-Antispam: No, score=0.0/5.0, scanned in 0.072sec at (localhost [127.0.0.1]) by smf-spamd v1.3.1 - http://smfs.sf.net/ References: <200807070719.m677Jt7f002469@sac.sfbay.sun.com> Status: RO Content-Length: 2123 Yong Young Sun wrote: [snip] > 2. Project Summary > 2.1. Project Description: > Add the following South East Asia locales support to current > OpenSolaris. > Malaysian: ms_MY.UTF-8 > Indonesian: id_ID.UTF-8 > Vietnamese: vi_VN.UTF-8 Are there any plans to add a "vi_VN.TCVN" locale for interoperabilty with Linux and other operating systems ? > Add VISCII and TCVN code conversion feature in iconv library. So that > the bidirectional conversion between VISCII,TCVN, and UTF-8/UCS4(2) > will be supported in iconv(1) and iconv(3). > > 3. Business Summary > 3.5. Opportunity Window/Exposure: > Solaris Nevada > Project Indiana > > 4. Technical Description > 4.1. Details: [snip] > * CLI (Command Line Interface) messages: > The localization for Solaris system libraries and utilities in Malaysian, > Indonesian and Vietnamese are not available. Will this be changed over time ? > * L10N status for major GUI components by communities > > Malaysian Indonesian Vietnamese > -------------------------------------------------------------- > Gnome[3] Yes Yes Yes > Firefox [10] N/A Yes N/A > Thunderbird [11] N/A N/A N/A > Openoffice [14] Yes [12] N/A Yes [13] > > The localization contents for these three languages of gnome had been > integrated in package SUNWgnome-l10nmessages-extra on Solaris. One thing which is AFAIK missing here is the support status for X11 terminal emulators, e.g. can characters in these locales properly displayed in: 1) xterm 2) dtterm 3) gnome-terminal (this may be optional since gnome-terminal has _huge_ issues with non-ASCII characters anyway) ---- Bye, Roland -- __ . . __ (o.\ \/ /.o) roland.mainz@nrubsig.org \__\/\/__/ MPEG specialist, C&&JAVA&&Sun&&Unix programmer /O /==\ O\ TEL (;O/ \/ \O;) From Yong.Sun@Sun.COM Mon Jul 7 03:41:50 2008 Received: from sunmail5.uk.sun.com (sunmail5.UK.Sun.COM [129.156.85.165]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id m67Afnei007889 for ; Mon, 7 Jul 2008 03:41:50 -0700 (PDT) Received: from nwk-avmta-2.sfbay.sun.com (nwk-avmta-2.SFBay.Sun.COM [129.145.155.6]) by sunmail5.uk.sun.com (8.13.8+Sun/8.13.8/ENSMAIL,v2.2) with ESMTP id m67AfmG2019705; Mon, 7 Jul 2008 11:41:49 +0100 (BST) Received: from pmxchannel-daemon.nwk-avmta-2.sfbay.sun.com by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0K3M00K07TPKGR00@nwk-avmta-2.sfbay.sun.com>; Mon, 07 Jul 2008 03:41:44 -0700 (PDT) Received: from sineb-mail-1.sun.com ([192.18.19.6]) by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0K3M00FOZTPH0A50@nwk-avmta-2.sfbay.sun.com>; Mon, 07 Jul 2008 03:41:44 -0700 (PDT) Received: from fe-apac-06.sun.com (fe-apac-06.sun.com [192.18.19.177] (may be forged)) by sineb-mail-1.sun.com (8.13.6+Sun/8.12.9) with ESMTP id m67Ag83K024642; Mon, 07 Jul 2008 10:42:08 +0000 (GMT) Received: from conversion-daemon.mail-apac.sun.com by mail-apac.sun.com (Sun Java System Messaging Server 6.2-6.01 (built Apr 3 2006)) id <0K3M00G01THSPW00@mail-apac.sun.com> (original mail from Yong.Sun@Sun.COM) ; Mon, 07 Jul 2008 18:39:32 +0800 (SGT) Received: from yongmini.local ([129.150.144.28]) by mail-apac.sun.com (Sun Java System Messaging Server 6.2-6.01 (built Apr 3 2006)) with ESMTPSA id <0K3M009OMTLT8ADV@mail-apac.sun.com>; Mon, 07 Jul 2008 18:39:32 +0800 (SGT) Date: Mon, 07 Jul 2008 18:41:39 +0800 From: Yong Sun Subject: Re: Adding Malaysian, Indonesian, Vietnamese UTF-8 locales [PSARC/2008/420FastTrack timeout 07/11/2008] In-reply-to: <4871E350.A1C40541@nrubsig.org> Sender: Yong.Sun@Sun.COM To: Roland Mainz Cc: Yong Young Sun , PSARC-ext@Sun.COM, indiana-g11n@Sun.COM, Wei.Xue@Sun.COM Message-id: <4871F2E3.1060909@Sun.COM> MIME-version: 1.0 Content-type: text/plain; format=flowed; charset=UTF-8 Content-transfer-encoding: 8BIT X-PMX-Version: 5.4.1.325704 References: <200807070719.m677Jt7f002469@sac.sfbay.sun.com> <4871E350.A1C40541@nrubsig.org> User-Agent: Thunderbird 2.0.0.14 (Macintosh/20080421) Status: RO Content-Length: 2614 Hi, Roland, This project is targeting to Indiana 2008.11 release, UTF-8 locales have higher priority than legacy locales, we will gather more information/feedback to see if we have future plans for legacy locales. Regarding to the localization of CLI messages, yes, it would be changed over time, hopefully by the opensolaris l10n communities. And for you last question, X11 terminal emulators, I believe the answer is Yes, since they are all unicode characters, and we will ship the proper fonts. Regards, Roland Mainz 写道: > Yong Young Sun wrote: > [snip] > >> 2. Project Summary >> 2.1. Project Description: >> Add the following South East Asia locales support to current >> OpenSolaris. >> Malaysian: ms_MY.UTF-8 >> Indonesian: id_ID.UTF-8 >> Vietnamese: vi_VN.UTF-8 >> > > Are there any plans to add a "vi_VN.TCVN" locale for interoperabilty > with Linux and other operating systems ? > > >> Add VISCII and TCVN code conversion feature in iconv library. So that >> the bidirectional conversion between VISCII,TCVN, and UTF-8/UCS4(2) >> will be supported in iconv(1) and iconv(3). >> >> 3. Business Summary >> 3.5. Opportunity Window/Exposure: >> Solaris Nevada >> Project Indiana >> >> 4. Technical Description >> 4.1. Details: >> > [snip] > >> * CLI (Command Line Interface) messages: >> The localization for Solaris system libraries and utilities in Malaysian, >> Indonesian and Vietnamese are not available. >> > > Will this be changed over time ? > > >> * L10N status for major GUI components by communities >> >> Malaysian Indonesian Vietnamese >> -------------------------------------------------------------- >> Gnome[3] Yes Yes Yes >> Firefox [10] N/A Yes N/A >> Thunderbird [11] N/A N/A N/A >> Openoffice [14] Yes [12] N/A Yes [13] >> >> The localization contents for these three languages of gnome had been >> integrated in package SUNWgnome-l10nmessages-extra on Solaris. >> > > One thing which is AFAIK missing here is the support status for X11 > terminal emulators, e.g. can characters in these locales properly > displayed in: > 1) xterm > 2) dtterm > 3) gnome-terminal (this may be optional since gnome-terminal has _huge_ > issues with non-ASCII characters anyway) > > ---- > > Bye, > Roland > > From roland.mainz@nrubsig.org Mon Jul 7 04:48:34 2008 Received: from newsunmail1brm.central.sun.com (newsunmail1brm.Central.Sun.COM [129.147.62.245]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id m67BmY3I008622 for ; Mon, 7 Jul 2008 04:48:34 -0700 (PDT) Received: from brm-avmta-1.central.sun.com (brm-avmta-1.Central.Sun.COM [129.147.4.11]) by newsunmail1brm.central.sun.com (8.13.7+Sun/8.13.7/ENSMAIL,v2.2) with ESMTP id m67BmWxT028455; Mon, 7 Jul 2008 05:48:32 -0600 (MDT) Received: from pmxchannel-daemon.brm-avmta-1.central.sun.com by brm-avmta-1.central.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0K3M00F2BWSW8R00@brm-avmta-1.central.sun.com>; Mon, 07 Jul 2008 05:48:32 -0600 (MDT) Received: from brmea-mail-2.sun.com ([192.18.98.43]) by brm-avmta-1.central.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0K3M00103WSU9R80@brm-avmta-1.central.sun.com>; Mon, 07 Jul 2008 05:48:30 -0600 (MDT) Received: from relay13i.sun.com (ip123.net129179-4.block1.us.syntegra.com [129.179.4.123]) by brmea-mail-2.sun.com (8.13.6+Sun/8.12.9) with ESMTP id m67Bl52E000186; Mon, 07 Jul 2008 11:48:30 +0000 (GMT) Received: from mmp11es.mmp.us.syntegra.com ([160.41.208.11] [160.41.208.11]) by relay13i.sun.com with ESMTP id BT-MMP-795566; Mon, 07 Jul 2008 11:48:30 +0000 (Z) Received: from relay18i.sun.com (relay18i.sun.com [129.179.4.128]) by mmp11es.mmp.us.syntegra.com with ESMTP id BT-MMP-5211400; Mon, 07 Jul 2008 11:48:29 +0000 (Z) Received: from mail-in-04.arcor-online.net ([151.189.21.44] [151.189.21.44]) by relay1ib.sun.com with ESMTP id BT-MMP-20291320; Mon, 07 Jul 2008 11:48:29 +0000 (Z) Received: from mail-in-16-z2.arcor-online.net (mail-in-16-z2.arcor-online.net [151.189.8.33]) by mail-in-04.arcor-online.net (Postfix) with ESMTP id 0600E17F492; Mon, 07 Jul 2008 13:48:28 +0200 (CEST) Received: from mail-in-10.arcor-online.net (mail-in-10.arcor-online.net [151.189.21.50]) by mail-in-16-z2.arcor-online.net (Postfix) with ESMTP id E551825411D; Mon, 07 Jul 2008 13:48:27 +0200 (CEST) Received: from jupiterb48.nrubsig.org (dslb-084-059-055-037.pools.arcor-ip.net [84.59.55.37]) by mail-in-10.arcor-online.net (Postfix) with ESMTP id 4C32424D4C1; Mon, 07 Jul 2008 13:48:26 +0200 (CEST) Received: from nrubsig.org (localhost [127.0.0.1]) by jupiterb48.nrubsig.org (8.13.8+Sun/8.13.8) with ESMTP id m67BmO77001121; Mon, 07 Jul 2008 13:48:24 +0200 (CEST) Date: Mon, 07 Jul 2008 13:48:24 +0200 From: Roland Mainz Subject: Re: Adding Malaysian, Indonesian,Vietnamese UTF-8 locales [PSARC/2008/420FastTrack timeout 07/11/2008] Sender: gisburn@jupiterb48.nrubsig.org To: Yong Sun Cc: Yong Young Sun , PSARC-ext@sun.com, indiana-g11n@sun.com, Wei.Xue@sun.com Message-id: <48720288.89AE84F0@nrubsig.org> MIME-version: 1.0 X-Mailer: Mozilla 4.76 [en] (X11; U; SunOS 5.11 sun4u) Content-type: text/plain; charset=us-ascii Content-transfer-encoding: 7BIT X-Accept-Language: en X-PMX-Version: 5.4.1.325704 X-Brightmail-Tracker: AAAAAA== X-Virus-Scanned: ClamAV 0.93/7407/Mon Jun 9 04:21:00 2008 on mail-in-10.arcor-online.net X-Virus-Status: Clean X-Antispam: No, score=0.0/5.0, scanned in 0.068sec at (localhost [127.0.0.1]) by smf-spamd v1.3.1 - http://smfs.sf.net/ References: <200807070719.m677Jt7f002469@sac.sfbay.sun.com> <4871E350.A1C40541@nrubsig.org> <4871F2E3.1060909@Sun.COM> Status: RO Content-Length: 1543 Yong Sun wrote: > This project is targeting to Indiana 2008.11 release, UTF-8 locales have > higher priority than legacy locales, Right (except stuff like "zh_CN.GB18030" which still should be preferred over the UTF-8 variant since the matching goverment requires it (and is very picky about it)) ... > we will gather more > information/feedback to see if we have future plans for legacy locales. Ok... my main concern is "interoperabilty", e.g. what happens if I am running something like the "ms_MY.UTF-8" or "vi_VN.UTF-8" locale and then do a slogin into a Linux machine ? > Regarding to the localization of CLI messages, yes, it would be changed > over time, hopefully by the opensolaris l10n communities. > > And for you last question, X11 terminal emulators, I believe the answer > is Yes, since they are all unicode characters, and we will ship the > proper fonts. Please check whether you have _fixed_width_ fonts with all matching point populated. Many fonts for these languages are either proportional or don't have all points populated. BTW: What about keyboard mappings and input methods (e.g. VIQR, VNI, TELEX etc, for Vienamese), e.g. how does an user type characters for these languages, either within Gnome or without having Gnome installed (e.g. there is stuff like http://xvnkb.sourceforge.net/ for plain X11 applications) ? ---- Bye, Roland -- __ . . __ (o.\ \/ /.o) roland.mainz@nrubsig.org \__\/\/__/ MPEG specialist, C&&JAVA&&Sun&&Unix programmer /O /==\ O\ TEL (;O/ \/ \O;) From Yong.Sun@sun.com Mon Jul 7 10:00:16 2008 Received: from sunmail5.uk.sun.com (sunmail5.UK.Sun.COM [129.156.85.165]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id m67H0F8d018308 for ; Mon, 7 Jul 2008 10:00:15 -0700 (PDT) Received: from nwk-avmta-2.sfbay.sun.com (nwk-avmta-2.SFBay.Sun.COM [129.145.155.6]) by sunmail5.uk.sun.com (8.13.8+Sun/8.13.8/ENSMAIL,v2.2) with ESMTP id m67GxwEi026927; Mon, 7 Jul 2008 18:00:14 +0100 (BST) Received: from pmxchannel-daemon.nwk-avmta-2.sfbay.sun.com by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0K3N00D07B8D3M00@nwk-avmta-2.sfbay.sun.com>; Mon, 07 Jul 2008 10:00:13 -0700 (PDT) Received: from sineb-mail-1.sun.com ([192.18.19.6]) by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0K3N0055QB8AZ9C0@nwk-avmta-2.sfbay.sun.com>; Mon, 07 Jul 2008 10:00:12 -0700 (PDT) Received: from fe-apac-06.sun.com (fe-apac-06.sun.com [192.18.19.177] (may be forged)) by sineb-mail-1.sun.com (8.13.6+Sun/8.12.9) with ESMTP id m67H0bZP004189; Mon, 07 Jul 2008 17:00:37 +0000 (GMT) Received: from conversion-daemon.mail-apac.sun.com by mail-apac.sun.com (Sun Java System Messaging Server 6.2-6.01 (built Apr 3 2006)) id <0K3N00801B1ML500@mail-apac.sun.com> (original mail from Yong.Sun@Sun.COM) ; Tue, 08 Jul 2008 00:58:00 +0800 (SGT) Received: from [10.0.1.199] ([123.116.97.243]) by mail-apac.sun.com (Sun Java System Messaging Server 6.2-6.01 (built Apr 3 2006)) with ESMTPSA id <0K3N009LZB4M8G29@mail-apac.sun.com>; Tue, 08 Jul 2008 00:58:00 +0800 (SGT) Date: Tue, 08 Jul 2008 00:59:34 +0800 From: Yong Sun Subject: Re: Adding Malaysian, Indonesian,Vietnamese UTF-8 locales [PSARC/2008/420FastTrack timeout 07/11/2008] In-reply-to: <48720288.89AE84F0@nrubsig.org> Sender: Yong.Sun@sun.com To: Roland Mainz Cc: Yong Young Sun , PSARC-ext@sun.com, indiana-g11n@sun.com, Wei.Xue@sun.com Message-id: <48724B76.1070000@Sun.COM> MIME-version: 1.0 Content-type: text/plain; format=flowed; charset=ISO-8859-1 Content-transfer-encoding: 7BIT X-PMX-Version: 5.4.1.325704 References: <200807070719.m677Jt7f002469@sac.sfbay.sun.com> <4871E350.A1C40541@nrubsig.org> <4871F2E3.1060909@Sun.COM> <48720288.89AE84F0@nrubsig.org> User-Agent: Thunderbird 2.0.0.14 (X11/20080519) Status: RO Content-Length: 2781 Hi, Roland, Thank you very much for the comments, and please see my reply in-line, Roland Mainz wrote: > Yong Sun wrote: > >> This project is targeting to Indiana 2008.11 release, UTF-8 locales have >> higher priority than legacy locales, >> > > Right (except stuff like "zh_CN.GB18030" which still should be preferred > over the UTF-8 variant since the matching goverment requires it (and is > very picky about it)) ... > > >> we will gather more >> information/feedback to see if we have future plans for legacy locales. >> > > Ok... my main concern is "interoperabilty", e.g. what happens if I am > running something like the "ms_MY.UTF-8" or "vi_VN.UTF-8" locale and > then do a slogin into a Linux machine ? > I may not understand your question well, if you meant with same UTF-8 locale, there should be no problem; if target env is in legacy locale, we could set charset (Menu->Terminal->Set Character Encoding) in gnome-terminal. For xterm or dtterm, we have to manually use iconv(1) to convert the output to UTF-8 encoding. Actually, it's always a question, if local/remote locales are different. BTW, more and more linux distributions only ship UTF-8 locales, user needs extra steps to generate or install legacy locales. > >> Regarding to the localization of CLI messages, yes, it would be changed >> over time, hopefully by the opensolaris l10n communities. >> >> And for you last question, X11 terminal emulators, I believe the answer >> is Yes, since they are all unicode characters, and we will ship the >> proper fonts. >> > > Please check whether you have _fixed_width_ fonts with all matching > point populated. Many fonts for these languages are either proportional > or don't have all points populated. > Malaysian, Indonesian use Latin characters, no special fonts required. For Vietnamese, from http://vietunicode.sourceforge.net/main.html#UNICODE-COMPLIANT%20FONTS, we could see many unicode fonts have cover Vietnamese charset. William, please double check the available fonts. > BTW: What about keyboard mappings and input methods (e.g. VIQR, VNI, > TELEX etc, for Vienamese), e.g. how does an user type characters for > these languages, either within Gnome or without having Gnome installed > (e.g. there is stuff like http://xvnkb.sourceforge.net/ for plain X11 > applications) ? > We already have VIQR input method in IIIMF, and you could add it via iiim-properties(1). IIIMF could serve gtk application, or plain X11 application via XIM interface. For Telex and VNI input methods, they are supported in scim-m17n (www.scim-im.org, www.m17n.org), we are going to integrate SCIM to Solaris/OpenSolaris recently, and planed to integrate m17n and scim-m17n a little later. > ---- > > Bye, > Roland > > From Yong.Sun@sun.com Sun Jul 13 22:51:40 2008 Received: from sunmail2sca.sfbay.sun.com (sunmail2sca.SFBay.Sun.COM [129.145.155.234]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id m6E5peJp022079 for ; Sun, 13 Jul 2008 22:51:40 -0700 (PDT) Received: from brm-avmta-1.central.sun.com (brm-avmta-1.Central.Sun.COM [129.147.4.11]) by sunmail2sca.sfbay.sun.com (8.13.7+Sun/8.13.7/ENSMAIL,v2.2) with ESMTP id m6E5paRT018858; Sun, 13 Jul 2008 22:51:39 -0700 (PDT) Received: from pmxchannel-daemon.brm-avmta-1.central.sun.com by brm-avmta-1.central.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0K3Z00H03EY3W200@brm-avmta-1.central.sun.com>; Sun, 13 Jul 2008 23:51:39 -0600 (MDT) Received: from sineb-mail-2.sun.com ([192.18.19.7]) by brm-avmta-1.central.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0K3Z000W8EY1ED70@brm-avmta-1.central.sun.com>; Sun, 13 Jul 2008 23:51:38 -0600 (MDT) Received: from fe-apac-06.sun.com (fe-apac-06.sun.com [192.18.19.177] (may be forged)) by sineb-mail-2.sun.com (8.13.6+Sun/8.12.9) with ESMTP id m6E5qhcJ026513; Mon, 14 Jul 2008 05:52:43 +0000 (GMT) Received: from conversion-daemon.mail-apac.sun.com by mail-apac.sun.com (Sun Java System Messaging Server 6.2-6.01 (built Apr 3 2006)) id <0K3Z00501ETJ5S00@mail-apac.sun.com> (original mail from Yong.Sun@Sun.COM) ; Mon, 14 Jul 2008 13:49:21 +0800 (SGT) Received: from [129.158.150.23] by mail-apac.sun.com (Sun Java System Messaging Server 6.2-6.01 (built Apr 3 2006)) with ESMTPSA id <0K3Z009H0EU78A50@mail-apac.sun.com>; Mon, 14 Jul 2008 13:49:21 +0800 (SGT) Date: Mon, 14 Jul 2008 13:51:20 +0800 From: Yong Sun Subject: Re: Adding Malaysian, Indonesian, Vietnamese UTF-8 locales [PSARC/2008/420 FastTrack timeout 07/11/2008] In-reply-to: <200807070719.m677Jt7f002469@sac.sfbay.sun.com> Sender: Yong.Sun@sun.com To: Yong Young Sun Cc: PSARC-ext@sun.com, indiana-g11n@sun.com, Wei.Xue@sun.com Message-id: <487AE958.3010509@Sun.COM> MIME-version: 1.0 Content-type: text/plain; format=flowed; charset=UTF-8 Content-transfer-encoding: 7BIT X-PMX-Version: 5.4.1.325704 References: <200807070719.m677Jt7f002469@sac.sfbay.sun.com> User-Agent: Thunderbird 2.0.0.14 (X11/20080616) Status: RO Content-Length: 6311 Hi, guys, Since we have reached the duedate, and no negative comments, I'd like to close this case as "closed approved fast-track 07/11/2008". Thank you very much for the support! Regards, Yong Young Sun wrote: > Template Version: @(#)sac_nextcase 1.66 04/17/08 SMI > This information is Copyright 2008 Sun Microsystems > 1. Introduction > 1.1. Project/Component Working Name: > Adding Malaysian, Indonesian, Vietnamese UTF-8 locales > 1.2. Name of Document Author/Supplier: > Author: Wei Xue > 1.3 Date of This Document: > 07 July, 2008 > > 2. Project Summary > 2.1. Project Description: > Add the following South East Asia locales support to current > OpenSolaris. > Malaysian: ms_MY.UTF-8 > Indonesian: id_ID.UTF-8 > Vietnamese: vi_VN.UTF-8 > > Add VISCII and TCVN code conversion feature in iconv library. So that > the bidirectional conversion between VISCII,TCVN, and UTF-8/UCS4(2) > will be supported in iconv(1) and iconv(3). > > 3. Business Summary > 3.5. Opportunity Window/Exposure: > Solaris Nevada > Project Indiana > > 4. Technical Description > 4.1. Details: > 1> > To create a new locale support in Solaris, following locale data > need to be defined. > LC_CTYPE > LC_COLLATE > LC_NUMERIC > LC_TIME > LC_MONETARY > LC_MESSAGE > > Because CLDR(Unicode's Common Locale Data Repository)[1] is so far the > largest and most extensive standard repository of locale data. The > new UTF-8 locales: ms_MY.UTF-8, id_ID.UTF-8 and vi_VN.UTF-8 will be > created with standard locale data according to CLDR. > > The l10n(localization) messages of these three locale languages are not > covered by this project. As a reference, here are some information about l10n > messages status for these three languages: > > * CLI (Command Line Interface) messages: > The localization for Solaris system libraries and utilities in Malaysian, > Indonesian and Vietnamese are not available. > > * L10N status for major GUI components by communities > > Malaysian Indonesian Vietnamese > -------------------------------------------------------------- > Gnome[3] Yes Yes Yes > Firefox [10] N/A Yes N/A > Thunderbird [11] N/A N/A N/A > Openoffice [14] Yes [12] N/A Yes [13] > > The localization contents for these three languages of gnome had been > integrated in package SUNWgnome-l10nmessages-extra on Solaris. > > 2> > To enhance iconv modules for Vietnamese encodings: > > The most popular encoding standards for Vietnamese are : > VISCII [8] > TCVN(5712) [7] > CP1258 [9] > > CP1258 is the standard of Microsoft Windows. It is supported by current > Solaris iconv. > > If Vietnamese locale is supported, the VISCII, TCVN encoding conversion > should be supported as well. It includes details as following: > VISCII <-> UTF-8/UCS-4/UCS-4BE/UCS-4LE/UCS-2/UCS-2BE/UCS-2LE > TCVN <-> UTF-8/UCS-4/UCS-4BE/UCS-4LE/UCS-2/UCS-2BE/UCS-2LE > VISCII <-> TCVN > (Note: <-> means from and to.) > > Since Malaysia and Indonesia language characters belong to ISO8859-1[2] > standard, they do not need extra iconv modules. > > > 4.5. Interfaces: > 1> > For function: > iconv_t iconv_open(const char *tocode, const char *fromcode) > The parameters tocode and fromcode will support: VISCII, TCVN(TCVN5712). > > 2> > For utility: > iconv [-cs] -f frommap -t tomap [file]... > "frommap" and "tomap" will support VISCII, TCVN(TCVN5712). > > > 4.6. Doc Impact: > None. > > 4.7. Admin/Config Impact: > None. > > 4.8. HA Impact: > None. > > 4.9. I18N/L10N Impact: > No impact to current XI18N. > > 4.10. Packaging & Delivery: > locale enabling packages (new packages): > SUNWlang-ms > SUNWlang-id > SUNWlang-vi > > iconv packages (updated packages): > SUNWiconv-extra > SUNWiconv-unicode > > 4.11. Security Impact: > None. > > 4.12. Dependencies: > > > 5. Reference Documents: > [1] Unicode CLDR Project: Common Locale Data Repository > http://unicode.org/cldr > > [2] ISO/IEC 8859-1:1998: > http://anubis.dkuug.dk/JTC1/SC2/WG3/docs/n411.pdf > > [3] Gnome l10n message language list: > http://l10n.gnome.org/languages/ > > [4] Vietnamese Unicode FAQ: > http://vietunicode.sourceforge.net/ > > [5] Vietnamese encoding conversion-tables: > http://www.haible.de/bruno/charsets/conversion-tables/Vietnamese.html > > [6] The TCVN 6909 standard: > http://www.informatik.uni-leipzig.de/~duc/software/misc/tcvn6909.pdf > > [7] TCVN 5712:1993 standard: > http://www.informatik.uni-leipzig.de/~duc/software/misc/tcvn.txt > > [8] rfc1456 - Conventions for Encoding the Vietnamese Language > http://tools.ietf.org/html/rfc1456 > > [9] Windows 1258 reference: > http://www.microsoft.com/globaldev/reference/sbcs/1258.mspx > > [10] Firefox is available in over 45 languages: > http://www.mozilla.com/en-US/firefox/all.html > > [11] Available Thunderbird languages: > http://www.mozilla.com/en-US/thunderbird/all.html > > [12] Malaysian openoffice website: > http://ms.openoffice.org/ > > [13] Vietnamese openoffice website: > http://vi.openoffice.org/ > > [14] Language localization status of openoffice > http://wiki.services.openoffice.org/wiki/Languages > > 6. Resources and Schedule > 6.4. Steering Committee requested information > 6.4.1. Consolidation C-team Name: > Globalization > 6.5. ARC review type: FastTrack > 6.6. ARC Exposure: open > >