From sacadmin Wed Mar 21 21:08:34 2007 Received: from sparc-build.SFBay.Sun.COM (sparc-build.SFBay.Sun.COM [10.5.23.87]) by sac.sfbay.sun.com (8.13.6+Sun/8.13.6) with ESMTP id l2M48YQL023671; Wed, 21 Mar 2007 21:08:34 -0700 (PDT) Received: from sparc-build.SFBay.Sun.COM (localhost [127.0.0.1]) by sparc-build.SFBay.Sun.COM (8.13.3+Sun/8.13.3) with ESMTP id l2M3xsIT012278; Wed, 21 Mar 2007 19:59:54 -0800 (PST) Received: (from is@localhost) by sparc-build.SFBay.Sun.COM (8.13.3+Sun/8.13.3/Submit) id l2M3xsQY012274; Wed, 21 Mar 2007 19:59:54 -0800 (PST) Date: Wed, 21 Mar 2007 19:59:54 -0800 (PST) From: Ienup Sung Message-Id: <200703220359.l2M3xsQY012274@sparc-build.SFBay.Sun.COM> To: PSARC@sac.sfbay.sun.com Subject: kiconv [PSARC/2007/173 Timeout: 03/28/2007] Status: RO Content-Length: 5796 Subject: PSARC FastTrack [03/28/2007]: kiconv Template Version: @(#)sac_nextcase %I% %G% SMI This information is Copyright 2007 Sun Microsystems, Inc. 1. Introduction 1.1. Project/Component Working Name: kiconv 1.2. Name of Document Author/Supplier: Author: Ienup Sung 1.3 Date of This Document: 21 March, 2007 4. Technical Description OVERVIEW This project proposes to add six notable functions, an kiconv module | specific linkage data structure with an accompanying module operations | data structure, five kiconv modules, and a header file with a couple of | notable data structures, kiconv_module_info(9S) and kiconv_ops(9S), for | the support of kernel-level iconv code conversions as described at below and [1]. The interfaces and code conversions are requested by SNAS Technologies group and file system groups such as NFS and PCFS to support necessary code conversions for our software and storage products. Among the new functions, kiconv_open(9F), kiconv(9F), kiconv_close(9F), and kiconvstr(9F) are the code conversion functions for general consumption. Functions kiconv_register_module(9F) and kiconv_unregister_module(9F) are for | kiconv module population management and will be used only by the project team. | Data structures kiconv_module_info(9S) and kiconv_ops(9S) and a header file | are for code conversion module developers and the project team. | The following kiconv module specific linkage and module operations structures | are for code conversion module developers and the project team: | | struct modlkiconv { | struct mod_ops *kiconv_modops; | char *kiconv_linkinfo; | kiconv_module_info_t *kiconv_moddef; | }; | | static int mod_installkiconv(struct modlkiconv *, struct modlinkage *);| static int mod_removekiconv(struct modlkiconv *, struct modlinkage *); | | struct mod_ops mod_kiconvops = { | mod_installkiconv, mod_removekiconv, mod_infonull | }; | | The initial set of code conversions proposed to be supported are shown in the kiconv_open(9F) man page and will be supplied by the project team. Most of the code conversions are coming from kiconv code conversion modules and loaded as needed except ISO-8859-1, ISO-8859-15, CP850, and CP1252 related code conversions that are quite commonly used in the world and require very small memory space (approximately about 1KB) for the mapping tables. Loading of code conversions can be done in two ways: kiconv_open(9F), with embedded info on available code conversions and corresponding modules, can identify and load necessary modules, or, people can manually load a module and let the module register itself with a kiconv module definition including | the supported code conversions. | Among the supported code conversions, unlike other code conversions we plan to support, we do not have legal clearance on the CP720 (DOS Arabic) mapping table yet. Some related people are currently looking for legal guidance or approval on the mapping table for CP720 from a 3'rd party. Depending on that, we may choose not to include the support for the CP720 related code conversions in the initial putback and thus omit from the proposed man page. INTERFACE STABILITY AND RELEASE BINDING There is no notable imported interfaces. The following are the exported interfaces: Interface Stability Reference/Comment kiconv_open(9F), Committed [1] kiconv(9F), kiconv_close(9F), kiconvstr(9F) kiconv_register_module(9F), Project Private [1] | kiconv_unregister_module(9F) sys/kiconv.h, Consolidation Private [1] (Header file and kiconv_module_info(9S), data structures for kiconv_ops(9S), the above functions struct modlkiconv, and and the modules at | struct mod_ops mod_kiconvops below.) | | mod_installkiconv(), Project Private module install and | mod_removekiconv() remove operations. | /kernel/kiconv/ Consolidation Private Directory for kiconv | kernel modules | kiconv_emea Project Private European, Middle | East, and South East | Asian kiconv module | kiconv_ja Project Private Japanese kiconv module | kiconv_ko Project Private Korean kiconv module | kiconv_sc Project Private S. Chinese kiconv | module | kiconv_tc Project Private T. Chinese kiconv | module | Note: For the above kiconv directory and the five kiconv modules, | the project team also asks for the same interface stability for the corresponding 64-bit directories and modules. | The project team asks for Micro/Patch release binding. REFERENCES [1] Man pages at the case directory in flat text files: materials/*.9[fs] 6. Resources and Schedule 6.4. Steering Committee requested information 6.4.1. Consolidation C-team Name: ON 6.5. ARC review type: FastTrack From sacadmin Wed Mar 21 21:39:57 2007 Received: from jurassic-x4600.sfbay.sun.com (cretaceous.SFBay.Sun.COM [129.146.17.59]) by sac.sfbay.sun.com (8.13.6+Sun/8.13.6) with ESMTP id l2M4dvUa023954 for ; Wed, 21 Mar 2007 21:39:57 -0700 (PDT) Received: from [129.150.12.53] (vpn-129-150-12-53.SFBay.Sun.COM [129.150.12.53]) by jurassic-x4600.sfbay.sun.com (8.14.0+Sun/8.14.0) with ESMTP id l2M4duEs463741; Wed, 21 Mar 2007 21:39:56 -0700 (PDT) Message-ID: <46020895.9000205@sun.com> Date: Wed, 21 Mar 2007 18:39:49 -1000 From: Joseph Kowalski User-Agent: Thunderbird 1.5.0.5 (X11/20060925) MIME-Version: 1.0 To: Ienup Sung CC: PSARC@sac.sfbay.sun.com Subject: Re: kiconv [PSARC/2007/173 Timeout: 03/28/2007] References: <200703220359.l2M3xsQY012274@sparc-build.SFBay.Sun.COM> In-Reply-To: <200703220359.l2M3xsQY012274@sparc-build.SFBay.Sun.COM> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Status: RO Content-Length: 541 Ienup Sung wrote: > Functions kiconv_register_module(9F) and kiconv_unregister_module(9F) are for | > kiconv module population management and will be used only by the project team. | > > Data structures kiconv_module_info(9S) and kiconv_ops(9S) and a header file | > are for code conversion module developers and the project team. > Just checking,... You have nice manpages for these just for internal review (a good thing), but as these are Project/Consolidation private, you won't be shipping them, right? - jek3 From sacadmin Wed Mar 21 22:09:20 2007 Received: from sfbaymail2sca.sfbay.sun.com (sfbaymail2sca.SFBay.Sun.COM [129.145.155.42]) by sac.sfbay.sun.com (8.13.6+Sun/8.13.6) with ESMTP id l2M59KY9024472 for ; Wed, 21 Mar 2007 22:09:20 -0700 (PDT) Received: from nwk-ea-fw-1.sun.com (nwkes-gis-mail-2.SFBay.Sun.COM [10.4.134.6]) by sfbaymail2sca.sfbay.sun.com (8.13.6+Sun/8.12.10/ENSMAIL,v2.2) with ESMTP id l2M59Ksk003744 for ; Wed, 21 Mar 2007 22:09:20 -0700 (PDT) Received: from d1-sfbay-09.sun.com ([192.18.39.119]) by nwk-ea-fw-1.sun.com (8.13.6+Sun/8.12.9) with ESMTP id l2M59FBS010431 for ; Wed, 21 Mar 2007 21:09:15 -0800 (PST) Received: from conversion-daemon.d1-sfbay-09.sun.com by d1-sfbay-09.sun.com (Sun Java System Messaging Server 6.2-6.01 (built Apr 3 2006)) id <0JFA00M01GXSAO00@d1-sfbay-09.sun.com> (original mail from Ienup.Sung@Sun.COM) for PSARC@sac.SFBay.Sun.COM; Wed, 21 Mar 2007 22:09:15 -0700 (PDT) Received: from [192.168.1.93] ([129.150.20.87]) by d1-sfbay-09.sun.com (Sun Java System Messaging Server 6.2-6.01 (built Apr 3 2006)) with ESMTPSA id <0JFA007T2GZF26G3@d1-sfbay-09.sun.com> for PSARC@sac.SFBay.Sun.COM; Wed, 21 Mar 2007 22:09:15 -0700 (PDT) Date: Wed, 21 Mar 2007 22:08:17 -0700 From: Ienup Sung Subject: Re: kiconv [PSARC/2007/173 Timeout: 03/28/2007] In-reply-to: <46020895.9000205@sun.com> Sender: Ienup.Sung@Sun.COM To: PSARC@sac.sfbay.sun.com Reply-to: Ienup.Sung@Sun.COM Message-id: <46020F41.3020000@sun.com> Organization: Sun Microsystems, Inc. MIME-version: 1.0 Content-type: text/plain; format=flowed; charset=us-ascii Content-transfer-encoding: 7BIT X-Accept-Language: en-us, en References: <200703220359.l2M3xsQY012274@sparc-build.SFBay.Sun.COM> <46020895.9000205@sun.com> User-Agent: Mozilla/5.0 (X11; U; SunOS sun4u; en-US; rv:1.7) Gecko/20041221 Status: RO Content-Length: 367 Joseph Kowalski wrote at 03/21/07 21:39: > Just checking,... You have nice manpages for these just for internal > review (a good thing), > but as these are Project/Consolidation private, you won't be shipping > them, right? > > - jek3 Thanks and right, man pages for private interfaces are not going to be shipped and only for internal uses at this point. Ienup From sacadmin Thu Mar 22 18:17:20 2007 Received: from sfbaymail2sca.sfbay.sun.com (sfbaymail2sca.SFBay.Sun.COM [129.145.155.42]) by sac.sfbay.sun.com (8.13.6+Sun/8.13.6) with ESMTP id l2N1HJpM025637 for ; Thu, 22 Mar 2007 18:17:19 -0700 (PDT) Received: from nwk-ea-fw-1.sun.com (nwkes-gis-mail-1.SFBay.Sun.COM [10.4.134.5]) by sfbaymail2sca.sfbay.sun.com (8.13.6+Sun/8.12.10/ENSMAIL,v2.2) with ESMTP id l2N1HF7t025171 for ; Thu, 22 Mar 2007 18:17:15 -0700 (PDT) Received: from d1-sfbay-10.sun.com ([192.18.39.120]) by nwk-ea-fw-1.sun.com (8.13.6+Sun/8.12.9) with ESMTP id l2N1HACA018493 for ; Thu, 22 Mar 2007 17:17:10 -0800 (PST) Received: from conversion-daemon.d1-sfbay-10.sun.com by d1-sfbay-10.sun.com (Sun Java System Messaging Server 6.2-6.01 (built Apr 3 2006)) id <0JFC004010NQEM00@d1-sfbay-10.sun.com> (original mail from Ienup.Sung@Sun.COM) for PSARC@sac.sfbay.sun.com; Thu, 22 Mar 2007 18:17:10 -0700 (PDT) Received: from [192.168.1.93] ([129.150.21.141]) by d1-sfbay-10.sun.com (Sun Java System Messaging Server 6.2-6.01 (built Apr 3 2006)) with ESMTPSA id <0JFC00M6A0WLD700@d1-sfbay-10.sun.com> for PSARC@sac.sfbay.sun.com; Thu, 22 Mar 2007 18:17:09 -0700 (PDT) Date: Thu, 22 Mar 2007 18:16:10 -0700 From: Ienup Sung Subject: Re: kiconv [PSARC/2007/173 Timeout: 03/28/2007] In-reply-to: <46020F41.3020000@sun.com> Sender: Ienup.Sung@Sun.COM To: PSARC@sac.sfbay.sun.com Reply-to: Ienup.Sung@Sun.COM Message-id: <46032A5A.1010602@sun.com> Organization: Sun Microsystems, Inc. MIME-version: 1.0 Content-type: text/plain; format=flowed; charset=us-ascii Content-transfer-encoding: 7BIT X-Accept-Language: en-us, en References: <200703220359.l2M3xsQY012274@sparc-build.SFBay.Sun.COM> <46020895.9000205@sun.com> <46020F41.3020000@sun.com> User-Agent: Mozilla/5.0 (X11; U; SunOS sun4u; en-US; rv:1.7) Gecko/20041221 Status: RO Content-Length: 430 I just realized there is a typo at the kiconv_ops.9s man page submitted for the case where necessary data fields are defined for kiconv code conversion specific operations and so I corrected the following line: kiconv_t (*kiconv_open)(void); into: void *(*kiconv_open)(void); | Sorry about the change and there is no other change in the submitted materials. Ienup From sacadmin Thu Mar 22 18:24:26 2007 Received: from sfbaymail1sca.SFBay.Sun.COM (sfbaymail1sca.SFBay.Sun.COM [129.145.154.35]) by sac.sfbay.sun.com (8.13.6+Sun/8.13.6) with ESMTP id l2N1OQmR025780 for ; Thu, 22 Mar 2007 18:24:26 -0700 (PDT) Received: from nwk-ea-fw-1.sun.com (nwkes-gis-mail-1.SFBay.Sun.COM [10.4.134.5]) by sfbaymail1sca.SFBay.Sun.COM (8.13.6+Sun/8.13.6/ENSMAIL,v2.2) with ESMTP id l2N1OPrl015078 for ; Thu, 22 Mar 2007 18:24:25 -0700 (PDT) Received: from d1-sfbay-09.sun.com ([192.18.39.119]) by nwk-ea-fw-1.sun.com (8.13.6+Sun/8.12.9) with ESMTP id l2N1OKbX018869 for ; Thu, 22 Mar 2007 17:24:20 -0800 (PST) Received: from conversion-daemon.d1-sfbay-09.sun.com by d1-sfbay-09.sun.com (Sun Java System Messaging Server 6.2-6.01 (built Apr 3 2006)) id <0JFC00B01181E800@d1-sfbay-09.sun.com> (original mail from Ienup.Sung@Sun.COM) for PSARC@sac.sfbay.sun.com; Thu, 22 Mar 2007 18:24:20 -0700 (PDT) Received: from [192.168.1.93] ([129.150.21.141]) by d1-sfbay-09.sun.com (Sun Java System Messaging Server 6.2-6.01 (built Apr 3 2006)) with ESMTPSA id <0JFC007HR18K2BF9@d1-sfbay-09.sun.com> for PSARC@sac.sfbay.sun.com; Thu, 22 Mar 2007 18:24:20 -0700 (PDT) Date: Thu, 22 Mar 2007 18:23:21 -0700 From: Ienup Sung Subject: Re: kiconv [PSARC/2007/173 Timeout: 03/28/2007] In-reply-to: <46032A5A.1010602@sun.com> Sender: Ienup.Sung@Sun.COM To: PSARC@sac.sfbay.sun.com Reply-to: Ienup.Sung@Sun.COM Message-id: <46032C09.9050804@sun.com> Organization: Sun Microsystems, Inc. MIME-version: 1.0 Content-type: text/plain; format=flowed; charset=us-ascii Content-transfer-encoding: 7BIT X-Accept-Language: en-us, en References: <200703220359.l2M3xsQY012274@sparc-build.SFBay.Sun.COM> <46020895.9000205@sun.com> <46020F41.3020000@sun.com> <46032A5A.1010602@sun.com> User-Agent: Mozilla/5.0 (X11; U; SunOS sun4u; en-US; rv:1.7) Gecko/20041221 Status: RO Content-Length: 790 Sorry, what I meant by the previous email was changing the following lines: kiconv_t (*kiconv_open)(void); size_t (*kiconv)(kiconv_t cd, char **inbuf, size_t *inbytesleft, char **outbuf, size_t *outbytesleft, int *errno); int (*kiconv_close)(kiconv_t cd); into the following: void *(*kiconv_open)(void); | size_t (*kiconv)(void *cd, char **inbuf, | size_t *inbytesleft, char **outbuf, size_t *outbytesleft, int *errno); int (*kiconv_close)(void *cd); | Ienup From sacadmin Wed Mar 28 10:19:12 2007 Received: from sfbaymail1sca.SFBay.Sun.COM (sfbaymail1sca.SFBay.Sun.COM [129.145.154.35]) by sac.sfbay.sun.com (8.13.6+Sun/8.13.6) with ESMTP id l2SHJC0e028477 for ; Wed, 28 Mar 2007 10:19:12 -0700 (PDT) Received: from nwk-ea-fw-1.sun.com (nwkes-gis-mail-2.SFBay.Sun.COM [10.4.134.6]) by sfbaymail1sca.SFBay.Sun.COM (8.13.6+Sun/8.13.6/ENSMAIL,v2.2) with ESMTP id l2SHHsVf022067 for ; Wed, 28 Mar 2007 10:18:59 -0700 (PDT) Received: from d1-sfbay-09.sun.com ([192.18.39.119]) by nwk-ea-fw-1.sun.com (8.13.6+Sun/8.12.9) with ESMTP id l2SHHnwo001193 for ; Wed, 28 Mar 2007 09:17:49 -0800 (PST) Received: from conversion-daemon.d1-sfbay-09.sun.com by d1-sfbay-09.sun.com (Sun Java System Messaging Server 6.2-6.01 (built Apr 3 2006)) id <0JFM00F01I5X1V00@d1-sfbay-09.sun.com> (original mail from Ienup.Sung@Sun.COM) for PSARC@sac.sfbay.sun.com; Wed, 28 Mar 2007 10:17:49 -0700 (PDT) Received: from [192.168.1.93] ([129.150.20.74]) by d1-sfbay-09.sun.com (Sun Java System Messaging Server 6.2-6.01 (built Apr 3 2006)) with ESMTPSA id <0JFM007NBIPL27NA@d1-sfbay-09.sun.com>; Wed, 28 Mar 2007 10:17:45 -0700 (PDT) Date: Wed, 28 Mar 2007 10:16:36 -0700 From: Ienup Sung Subject: Re: kiconv [PSARC/2007/173 Timeout: 03/28/2007] In-reply-to: <46032C09.9050804@sun.com> Sender: Ienup.Sung@Sun.COM To: PSARC@sac.sfbay.sun.com Cc: cifs-project@Sun.COM Reply-to: Ienup.Sung@Sun.COM Message-id: <460AA2F4.1090805@sun.com> Organization: Sun Microsystems, Inc. MIME-version: 1.0 Content-type: text/plain; format=flowed; charset=us-ascii Content-transfer-encoding: 7BIT X-Accept-Language: en-us, en References: <200703220359.l2M3xsQY012274@sparc-build.SFBay.Sun.COM> <46020895.9000205@sun.com> <46020F41.3020000@sun.com> <46032A5A.1010602@sun.com> <46032C09.9050804@sun.com> User-Agent: Mozilla/5.0 (X11; U; SunOS sun4u; en-US; rv:1.7) Gecko/20041221 Status: RO Content-Length: 144 This case was approved at today's PSARC meeting. Approved spec.txt and man pages can be found from the materials directory of the case. Ienup From sacadmin Mon Sep 10 22:26:38 2007 Received: from newsunmail1brm.central.sun.com (newsunmail1brm.Central.Sun.COM [129.147.62.245]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id l8B5QcUK014148 for ; Mon, 10 Sep 2007 22:26:38 -0700 (PDT) Received: from brm-avmta-1.central.sun.com (brm-avmta-1.Central.Sun.COM [129.147.4.11]) by newsunmail1brm.central.sun.com (8.13.7+Sun/8.13.7/ENSMAIL,v2.2) with ESMTP id l8B5N9hW043902 for <@sunmail2sca.sfbay.sun.com:psarc-record@sun.com>; Mon, 10 Sep 2007 23:23:09 -0600 (MDT) Received: from pmxchannel-daemon.brm-avmta-1.central.sun.com by brm-avmta-1.central.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0JO600I01UZLQN00@brm-avmta-1.central.sun.com> for psarc-record@sun.com (ORCPT psarc-record@Sun.COM); Mon, 10 Sep 2007 23:23:45 -0600 (MDT) Received: from sca-es-mail-1.sun.com ([192.18.43.132]) by brm-avmta-1.central.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0JO600C49UZKWM70@brm-avmta-1.central.sun.com> for psarc-record@sun.com (ORCPT psarc-record@Sun.COM); Mon, 10 Sep 2007 23:23:44 -0600 (MDT) Received: from fe-sfbay-10.sun.com ([192.18.43.129]) by sca-es-mail-1.sun.com (8.13.7+Sun/8.12.9) with ESMTP id l8B5NiWc017406 for ; Mon, 10 Sep 2007 22:23:44 -0700 (PDT) Received: from conversion-daemon.fe-sfbay-10.sun.com by fe-sfbay-10.sun.com (Sun Java System Messaging Server 6.2-8.04 (built Feb 28 2007)) id <0JO600201UTQYW00@fe-sfbay-10.sun.com> (original mail from Ienup.Sung@Sun.COM) for psarc-record@Sun.COM (ORCPT psarc-record@Sun.COM); Mon, 10 Sep 2007 22:23:44 -0700 (PDT) Received: from [129.145.155.61] by fe-sfbay-10.sun.com (Sun Java System Messaging Server 6.2-8.04 (built Feb 28 2007)) with ESMTPSA id <0JO6008QXUZJQ460@fe-sfbay-10.sun.com> for psarc-record@Sun.COM (ORCPT psarc-record@Sun.COM); Mon, 10 Sep 2007 22:23:44 -0700 (PDT) Date: Mon, 10 Sep 2007 22:23:43 -0700 From: Ienup Sung Subject: PSARC/2007/173 kiconv: adding an additional pair of code conversions Sender: Ienup.Sung@Sun.COM To: psarc-record@Sun.COM Cc: Yandong Yao , Osamu Sayama Reply-to: Ienup.Sung@Sun.COM Message-id: <46E6265F.3080606@Sun.COM> Organization: Sun Microsystems, Inc. MIME-version: 1.0 Content-type: text/plain; format=flowed; charset=us-ascii Content-transfer-encoding: 7BIT X-Accept-Language: en-us, en X-PMX-Version: 5.2.0.264296 User-Agent: Mozilla/5.0 (X11; U; SunOS sun4v; en-US; rv:1.7) Gecko/20070109 Status: RO Content-Length: 1263 Based on the input from Chinese expert and also a requirement from Asian G11N center, I'm adding the following line at kiconv_open.9f man page: CP950-HKSCS Traditional Chinese HKSCS-2001 (Windows) | to indicate that we will additionally have a new pair of code conversions supported between UTF-8 and CP950-HKSCS at kiconv_open(9F). Considering this requires no architecture change and this is rather of a minor change to explicit the necessary enhancement in supported code conversions, I'm sending this only to psarc-record@sun.com to save everyone's time. Ienup PS. Here is the diff output: diff -u materials/kiconv_open.9f-- materials/kiconv_open.9f --- materials/kiconv_open.9f-- Mon Sep 10 22:21:44 2007 +++ materials/kiconv_open.9f Mon Sep 10 22:22:04 2007 @@ -38,6 +38,7 @@ CP862 DOS Hebrew | CP866 DOS Cyrillic Russian | CP932 Japanese Shift JIS (Windows) | + CP950-HKSCS Traditional Chinese HKSCS-2001 (Windows) | CP1250 Central Europe CP1251 Cyrillic CP1252 Western Europe