From sacadmin Wed Apr 16 21:50:29 2008 Received: from sac.sfbay.sun.com (localhost [127.0.0.1]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id m3H4oTF0011261; Wed, 16 Apr 2008 21:50:29 -0700 (PDT) Received: (from meem@localhost) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8/Submit) id m3H4oT9j011258; Wed, 16 Apr 2008 21:50:29 -0700 (PDT) Date: Wed, 16 Apr 2008 21:50:29 -0700 (PDT) From: Peter Memishian Message-Id: <200804170450.m3H4oT9j011258@sac.sfbay.sun.com> To: PSARC-record@sac.sfbay.sun.com Cc: chris.beal@sun.com, clive.king@sun.com Subject: STREAMS _I_CMD and pfiles TLI support [PSARC/2008/265 FastTrack timeout 04/23/2008] Status: RO Content-Length: 574 Template Version: @(#)sac_nextcase 1.64 07/13/07 SMI This information is Copyright 2008 Sun Microsystems 1. Introduction 1.1. Project/Component Working Name: STREAMS _I_CMD and pfiles TLI support 1.2. Name of Document Author/Supplier: Author: Peter Memishian 1.3 Date of This Document: 16 April, 2008 4. Technical Description See the case directory for more detail 6. Resources and Schedule 6.4. Steering Committee requested information 6.4.1. Consolidation C-team Name: ON 6.5. ARC review type: FastTrack 6.6. ARC Exposure: open From peter.memishian@sun.com Wed Apr 16 21:53:57 2008 Received: from sunmail5.uk.sun.com (sunmail5.UK.Sun.COM [129.156.85.165]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id m3H4ruV7011311 for ; Wed, 16 Apr 2008 21:53:57 -0700 (PDT) Received: from brm-avmta-1.central.sun.com (brm-avmta-1.Central.Sun.COM [129.147.4.11]) by sunmail5.uk.sun.com (8.13.8+Sun/8.13.8/ENSMAIL,v2.2) with ESMTP id m3H4rq1I010499 for <@sunmail2sca.sfbay.sun.com:psarc-ext@sun.com>; Thu, 17 Apr 2008 05:53:56 +0100 (BST) Received: from pmxchannel-daemon.brm-avmta-1.central.sun.com by brm-avmta-1.central.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0JZG00C1DDLU3500@brm-avmta-1.central.sun.com> for psarc-ext@sun.com (ORCPT psarc-ext@sun.com); Wed, 16 Apr 2008 22:53:54 -0600 (MDT) Received: from dm-east-01.east.sun.com ([129.148.9.192]) by brm-avmta-1.central.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0JZG00CR9DLR9DB0@brm-avmta-1.central.sun.com> for psarc-ext@sun.com (ORCPT psarc-ext@sun.com); Wed, 16 Apr 2008 22:53:52 -0600 (MDT) Received: from zhadum.east.sun.com (zhadum.East.Sun.COM [10.8.57.1]) by dm-east-01.east.sun.com (8.13.8+Sun/8.13.8/ENSMAIL,v2.2) with ESMTP id m3H4roEa062939; Thu, 17 Apr 2008 00:53:50 -0400 (EDT) Received: from zhadum.east.sun.com (localhost [127.0.0.1]) by zhadum.east.sun.com (8.14.2+Sun/8.14.2) with ESMTP id m3H4ronF314631; Thu, 17 Apr 2008 00:53:50 -0400 (EDT) Received: (from meem@localhost) by zhadum.east.sun.com (8.14.2+Sun/8.14.2/Submit) id m3H4roL2314618; Thu, 17 Apr 2008 00:53:50 -0400 (EDT) Date: Thu, 17 Apr 2008 00:53:50 -0400 From: Peter Memishian Subject: STREAMS _I_CMD and pfiles TLI support [PSARC/2008/265 FastTrack timeout 04/23/2008] To: psarc-ext@sun.com Cc: clive.king@sun.com, chris.beal@sun.com Reply-to: peter.memishian@sun.com Message-id: <18438.55262.49836.160102@gargle.gargle.HOWL> MIME-version: 1.0 X-Mailer: VM 7.19 under 21.4 (patch 21) "Educational Television" XEmacs Lucid Content-type: text/plain; charset=us-ascii Content-transfer-encoding: 7BIT X-PMX-Version: 5.4.1.325704 X-Authentication-warning: zhadum.east.sun.com: meem set sender to peter.memishian@sun.com using -f Status: RO Content-Length: 7959 I'm filing this case for myself. The timer expires Wednesday, April 23rd. Patch binding is requested. Consolidation Private is requested for all proposed interfaces except for the new pfiles output, which is unstable (as per pfiles(1M)). Overview ======== This cases proposes a new STREAMS ioctl mechanism called _I_CMD which allows proc tools to reliably retrieve information from modules and drivers on a stream associated with a stopped process. This case also proposes an enhancement to pfiles(1M), which will make use of _I_CMD to report TLI endpoint information, addressing an observability limitation for customers using zones. Motivation ========== For historical reasons, a number of critical Solaris daemons still use TLI instead of sockets (e.g., 8 of the 55 processes running on my Nevada desktop after boot have TLI endpoints). While pfiles provides local and remote address information for socket endpoints, an architectural issue described below prevents this information from being provided for TLI endpoints. Customers have traditionally worked around this limitation by using the freely available `lsof' tool. However, since lsof uses /dev/kmem (among other unsavory interfaces) to retrieve this and other information, it is unsuitable for use in a zone. As such, TLI endpoint information is currently unavailable inside a zone, which has proven to be a gating issue for some zones deployments. Problem ======= The architectural issue stems from a conflict between the design of STREAMS ioctls and the way the proc tools (using the proc filesystem) examine a process. Specifically, proc tools work by asking the kernel to stop the process they wish to examine (the controlled process), and then create an "agent LWP" (see PCAGENT in proc(4)) which is used by the proc tool to perform operations on its behalf but in the context of the controlled process. Once the information has been retrieved, the process is resumed, unaware of the examination. At a high level, providing the information seems straightforward: since TLI endpoints are STREAMS devices, and since there are already ioctls available (TI_GETMYNAME and TI_GETPEERNAME) to retrieve TLI endpoint information, one might think the proc tools could issue the appropriate ioctl()s on the TLI streams inside the controlled process to get the information. However, there are several problematic cases to consider: * If an ioctl request is already outstanding on the stream, attempting to issue another ioctl() will block indefinitely. * If the stream is flow controlled, the M_IOCTL message (which is not a high priority message) will end up enqueued indefinitely. * Most STREAMS ioctls (including TI_GET{MY,PEER}NAME) are "transparent" ioctls, which function by having a given STREAMS module/driver iteratively request that the stream head copy data in/out of the userland process on its behalf. The copy in/out sequences are ioctl-specific (and not known to the STREAMS framework itself). In contrast, the current agent LWP ioctl design allows a proc tool to issue an ioctl() in the context of a controlled process by copying in a single buffer at ioctl entry and copying out the same buffer at ioctl() exit. These approaches are incompatible. (Note: sockets don't have these problems because socket endpoint information is stored in the "sonode" tied to each socket's vnode, and that information can be accessed without issuing STREAMS ioctls. That approach isn't feasible for TLI since a TLI device is just like any other STREAMS device and thus has only a specfs vnode.) Solution ======== To address the above problems, we propose a new STREAMS ioctl mechanism called "_I_CMD". The _I_CMD mechanism is similar in spirit to the existing I_STR (non-transparent) STREAMS ioctl mechanism: the caller fills in a `struct strcmd' (as they would a `struct strioctl') with an ioctl command number, timeout, data buffer, and data buffer length: typedef struct strcmd { int sc_cmd; /* ioctl command */ int sc_timeout; /* timeout value (in secs) */ int sc_len; /* data length */ int sc_pad; char sc_buf[STRCMDBUFSIZE]; /* data buffer */ } strcmd_t; However, unlike `struct strioctl', the data buffer is directly embedded into the `struct strcmd' to eliminate the need for additional copyin and copyout operations by the stream head. Thus, this design is compatible with the existing agent LWP ioctl approach. When an _I_CMD is issued on a stream, the stream head will sanity-check the request/payload, and allocate/initialize a new STREAMS message type called M_CMD. An M_CMD message is similar to an M_IOCTL message, but is high-priority (thus addressing the flow control issue above) and handled independently from ioctl messages (thus addressing the "outstanding ioctl request" problem above). The M_CMD message will be associated with a `struct cmdblk', which is similar to the existing `struct iocblk' message used for M_IOCTL messages, but tailored for M_CMD: typedef struct cmdblk { int cb_cmd; /* ioctl command type */ cred_t *cb_cr; /* full credentials */ uint_t cb_len; /* payload size */ int cb_error; /* error code */ } cmdblk_t; As with an I_STR M_IOCTL message, the stream head will also allocate an M_DATA message (of sc_len bytes) and place the contents of sc_buf into the message. As with M_IOCTL, the M_DATA will be chained onto the M_CMD message and sent downstream. The stream head will then wait interruptibly for sc_timeout seconds (or forever if sc_timeout is -1) to receive an M_CMD response. Upon receiving a response, the data will be copied back out to userland and the _I_CMD will complete. Since this facility is intended for use by the proc tools and only one proc tool can examine a process at a time, attempting to issue an _I_CMD while one is already pending will fail with EBUSY. However, this interface restriction could be lifted in the future at the expense of additional implementation complexity. By design, from the standpoint of a STREAMS module or driver, handling an M_CMD message is quite similar to handling a non-transparent M_IOCTL or a transparent M_IOCDATA. Thus, it is straightforward to share processing routines which can be used by either the traditional M_IOCTL/M_IOCDATA facility or the new M_CMD facility. That said, only STREAMS ioctls which need to be used by the proc tools need to have M_CMD support (presently just TI_GET{MY,PEER}NAME). As per the STREAMS design, modules putnext() messages they do not recognize, and drivers freemsg() messages they do not recognize. Thus, the risk associated with adding the new M_CMD STREAMS message is minimal. However, because drivers will freemsg() M_CMD messages by default (causing the _I_CMD to timeout), pfiles will take care to only issue the _I_CMD on known IP-based TLI devices (currently: /dev/udp, /dev/udp6, /dev/tcp, and /dev/tcp6). The proposed output of pfiles on TLI endpoints matches the current output used for sockets -- e.g.: # pfiles `pgrep rpc` 100395: /usr/sbin/rpcbind [ ... ] 19: S_IFCHR mode:0000 dev:333,0 ino:44170 uid:0 gid:0 rdev:105,27 O_RDWR /devices/pseudo/tl@0:ticots 20: S_IFCHR mode:0000 dev:333,0 ino:65028 uid:0 gid:0 rdev:42,35 O_RDWR|O_NONBLOCK FD_CLOEXEC --> sockname: AF_INET 10.8.57.32 port: 111 --> peername: AF_INET 10.8.57.11 port: 61404 /devices/pseudo/tcp@0:tcp -- meem From carlsonj@phorcys.east.sun.com Thu Apr 17 05:00:04 2008 Received: from sunmail3mpk.sfbay.sun.com (sunmail3mpk.SFBay.Sun.COM [129.146.11.52]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id m3HC04AO020923 for ; Thu, 17 Apr 2008 05:00:04 -0700 (PDT) Received: from nwk-avmta-2.sfbay.sun.com (nwk-avmta-2.SFBay.Sun.COM [129.145.155.6]) by sunmail3mpk.sfbay.sun.com (8.13.7+Sun/8.13.7/ENSMAIL,v2.2) with ESMTP id m3HC01HH025030; Thu, 17 Apr 2008 05:00:02 -0700 (PDT) Received: from pmxchannel-daemon.nwk-avmta-2.sfbay.sun.com by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0JZG00K0TXC14400@nwk-avmta-2.sfbay.sun.com>; Thu, 17 Apr 2008 05:00:01 -0700 (PDT) Received: from phorcys.east.sun.com ([129.148.174.143]) by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0JZG0099ZXC1FE90@nwk-avmta-2.sfbay.sun.com>; Thu, 17 Apr 2008 05:00:01 -0700 (PDT) Received: from phorcys.east.sun.com (localhost [127.0.0.1]) by phorcys.east.sun.com (8.14.2+Sun/8.14.2) with ESMTP id m3HC00op011507; Thu, 17 Apr 2008 08:00:00 -0400 (EDT) Received: (from carlsonj@localhost) by phorcys.east.sun.com (8.14.2+Sun/8.14.2/Submit) id m3HC00QU011504; Thu, 17 Apr 2008 08:00:00 -0400 (EDT) Date: Thu, 17 Apr 2008 08:00:00 -0400 From: James Carlson Subject: Re: STREAMS _I_CMD and pfiles TLI support [PSARC/2008/265 FastTrack timeout 04/23/2008] In-reply-to: <18438.55262.49836.160102@gargle.gargle.HOWL> To: Peter.Memishian@sun.com Cc: psarc-ext@sun.com, Chris.Beal@sun.com, Clive.King@sun.com Message-id: <18439.15296.924444.557452@gargle.gargle.HOWL> MIME-version: 1.0 X-Mailer: VM 7.01 under Emacs 21.3.1 Content-type: text/plain; charset=us-ascii Content-transfer-encoding: 7BIT X-PMX-Version: 5.4.1.325704 References: <18438.55262.49836.160102@gargle.gargle.HOWL> Status: RO Content-Length: 536 Peter Memishian writes: > 20: S_IFCHR mode:0000 dev:333,0 ino:65028 uid:0 gid:0 rdev:42,35 > O_RDWR|O_NONBLOCK FD_CLOEXEC > --> sockname: AF_INET 10.8.57.32 port: 111 > --> peername: AF_INET 10.8.57.11 port: 61404 > /devices/pseudo/tcp@0:tcp Yay! -- James Carlson, Solaris Networking Sun Microsystems / 35 Network Drive 71.232W Vox +1 781 442 2084 MS UBUR02-212 / Burlington MA 01803-2757 42.496N Fax +1 781 442 1677 From brian.utterback@sun.com Thu Apr 17 08:42:36 2008 Received: from sunmail3mpk.sfbay.sun.com (sunmail3mpk.SFBay.Sun.COM [129.146.11.52]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id m3HFgaGI026117 for ; Thu, 17 Apr 2008 08:42:36 -0700 (PDT) Received: from nwk-avmta-2.sfbay.sun.com (nwk-avmta-2.SFBay.Sun.COM [129.145.155.6]) by sunmail3mpk.sfbay.sun.com (8.13.7+Sun/8.13.7/ENSMAIL,v2.2) with ESMTP id m3HFgWgJ009224 for <@sunmail2sca.sfbay.sun.com:psarc-ext@sun.com>; Thu, 17 Apr 2008 08:42:35 -0700 (PDT) Received: from pmxchannel-daemon.nwk-avmta-2.sfbay.sun.com by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0JZH005037MZJ600@nwk-avmta-2.sfbay.sun.com> for psarc-ext@sun.com (ORCPT psarc-ext@sun.com); Thu, 17 Apr 2008 08:42:35 -0700 (PDT) Received: from dm-east-01.east.sun.com ([129.148.9.192]) by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0JZH001DI7MYZ070@nwk-avmta-2.sfbay.sun.com> for psarc-ext@sun.com (ORCPT psarc-ext@sun.com); Thu, 17 Apr 2008 08:42:34 -0700 (PDT) Received: from [129.148.226.12] (sr1-unsh01-02.East.Sun.COM [129.148.226.12]) by dm-east-01.east.sun.com (8.13.8+Sun/8.13.8/ENSMAIL,v2.2) with ESMTP id m3HFgVgt056529; Thu, 17 Apr 2008 11:42:32 -0400 (EDT) Date: Thu, 17 Apr 2008 11:42:31 -0400 From: Brian Utterback Subject: Re: STREAMS _I_CMD and pfiles TLI support [PSARC/2008/265 FastTrack timeout 04/23/2008] In-reply-to: <18438.55262.49836.160102@gargle.gargle.HOWL> To: Peter.Memishian@sun.com Cc: psarc-ext@sun.com, Clive.King@sun.com, Chris.Beal@sun.com Message-id: <48076FE7.5010703@sun.com> MIME-version: 1.0 Content-type: text/plain; charset=ISO-8859-1; format=flowed Content-transfer-encoding: 7BIT X-PMX-Version: 5.4.1.325704 References: <18438.55262.49836.160102@gargle.gargle.HOWL> User-Agent: Thunderbird 2.0.0.15pre (X11/20080413) Status: RO Content-Length: 897 Peter Memishian wrote: > # pfiles `pgrep rpc` > 100395: /usr/sbin/rpcbind > [ ... ] > 19: S_IFCHR mode:0000 dev:333,0 ino:44170 uid:0 gid:0 rdev:105,27 > O_RDWR > /devices/pseudo/tl@0:ticots > 20: S_IFCHR mode:0000 dev:333,0 ino:65028 uid:0 gid:0 rdev:42,35 > O_RDWR|O_NONBLOCK FD_CLOEXEC > --> sockname: AF_INET 10.8.57.32 port: 111 > --> peername: AF_INET 10.8.57.11 port: 61404 > /devices/pseudo/tcp@0:tcp > Will the device show as /devices/pseudo/tcp@0:tcp or /devices/pseudo/tl@0:ticots? -- blu There are two rules in life: Rule 1- Don't tell people everything you know ---------------------------------------------------------------------- Brian Utterback - Solaris RPE, Sun Microsystems, Inc. Ph:877-259-7345, Em:brian.utterback-at-ess-you-enn-dot-kom From jgh@wizmail.org Thu Apr 17 12:35:54 2008 Received: from sunmail4.singapore.sun.com (sunmail4.Singapore.Sun.COM [129.158.71.19]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id m3HJZqcM004772 for ; Thu, 17 Apr 2008 12:35:53 -0700 (PDT) Received: from brm-avmta-1.central.sun.com (brm-avmta-1.Central.Sun.COM [129.147.4.11]) by sunmail4.singapore.sun.com (8.13.4+Sun/8.13.3/ENSMAIL,v2.2) with ESMTP id m3HJZi6X009961 for <@sunmail2sca.sfbay.sun.com:psarc-ext@sun.com>; Fri, 18 Apr 2008 03:35:52 +0800 (SGT) Received: from pmxchannel-daemon.brm-avmta-1.central.sun.com by brm-avmta-1.central.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0JZH0030XIFQSG00@brm-avmta-1.central.sun.com> for psarc-ext@sun.com (ORCPT psarc-ext@sun.com); Thu, 17 Apr 2008 13:35:50 -0600 (MDT) Received: from brmea-mail-4.sun.com ([192.18.98.36]) by brm-avmta-1.central.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0JZH00ET8IFNUCB0@brm-avmta-1.central.sun.com> for psarc-ext@sun.com (ORCPT psarc-ext@sun.com); Thu, 17 Apr 2008 13:35:47 -0600 (MDT) Received: from relay44i.sun.com ([192.5.209.118]) by brmea-mail-4.sun.com (8.13.6+Sun/8.12.9) with ESMTP id m3HJY41w023062 for ; Thu, 17 Apr 2008 19:35:47 +0000 (GMT) Received: from mms48es.mms.us.syntegra.com ([160.41.221.230] [160.41.221.230]) by relay44i.sun.com with ESMTP id BT-MMP-56294 for psarc-ext@sun.com; Thu, 17 Apr 2008 19:35:46 +0000 (Z) Received: from relay44i.sun.com (relay44i.sun.com [192.5.209.118]) by mms48es.sun.com with ESMTP id BT-MMP-2509114 for psarc-ext@sun.com; Thu, 17 Apr 2008 19:35:46 +0000 (Z) Received: from wizmail.org ([217.146.104.199] [217.146.104.199]) by relay4i.sun.com with ESMTP id BT-MMP-1581966 for psarc-ext@sun.com; Thu, 17 Apr 2008 19:35:46 +0000 (Z) Received: from ebony.jgh.adsl.wizards.co.uk ([217.146.123.59]) (from_AS 16353) by wizmail.org with esmtpsa (TLSv1:DHE-RSA-AES256-SHA:256) (Exim 4.67) id 1JmZtZ-0005LA-Fu for psarc-ext@sun.com (return-path ) ; Thu, 17 Apr 2008 19:35:45 +0000 Date: Thu, 17 Apr 2008 20:35:43 +0100 From: Jeremy Harris Subject: Re: STREAMS _I_CMD and pfiles TLI support [PSARC/2008/265 FastTrack timeout 04/23/2008] In-reply-to: <18438.55262.49836.160102@gargle.gargle.HOWL> To: psarc-ext@sun.com Message-id: <4807A68F.1020509@wizmail.org> MIME-version: 1.0 Content-type: text/plain; charset=ISO-8859-1; format=flowed Content-transfer-encoding: 7BIT X-PMX-Version: 5.4.1.325704 X-Brightmail-Tracker: AAAAAA== X-Antispam: No, score=-2.6/5.0, scanned in 0.282sec at (localhost [127.0.0.1]) by smf-spamd v1.3.1 - http://smfs.sf.net/ References: <18438.55262.49836.160102@gargle.gargle.HOWL> User-Agent: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.12) Gecko/20080226 Fedora/2.0.0.12-1.fc7 Thunderbird/2.0.0.12 Mnenhy/0.7.5.0 Status: RO Content-Length: 1127 Peter Memishian wrote: > # pfiles `pgrep rpc` > 100395: /usr/sbin/rpcbind > [ ... ] > 19: S_IFCHR mode:0000 dev:333,0 ino:44170 uid:0 gid:0 rdev:105,27 > O_RDWR > /devices/pseudo/tl@0:ticots > 20: S_IFCHR mode:0000 dev:333,0 ino:65028 uid:0 gid:0 rdev:42,35 > O_RDWR|O_NONBLOCK FD_CLOEXEC > --> sockname: AF_INET 10.8.57.32 port: 111 > --> peername: AF_INET 10.8.57.11 port: 61404 > /devices/pseudo/tcp@0:tcp jgh1) What is the stability level of the proposed output from pfiles(1) ? jgh2) Will it support IPv6? jgh3) Is there any interaction with PSARC/2008/257 sockets-direct? Finally, though I'm fully in favour of this proposal: > For historical reasons, a number of critical Solaris daemons still use > TLI instead of sockets (e.g., 8 of the 55 processes running on my Nevada > desktop after boot have TLI endpoints). Is there any intent to eventually move these TLI uses over to sockets? (Not part of this case). Cheers, Jeremy Harris jgh@wizmail.org From peter.memishian@sun.com Thu Apr 17 13:45:37 2008 Received: from sunmail4.singapore.sun.com (sunmail4.Singapore.Sun.COM [129.158.71.19]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id m3HKjaae008323 for ; Thu, 17 Apr 2008 13:45:37 -0700 (PDT) Received: from nwk-avmta-1.SFBay.Sun.COM (nwk-avmta-1.SFBay.Sun.COM [129.146.11.74]) by sunmail4.singapore.sun.com (8.13.4+Sun/8.13.3/ENSMAIL,v2.2) with ESMTP id m3HKjW2w005639 for <@sunmail2sca.sfbay.sun.com:psarc-ext@sun.com>; Fri, 18 Apr 2008 04:45:35 +0800 (SGT) Received: from pmxchannel-daemon.nwk-avmta-1.sfbay.Sun.COM by nwk-avmta-1.sfbay.Sun.COM (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0JZH00D0HLNXRR00@nwk-avmta-1.sfbay.Sun.COM> for psarc-ext@sun.com (ORCPT psarc-ext@sun.com); Thu, 17 Apr 2008 13:45:33 -0700 (PDT) Received: from dm-east-02.east.sun.com ([129.148.13.5]) by nwk-avmta-1.sfbay.Sun.COM (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0JZH00BGULNWAY90@nwk-avmta-1.sfbay.Sun.COM> for psarc-ext@sun.com (ORCPT psarc-ext@sun.com); Thu, 17 Apr 2008 13:45:32 -0700 (PDT) Received: from zhadum.east.sun.com (zhadum.East.Sun.COM [10.8.57.1]) by dm-east-02.east.sun.com (8.13.8+Sun/8.13.8/ENSMAIL,v2.2) with ESMTP id m3HKjTeM031717; Thu, 17 Apr 2008 16:45:29 -0400 (EDT) Received: from zhadum.east.sun.com (localhost [127.0.0.1]) by zhadum.east.sun.com (8.14.2+Sun/8.14.2) with ESMTP id m3HKjTNj733092; Thu, 17 Apr 2008 16:45:29 -0400 (EDT) Received: (from meem@localhost) by zhadum.east.sun.com (8.14.2+Sun/8.14.2/Submit) id m3HKjTiG733089; Thu, 17 Apr 2008 16:45:29 -0400 (EDT) Date: Thu, 17 Apr 2008 16:45:29 -0400 From: Peter Memishian Subject: Re: STREAMS _I_CMD and pfiles TLI support [PSARC/2008/265 FastTrack timeout 04/23/2008] In-reply-to: <48076FE7.5010703@sun.com> To: Brian Utterback Cc: peter.memishian@sun.com, psarc-ext@sun.com, Clive.King@sun.com, Chris.Beal@sun.com Reply-to: peter.memishian@sun.com Message-id: <18439.46825.687449.899088@gargle.gargle.HOWL> MIME-version: 1.0 X-Mailer: VM 7.19 under 21.4 (patch 21) "Educational Television" XEmacs Lucid Content-type: text/plain; charset=us-ascii Content-transfer-encoding: 7BIT X-PMX-Version: 5.4.1.325704 References: <18438.55262.49836.160102@gargle.gargle.HOWL> <48076FE7.5010703@sun.com> X-Authentication-warning: zhadum.east.sun.com: meem set sender to peter.memishian@sun.com using -f Status: RO Content-Length: 689 > > # pfiles `pgrep rpc` > > 100395: /usr/sbin/rpcbind > > [ ... ] > > 19: S_IFCHR mode:0000 dev:333,0 ino:44170 uid:0 gid:0 rdev:105,27 > > O_RDWR > > /devices/pseudo/tl@0:ticots > > 20: S_IFCHR mode:0000 dev:333,0 ino:65028 uid:0 gid:0 rdev:42,35 > > O_RDWR|O_NONBLOCK FD_CLOEXEC > > --> sockname: AF_INET 10.8.57.32 port: 111 > > --> peername: AF_INET 10.8.57.11 port: 61404 > > /devices/pseudo/tcp@0:tcp > > > > > Will the device show as /devices/pseudo/tcp@0:tcp or > /devices/pseudo/tl@0:ticots? The former, as shown above. -- meem From Brian.Utterback@Sun.COM Thu Apr 17 18:04:05 2008 Received: from sunmail3mpk.sfbay.sun.com (sunmail3mpk.SFBay.Sun.COM [129.146.11.52]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id m3I14567015902 for ; Thu, 17 Apr 2008 18:04:05 -0700 (PDT) Received: from nwk-avmta-1.SFBay.Sun.COM (nwk-avmta-1.SFBay.Sun.COM [129.146.11.74]) by sunmail3mpk.sfbay.sun.com (8.13.7+Sun/8.13.7/ENSMAIL,v2.2) with ESMTP id m3I145CZ018189 for <@sunmail2sca.sfbay.sun.com:psarc-ext@sun.com>; Thu, 17 Apr 2008 18:04:05 -0700 (PDT) Received: from pmxchannel-daemon.nwk-avmta-1.sfbay.Sun.COM by nwk-avmta-1.sfbay.Sun.COM (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0JZH00J03XMSBI00@nwk-avmta-1.sfbay.Sun.COM> for psarc-ext@sun.com (ORCPT psarc-ext@sun.com); Thu, 17 Apr 2008 18:04:04 -0700 (PDT) Received: from brmea-mail-4.sun.com ([192.18.98.36]) by nwk-avmta-1.sfbay.Sun.COM (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0JZH00FEGXMRB2E0@nwk-avmta-1.sfbay.Sun.COM> for psarc-ext@sun.com (ORCPT psarc-ext@sun.com); Thu, 17 Apr 2008 18:04:04 -0700 (PDT) Received: from fe-amer-10.sun.com ([192.18.109.80]) by brmea-mail-4.sun.com (8.13.6+Sun/8.12.9) with ESMTP id m3I143ru004940 for ; Fri, 18 Apr 2008 01:04:03 +0000 (GMT) Received: from conversion-daemon.mail-amer.sun.com by mail-amer.sun.com (Sun Java System Messaging Server 6.2-8.04 (built Feb 28 2007)) id <0JZH00E01XEYIA00@mail-amer.sun.com> (original mail from Brian.Utterback@Sun.COM) for psarc-ext@sun.com (ORCPT psarc-ext@sun.com); Thu, 17 Apr 2008 19:04:03 -0600 (MDT) Received: from [192.168.1.3] ([71.168.125.142]) by mail-amer.sun.com (Sun Java System Messaging Server 6.2-8.04 (built Feb 28 2007)) with ESMTPSA id <0JZH00FDFXMQN090@mail-amer.sun.com> for psarc-ext@sun.com (ORCPT psarc-ext@sun.com); Thu, 17 Apr 2008 19:04:03 -0600 (MDT) Date: Thu, 17 Apr 2008 21:04:00 -0400 From: Brian Utterback Subject: Re: STREAMS _I_CMD and pfiles TLI support [PSARC/2008/265 FastTrack timeout 04/23/2008] In-reply-to: <18439.46825.687449.899088@gargle.gargle.HOWL> Sender: Brian.Utterback@Sun.COM To: Peter.Memishian@Sun.COM Cc: psarc-ext@Sun.COM, Clive.King@Sun.COM, Chris.Beal@Sun.COM Message-id: <4807F380.9020409@sun.com> MIME-version: 1.0 Content-type: text/plain; format=flowed; charset=ISO-8859-1 Content-transfer-encoding: 7BIT X-PMX-Version: 5.4.1.325704 References: <18438.55262.49836.160102@gargle.gargle.HOWL> <48076FE7.5010703@sun.com> <18439.46825.687449.899088@gargle.gargle.HOWL> User-Agent: Thunderbird 2.0.0.12 (Windows/20080213) Status: RO Content-Length: 900 Peter Memishian wrote: > > > # pfiles `pgrep rpc` > > > 100395: /usr/sbin/rpcbind > > > [ ... ] > > > 19: S_IFCHR mode:0000 dev:333,0 ino:44170 uid:0 gid:0 rdev:105,27 > > > O_RDWR > > > /devices/pseudo/tl@0:ticots > > > 20: S_IFCHR mode:0000 dev:333,0 ino:65028 uid:0 gid:0 rdev:42,35 > > > O_RDWR|O_NONBLOCK FD_CLOEXEC > > > --> sockname: AF_INET 10.8.57.32 port: 111 > > > --> peername: AF_INET 10.8.57.11 port: 61404 > > > /devices/pseudo/tcp@0:tcp > > > > > > > > > Will the device show as /devices/pseudo/tcp@0:tcp or > > /devices/pseudo/tl@0:ticots? > > The former, as shown above. > > -- > meem > I wasn't sure that it was intentional. So, there is no way in the pfiles output to tell that this is TLI/XTI and not sockets? Brian Utterback From peter.memishian@sun.com Thu Apr 17 18:28:03 2008 Received: from newsunmail1brm.central.sun.com (newsunmail1brm.Central.Sun.COM [129.147.62.245]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id m3I1S3qw016029 for ; Thu, 17 Apr 2008 18:28:03 -0700 (PDT) Received: from nwk-avmta-2.sfbay.sun.com (nwk-avmta-2.SFBay.Sun.COM [129.145.155.6]) by newsunmail1brm.central.sun.com (8.13.7+Sun/8.13.7/ENSMAIL,v2.2) with ESMTP id m3I1S2bK002457 for <@sunmail2sca.sfbay.sun.com:psarc-ext@sun.com>; Thu, 17 Apr 2008 19:28:03 -0600 (MDT) Received: from pmxchannel-daemon.nwk-avmta-2.sfbay.sun.com by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0JZH0060DYQPYA00@nwk-avmta-2.sfbay.sun.com> for psarc-ext@sun.com (ORCPT psarc-ext@sun.com); Thu, 17 Apr 2008 18:28:01 -0700 (PDT) Received: from dm-east-02.east.sun.com ([129.148.13.5]) by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0JZH002CDYQOGN60@nwk-avmta-2.sfbay.sun.com> for psarc-ext@sun.com (ORCPT psarc-ext@sun.com); Thu, 17 Apr 2008 18:28:00 -0700 (PDT) Received: from zhadum.east.sun.com (zhadum.East.Sun.COM [10.8.57.1]) by dm-east-02.east.sun.com (8.13.8+Sun/8.13.8/ENSMAIL,v2.2) with ESMTP id m3I1RvTT023170; Thu, 17 Apr 2008 21:27:57 -0400 (EDT) Received: from zhadum.east.sun.com (localhost [127.0.0.1]) by zhadum.east.sun.com (8.14.2+Sun/8.14.2) with ESMTP id m3I1Rv9H566467; Thu, 17 Apr 2008 21:27:57 -0400 (EDT) Received: (from meem@localhost) by zhadum.east.sun.com (8.14.2+Sun/8.14.2/Submit) id m3I1Rv3X566445; Thu, 17 Apr 2008 21:27:57 -0400 (EDT) Date: Thu, 17 Apr 2008 21:27:57 -0400 From: Peter Memishian Subject: Re: STREAMS _I_CMD and pfiles TLI support [PSARC/2008/265 FastTrack timeout 04/23/2008] In-reply-to: <4807F380.9020409@sun.com> To: Brian Utterback Cc: peter.memishian@sun.com, psarc-ext@sun.com, Clive.King@sun.com, Chris.Beal@sun.com Reply-to: peter.memishian@sun.com Message-id: <18439.63773.536268.875352@gargle.gargle.HOWL> MIME-version: 1.0 X-Mailer: VM 7.19 under 21.4 (patch 21) "Educational Television" XEmacs Lucid Content-type: text/plain; charset=us-ascii Content-transfer-encoding: 7BIT X-PMX-Version: 5.4.1.325704 References: <18438.55262.49836.160102@gargle.gargle.HOWL> <48076FE7.5010703@sun.com> <18439.46825.687449.899088@gargle.gargle.HOWL> <4807F380.9020409@sun.com> X-Authentication-warning: zhadum.east.sun.com: meem set sender to peter.memishian@sun.com using -f Status: RO Content-Length: 615 > > > 20: S_IFCHR mode:0000 dev:333,0 ino:65028 uid:0 gid:0 rdev:42,35 > > > O_RDWR|O_NONBLOCK FD_CLOEXEC > > > --> sockname: AF_INET 10.8.57.32 port: 111 > > > --> peername: AF_INET 10.8.57.11 port: 61404 > > > /devices/pseudo/tcp@0:tcp > So, there is no way in the pfiles output to tell that this is TLI/XTI > and not sockets? For sockets, the file descriptor type will be S_IFSOCK. For TLI, the file descriptor type will be S_IFCHR. Also, note that sockets do not display an associated pathname (unless they're AF_UNIX). -- meem From peter.memishian@sun.com Sun Apr 20 12:17:58 2008 Received: from sunmail2sca.sfbay.sun.com (sunmail2sca.SFBay.Sun.COM [129.145.155.234]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id m3KJHwDQ014510 for ; Sun, 20 Apr 2008 12:17:58 -0700 (PDT) Received: from brm-avmta-1.central.sun.com (brm-avmta-1.Central.Sun.COM [129.147.4.11]) by sunmail2sca.sfbay.sun.com (8.13.7+Sun/8.13.7/ENSMAIL,v2.2) with ESMTP id m3KJHuQO024319 for <@sunmail2sca.sfbay.sun.com:psarc-ext@sun.com>; Sun, 20 Apr 2008 12:17:57 -0700 (PDT) Received: from pmxchannel-daemon.brm-avmta-1.central.sun.com by brm-avmta-1.central.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0JZN0070F1LXBS00@brm-avmta-1.central.sun.com> for psarc-ext@sun.com (ORCPT psarc-ext@sun.com); Sun, 20 Apr 2008 13:17:57 -0600 (MDT) Received: from dm-east-02.east.sun.com ([129.148.13.5]) by brm-avmta-1.central.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0JZN005WG1LWQV00@brm-avmta-1.central.sun.com> for psarc-ext@sun.com (ORCPT psarc-ext@sun.com); Sun, 20 Apr 2008 13:17:57 -0600 (MDT) Received: from zhadum.east.sun.com (zhadum.East.Sun.COM [10.8.57.1]) by dm-east-02.east.sun.com (8.13.8+Sun/8.13.8/ENSMAIL,v2.2) with ESMTP id m3KJHbX4055486; Sun, 20 Apr 2008 15:17:37 -0400 (EDT) Received: from zhadum.east.sun.com (localhost [127.0.0.1]) by zhadum.east.sun.com (8.14.2+Sun/8.14.2) with ESMTP id m3KJHbSU232044; Sun, 20 Apr 2008 15:17:37 -0400 (EDT) Received: (from meem@localhost) by zhadum.east.sun.com (8.14.2+Sun/8.14.2/Submit) id m3KJHacB232040; Sun, 20 Apr 2008 15:17:36 -0400 (EDT) Date: Sun, 20 Apr 2008 15:17:36 -0400 From: Peter Memishian Subject: re: [Fwd: Re: STREAMS _I_CMD and pfiles TLI support [PSARC/2008/265 FastTrack timeout 04/23/2008]] In-reply-to: <480B2376.6050606@wizmail.org> To: Jeremy Harris Cc: psarc-ext@sun.com Reply-to: peter.memishian@sun.com Message-id: <18443.38608.711853.422340@gargle.gargle.HOWL> MIME-version: 1.0 X-Mailer: VM 7.19 under 21.4 (patch 21) "Educational Television" XEmacs Lucid Content-type: text/plain; charset=us-ascii Content-transfer-encoding: 7BIT X-PMX-Version: 5.4.1.325704 References: <480B2376.6050606@wizmail.org> X-Authentication-warning: zhadum.east.sun.com: meem set sender to peter.memishian@sun.com using -f Status: RO Content-Length: 1430 [ Jeremy forwarded this to me; I never received his original email. ] > Peter Memishian wrote: > > # pfiles `pgrep rpc` > > 100395: /usr/sbin/rpcbind > > [ ... ] > > 19: S_IFCHR mode:0000 dev:333,0 ino:44170 uid:0 gid:0 rdev:105,27 > > O_RDWR > > /devices/pseudo/tl@0:ticots > > 20: S_IFCHR mode:0000 dev:333,0 ino:65028 uid:0 gid:0 rdev:42,35 > > O_RDWR|O_NONBLOCK FD_CLOEXEC > > --> sockname: AF_INET 10.8.57.32 port: 111 > > --> peername: AF_INET 10.8.57.11 port: 61404 > > /devices/pseudo/tcp@0:tcp > > jgh1) What is the stability level of the proposed output from pfiles(1) ? As per the case materials: Consolidation Private is requested for all proposed interfaces except for the new pfiles output, which is unstable (as per pfiles(1M)). > jgh2) Will it support IPv6? Yes. > jgh3) Is there any interaction with PSARC/2008/257 sockets-direct? Not that I can see. > Finally, though I'm fully in favour of this proposal: > > > For historical reasons, a number of critical Solaris daemons still use > > TLI instead of sockets (e.g., 8 of the 55 processes running on my Nevada > > desktop after boot have TLI endpoints). > > Is there any intent to eventually move these TLI uses over to sockets? Certainly, but inertia is hard to overcome. -- meem From erik.nordmark@sun.com Mon Apr 21 13:42:14 2008 Received: from sunmail4.singapore.sun.com (sunmail4.Singapore.Sun.COM [129.158.71.19]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id m3LKgDvJ017879 for ; Mon, 21 Apr 2008 13:42:14 -0700 (PDT) Received: from brm-avmta-1.central.sun.com (brm-avmta-1.Central.Sun.COM [129.147.4.11]) by sunmail4.singapore.sun.com (8.13.4+Sun/8.13.3/ENSMAIL,v2.2) with ESMTP id m3LKfpWZ009054; Tue, 22 Apr 2008 04:42:09 +0800 (SGT) Received: from pmxchannel-daemon.brm-avmta-1.central.sun.com by brm-avmta-1.central.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0JZP0042P067H800@brm-avmta-1.central.sun.com>; Mon, 21 Apr 2008 14:42:07 -0600 (MDT) Received: from jurassic.eng.sun.com ([129.146.17.57]) by brm-avmta-1.central.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0JZP003NL066OZ00@brm-avmta-1.central.sun.com>; Mon, 21 Apr 2008 14:42:06 -0600 (MDT) Received: from [10.7.251.248] (punchin-nordmark.SFBay.Sun.COM [10.7.251.248]) by jurassic.eng.sun.com (8.13.8+Sun/8.13.8) with ESMTP id m3LKg1ji313809 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Mon, 21 Apr 2008 13:42:02 -0700 (PDT) Date: Mon, 21 Apr 2008 13:41:57 -0700 From: Erik Nordmark Subject: Re: [Fwd: Re: STREAMS _I_CMD and pfiles TLI support [PSARC/2008/265 FastTrack timeout 04/23/2008]] In-reply-to: <18443.38608.711853.422340@gargle.gargle.HOWL> To: peter.memishian@sun.com Cc: Jeremy Harris , psarc-ext@sun.com Message-id: <480CFC15.70009@sun.com> MIME-version: 1.0 Content-type: text/plain; charset=ISO-8859-1; format=flowed Content-transfer-encoding: 7BIT X-PMX-Version: 5.4.1.325704 References: <480B2376.6050606@wizmail.org> <18443.38608.711853.422340@gargle.gargle.HOWL> User-Agent: Thunderbird 2.0.0.4 (X11/20070723) Status: RO Content-Length: 878 Peter Memishian wrote: > > Is there any intent to eventually move these TLI uses over to sockets? > > Certainly, but inertia is hard to overcome. It is probably a bit more than just inertia. I suspect most if not all of the applications are RPC applications. Such applications end up using TLI because that it how TI-RPC was designed and we document this fact. For instance, we have APIs like svc_tli_create and clnt_tli_create which allows the application to pass in a TLI endpoint. We also document the xp_fd field, but for that we (no longer) seem to explicitly say it is a TLI endpoint. I would be nice if we could - Add sockets as an interface under the RPC library akin to how we have added door support - If possible switch the generic clnt_create and svc_create to use sockets - If possible deprecate svc_tli_create and clnt_tli_create. Erik From peter.memishian@sun.com Thu Apr 24 00:53:53 2008 Received: from sunmail4.singapore.sun.com (sunmail4.Singapore.Sun.COM [129.158.71.19]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id m3O7rqY4010471 for ; Thu, 24 Apr 2008 00:53:53 -0700 (PDT) Received: from nwk-avmta-1.SFBay.Sun.COM (nwk-avmta-1.SFBay.Sun.COM [129.146.11.74]) by sunmail4.singapore.sun.com (8.13.4+Sun/8.13.3/ENSMAIL,v2.2) with ESMTP id m3O7rldA004353 for <@sunmail2sca.sfbay.sun.com:psarc-ext@sun.com>; Thu, 24 Apr 2008 15:53:51 +0800 (SGT) Received: from pmxchannel-daemon.nwk-avmta-1.sfbay.Sun.COM by nwk-avmta-1.sfbay.Sun.COM (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0JZT00L0HKLPUL00@nwk-avmta-1.sfbay.Sun.COM> for psarc-ext@sun.com (ORCPT psarc-ext@sun.com); Thu, 24 Apr 2008 00:53:49 -0700 (PDT) Received: from dm-east-01.east.sun.com ([129.148.9.192]) by nwk-avmta-1.sfbay.Sun.COM (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0JZT00H94KLOL5F0@nwk-avmta-1.sfbay.Sun.COM> for psarc-ext@sun.com (ORCPT psarc-ext@sun.com); Thu, 24 Apr 2008 00:53:49 -0700 (PDT) Received: from zhadum.east.sun.com (zhadum.East.Sun.COM [10.8.57.1]) by dm-east-01.east.sun.com (8.13.8+Sun/8.13.8/ENSMAIL,v2.2) with ESMTP id m3O7rk2I030162; Thu, 24 Apr 2008 03:53:46 -0400 (EDT) Received: from zhadum.east.sun.com (localhost [127.0.0.1]) by zhadum.east.sun.com (8.14.2+Sun/8.14.2) with ESMTP id m3O7rk9g354533; Thu, 24 Apr 2008 03:53:46 -0400 (EDT) Received: (from meem@localhost) by zhadum.east.sun.com (8.14.2+Sun/8.14.2/Submit) id m3O7rkBW354525; Thu, 24 Apr 2008 03:53:46 -0400 (EDT) Date: Thu, 24 Apr 2008 03:53:46 -0400 From: Peter Memishian Subject: re: STREAMS _I_CMD and pfiles TLI support [PSARC/2008/265 FastTrack timeout 04/23/2008] To: psarc-ext@sun.com Cc: clive.king@sun.com, chris.beal@sun.com Reply-to: peter.memishian@sun.com Message-id: <18448.15498.362156.469442@gargle.gargle.HOWL> MIME-version: 1.0 X-Mailer: VM 7.19 under 21.4 (patch 21) "Educational Television" XEmacs Lucid Content-type: text/plain; charset=us-ascii Content-transfer-encoding: 7BIT X-PMX-Version: 5.4.1.325704 X-Authentication-warning: zhadum.east.sun.com: meem set sender to peter.memishian@sun.com using -f Status: RO Content-Length: 64 This case was approved at this week's PSARC meeting. -- meem