The following are demonstrations of the kstat_types.d script. Here kstat_types.d is used to trace the kstat activity of the vmstat command, # ./kstat_types.d CMD CLASS TYPE MOD:INS:NAME vmstat . raw :0:kstat_headers vmstat . raw :0:kstat_headers vmstat misc named cpu_info:0:cpu_info0 vmstat misc named cpu:0:vm vmstat misc named cpu:0:sys vmstat disk io cmdk:0:cmdk0 vmstat disk io sd:0:sd0 vmstat misc raw unix:0:sysinfo vmstat vm raw unix:0:vminfo vmstat misc named unix:0:dnlcstats vmstat misc named unix:0:system_misc ^C Details of each lookup can be seen, including each disk device that was read. This is mpstat on a single CPU server, # ./kstat_types.d CMD CLASS TYPE MOD:INS:NAME mpstat . raw :0:kstat_headers mpstat . raw :0:kstat_headers mpstat misc named cpu_info:0:cpu_info0 mpstat misc named cpu:0:vm mpstat misc named cpu:0:sys ^C The output shows that the focus was CPU statistics, as expected. The following has caught in.routed reading some statistics, # ./kstat_types.d CMD CLASS TYPE MOD:INS:NAME in.routed . raw :0:kstat_headers in.routed . raw :0:kstat_headers in.routed net named lo:0:lo0 in.routed . raw :0:kstat_headers in.routed . raw :0:kstat_headers in.routed net named rtls:0:rtls0 in.routed . raw :0:kstat_headers in.routed . raw :0:kstat_headers in.routed net named rtls:0:rtls0 ^C Which shows that the network interfaces were checked. Finally, this is the kstats used when a "sar -u 1 1" command is run. ie, this thing, $ sar -u 1 1 SunOS jupiter 5.10 Generic i86pc 04/21/2006 23:28:53 %usr %sys %wio %idle 23:28:54 1 3 0 96 sar actually forks a child "sadc" to do the lookups. sadc caused the following kstat lookups (I'm not making this up), # ./kstat_types.d CMD CLASS TYPE MOD:INS:NAME sadc . raw :0:kstat_headers sadc . raw :0:kstat_headers sadc misc named unix:0:system_misc sadc kmem_cache named unix:0:file_cache sadc vmem named vmem:16:kmem_oversize sadc ufs named ufs:0:inode_cache sadc misc raw unix:0:var sadc kmem_cache named unix:0:kmem_magazine_1 sadc kmem_cache named unix:0:kmem_magazine_3 sadc kmem_cache named unix:0:kmem_magazine_7 sadc kmem_cache named unix:0:kmem_magazine_15 sadc kmem_cache named unix:0:kmem_magazine_31 sadc kmem_cache named unix:0:kmem_magazine_47 sadc kmem_cache named unix:0:kmem_magazine_63 sadc kmem_cache named unix:0:kmem_magazine_95 sadc kmem_cache named unix:0:kmem_magazine_143 sadc kmem_cache named unix:0:kmem_slab_cache sadc kmem_cache named unix:0:kmem_bufctl_cache sadc kmem_cache named unix:0:kmem_bufctl_audit_cache sadc kmem_cache named unix:0:kmem_va_4096 sadc kmem_cache named unix:0:kmem_va_8192 sadc kmem_cache named unix:0:kmem_va_12288 sadc kmem_cache named unix:0:kmem_va_16384 sadc kmem_cache named unix:0:kmem_va_20480 sadc kmem_cache named unix:0:kmem_va_24576 sadc kmem_cache named unix:0:kmem_va_28672 sadc kmem_cache named unix:0:kmem_va_32768 sadc kmem_cache named unix:0:kmem_alloc_8 sadc kmem_cache named unix:0:kmem_alloc_16 sadc kmem_cache named unix:0:kmem_alloc_24 sadc kmem_cache named unix:0:kmem_alloc_32 sadc kmem_cache named unix:0:kmem_alloc_40 sadc kmem_cache named unix:0:kmem_alloc_48 sadc kmem_cache named unix:0:kmem_alloc_56 sadc kmem_cache named unix:0:kmem_alloc_64 sadc kmem_cache named unix:0:kmem_alloc_80 sadc kmem_cache named unix:0:kmem_alloc_96 sadc kmem_cache named unix:0:kmem_alloc_112 sadc kmem_cache named unix:0:kmem_alloc_128 sadc kmem_cache named unix:0:kmem_alloc_160 sadc kmem_cache named unix:0:kmem_alloc_192 sadc kmem_cache named unix:0:kmem_alloc_224 sadc kmem_cache named unix:0:kmem_alloc_256 sadc kmem_cache named unix:0:kmem_alloc_320 sadc kmem_cache named unix:0:kmem_alloc_384 sadc kmem_cache named unix:0:kmem_alloc_448 sadc kmem_cache named unix:0:kmem_alloc_512 sadc kmem_cache named unix:0:kmem_alloc_640 sadc kmem_cache named unix:0:kmem_alloc_768 sadc kmem_cache named unix:0:kmem_alloc_896 sadc kmem_cache named unix:0:kmem_alloc_1152 sadc kmem_cache named unix:0:kmem_alloc_1344 sadc kmem_cache named unix:0:kmem_alloc_1600 sadc kmem_cache named unix:0:kmem_alloc_2048 sadc kmem_cache named unix:0:kmem_alloc_2688 sadc kmem_cache named unix:0:kmem_alloc_4096 sadc kmem_cache named unix:0:kmem_alloc_8192 sadc kmem_cache named unix:0:kmem_alloc_12288 sadc kmem_cache named unix:0:kmem_alloc_16384 sadc kmem_cache named unix:0:streams_mblk sadc kmem_cache named unix:0:streams_dblk_64 sadc kmem_cache named unix:0:streams_dblk_128 sadc kmem_cache named unix:0:streams_dblk_320 sadc kmem_cache named unix:0:streams_dblk_576 sadc kmem_cache named unix:0:streams_dblk_1088 sadc kmem_cache named unix:0:streams_dblk_1536 sadc kmem_cache named unix:0:streams_dblk_1984 sadc kmem_cache named unix:0:streams_dblk_2624 sadc kmem_cache named unix:0:streams_dblk_3968 sadc kmem_cache named unix:0:streams_dblk_8192 sadc kmem_cache named unix:0:streams_dblk_12160 sadc kmem_cache named unix:0:streams_dblk_16384 sadc kmem_cache named unix:0:streams_dblk_20352 sadc kmem_cache named unix:0:streams_dblk_24576 sadc kmem_cache named unix:0:streams_dblk_28544 sadc kmem_cache named unix:0:streams_dblk_32768 sadc kmem_cache named unix:0:streams_dblk_36736 sadc kmem_cache named unix:0:streams_dblk_40960 sadc kmem_cache named unix:0:streams_dblk_44928 sadc kmem_cache named unix:0:streams_dblk_49152 sadc kmem_cache named unix:0:streams_dblk_53120 sadc kmem_cache named unix:0:streams_dblk_57344 sadc kmem_cache named unix:0:streams_dblk_61312 sadc kmem_cache named unix:0:streams_dblk_65536 sadc kmem_cache named unix:0:streams_dblk_69504 sadc kmem_cache named unix:0:streams_dblk_73728 sadc kmem_cache named unix:0:streams_dblk_esb sadc kmem_cache named unix:0:streams_fthdr sadc kmem_cache named unix:0:streams_ftblk sadc kmem_cache named unix:0:multidata sadc kmem_cache named unix:0:multidata_pdslab sadc kmem_cache named unix:0:multidata_pattbl sadc kmem_cache named unix:0:taskq_ent_cache sadc kmem_cache named unix:0:taskq_cache sadc kmem_cache named unix:0:kmem_io_512M_128 sadc kmem_cache named unix:0:kmem_io_512M_256 sadc kmem_cache named unix:0:kmem_io_512M_512 sadc kmem_cache named unix:0:kmem_io_512M_1024 sadc kmem_cache named unix:0:kmem_io_512M_2048 sadc kmem_cache named unix:0:kmem_io_512M_4096 sadc kmem_cache named unix:0:kmem_io_16M_128 sadc kmem_cache named unix:0:kmem_io_16M_256 sadc kmem_cache named unix:0:kmem_io_16M_512 sadc kmem_cache named unix:0:kmem_io_16M_1024 sadc kmem_cache named unix:0:kmem_io_16M_2048 sadc kmem_cache named unix:0:kmem_io_16M_4096 sadc kmem_cache named unix:0:id32_cache sadc kmem_cache named unix:0:bp_map_4096 sadc kmem_cache named unix:0:bp_map_8192 sadc kmem_cache named unix:0:bp_map_12288 sadc kmem_cache named unix:0:bp_map_16384 sadc kmem_cache named unix:0:bp_map_20480 sadc kmem_cache named unix:0:bp_map_24576 sadc kmem_cache named unix:0:bp_map_28672 sadc kmem_cache named unix:0:bp_map_32768 sadc kmem_cache named unix:0:mod_hash_entries sadc kmem_cache named unix:0:ipp_mod sadc kmem_cache named unix:0:ipp_action sadc kmem_cache named unix:0:ipp_packet sadc kmem_cache named unix:0:htable_t sadc kmem_cache named unix:0:hment_t sadc kmem_cache named unix:0:hat_t sadc kmem_cache named unix:0:HatHash sadc kmem_cache named unix:0:seg_cache sadc kmem_cache named unix:0:snode_cache sadc kmem_cache named unix:0:dv_node_cache sadc kmem_cache named unix:0:dev_info_node_cache sadc kmem_cache named unix:0:segkp_4096 sadc kmem_cache named unix:0:segkp_8192 sadc kmem_cache named unix:0:segkp_12288 sadc kmem_cache named unix:0:segkp_16384 sadc kmem_cache named unix:0:segkp_20480 sadc kmem_cache named unix:0:thread_cache sadc kmem_cache named unix:0:lwp_cache sadc kmem_cache named unix:0:turnstile_cache sadc kmem_cache named unix:0:cred_cache sadc kmem_cache named unix:0:rctl_cache sadc kmem_cache named unix:0:rctl_val_cache sadc kmem_cache named unix:0:task_cache sadc kmem_cache named unix:0:cyclic_id_cache sadc kmem_cache named unix:0:dnlc_space_cache sadc kmem_cache named unix:0:vn_cache sadc kmem_cache named unix:0:file_cache sadc kmem_cache named unix:0:stream_head_cache sadc kmem_cache named unix:0:queue_cache sadc kmem_cache named unix:0:syncq_cache sadc kmem_cache named unix:0:qband_cache sadc kmem_cache named unix:0:linkinfo_cache sadc kmem_cache named unix:0:ciputctrl_cache sadc kmem_cache named unix:0:serializer_cache sadc kmem_cache named unix:0:as_cache sadc kmem_cache named unix:0:marker_cache sadc kmem_cache named unix:0:anon_cache sadc kmem_cache named unix:0:anonmap_cache sadc kmem_cache named unix:0:segvn_cache sadc kmem_cache named unix:0:flk_edges sadc kmem_cache named unix:0:fdb_cache sadc kmem_cache named unix:0:timer_cache sadc kmem_cache named unix:0:physio_buf_cache sadc kmem_cache named unix:0:ufs_inode_cache sadc kmem_cache named unix:0:directio_buf_cache sadc kmem_cache named unix:0:lufs_save sadc kmem_cache named unix:0:lufs_bufs sadc kmem_cache named unix:0:lufs_mapentry_cache sadc misc raw cpu_stat:0:cpu_stat0 sadc kmem_cache named unix:0:kcf_sreq_cache sadc kmem_cache named unix:0:kcf_areq_cache sadc kmem_cache named unix:0:kcf_context_cache sadc kmem_cache named unix:0:ipsec_actions sadc kmem_cache named unix:0:ipsec_selectors sadc kmem_cache named unix:0:ipsec_policy sadc kmem_cache named unix:0:ipsec_info sadc kmem_cache named unix:0:ip_minor_arena_1 sadc kmem_cache named unix:0:ipcl_conn_cache sadc kmem_cache named unix:0:ipcl_tcpconn_cache sadc kmem_cache named unix:0:ire_cache sadc kmem_cache named unix:0:tcp_timercache sadc kmem_cache named unix:0:tcp_sack_info_cache sadc kmem_cache named unix:0:tcp_iphc_cache sadc kmem_cache named unix:0:squeue_cache sadc kmem_cache named unix:0:sctp_conn_cache sadc kmem_cache named unix:0:sctp_faddr_cache sadc kmem_cache named unix:0:sctp_set_cache sadc kmem_cache named unix:0:sctp_ftsn_set_cache sadc kmem_cache named unix:0:sctpsock sadc kmem_cache named unix:0:sctp_assoc sadc kmem_cache named unix:0:socktpi_cache sadc kmem_cache named unix:0:socktpi_unix_cache sadc kmem_cache named unix:0:ncafs_cache sadc kmem_cache named unix:0:process_cache sadc kmem_cache named unix:0:exacct_object_cache sadc kmem_cache named unix:0:fctl_cache sadc kmem_cache named unix:0:tl_cache sadc kmem_cache named unix:0:keysock_1 sadc kmem_cache named unix:0:spdsock_1 sadc kmem_cache named unix:0:fnode_cache sadc kmem_cache named unix:0:pipe_cache sadc kmem_cache named unix:0:namefs_inodes_1 sadc kmem_cache named unix:0:port_cache sadc kmem_cache named unix:0:lnode_cache sadc kmem_cache named unix:0:clnt_clts_endpnt_cache sadc kmem_cache named unix:0:pty_map sadc kmem_cache named unix:0:sppptun_map sadc kmem_cache named unix:0:dtrace_state_cache sadc kmem_cache named unix:0:qif_head_cache sadc kmem_cache named unix:0:udp_minor_1 sadc kmem_cache named unix:0:authkern_cache sadc kmem_cache named unix:0:authloopback_cache sadc kmem_cache named unix:0:authdes_cache_handle sadc kmem_cache named unix:0:rnode_cache sadc kmem_cache named unix:0:nfs_access_cache sadc kmem_cache named unix:0:client_handle_cache sadc kmem_cache named unix:0:rnode4_cache sadc kmem_cache named unix:0:svnode_cache sadc kmem_cache named unix:0:nfs4_access_cache sadc kmem_cache named unix:0:client_handle4_cache sadc kmem_cache named unix:0:nfs4_ace4vals_cache sadc kmem_cache named unix:0:nfs4_ace4_list_cache sadc kmem_cache named unix:0:NFS_idmap_cache sadc kmem_cache named unix:0:lm_vnode sadc kmem_cache named unix:0:lm_xprt sadc kmem_cache named unix:0:lm_sysid sadc kmem_cache named unix:0:lm_client sadc kmem_cache named unix:0:lm_async sadc kmem_cache named unix:0:lm_sleep sadc kmem_cache named unix:0:lm_config sadc kmem_cache named unix:0:nfslog_small_rec sadc kmem_cache named unix:0:nfslog_medium_rec sadc kmem_cache named unix:0:nfslog_large_rec sadc kmem_cache named unix:0:exi_cache_handle sadc kmem_cache named unix:0:Client_entry_cache sadc kmem_cache named unix:0:OpenOwner_entry_cache sadc kmem_cache named unix:0:OpenStateID_entry_cache sadc kmem_cache named unix:0:LockStateID_entry_cache sadc kmem_cache named unix:0:Lockowner_entry_cache sadc kmem_cache named unix:0:File_entry_cache sadc kmem_cache named unix:0:DelegStateID_entry_cache sadc kmem_cache named unix:0:ip_minor_1 sadc kmem_cache named unix:0:ar_minor_1 sadc kmem_cache named unix:0:icmp_minor_1 sadc kmem_cache named unix:0:crypto_session_cache sadc kmem_cache named unix:0:fcsm_job_cache sadc kmem_cache named unix:0:sd0_cache sadc kmem_cache named unix:0:hsfs_hsnode_cache sadc kmem_cache named unix:0:kmem_magazine_1 sadc misc named unix:0:system_misc sadc kmem_cache named unix:0:file_cache sadc vmem named vmem:16:kmem_oversize sadc ufs named ufs:0:inode_cache sadc misc raw unix:0:var sadc kmem_cache named unix:0:kmem_magazine_1 sadc kmem_cache named unix:0:kmem_magazine_3 sadc kmem_cache named unix:0:kmem_magazine_7 sadc kmem_cache named unix:0:kmem_magazine_15 sadc kmem_cache named unix:0:kmem_magazine_31 sadc kmem_cache named unix:0:kmem_magazine_47 sadc kmem_cache named unix:0:kmem_magazine_63 sadc kmem_cache named unix:0:kmem_magazine_95 sadc kmem_cache named unix:0:kmem_magazine_143 sadc kmem_cache named unix:0:kmem_slab_cache sadc kmem_cache named unix:0:kmem_bufctl_cache sadc kmem_cache named unix:0:kmem_bufctl_audit_cache sadc kmem_cache named unix:0:kmem_va_4096 sadc kmem_cache named unix:0:kmem_va_8192 sadc kmem_cache named unix:0:kmem_va_12288 sadc kmem_cache named unix:0:kmem_va_16384 sadc kmem_cache named unix:0:kmem_va_20480 sadc kmem_cache named unix:0:kmem_va_24576 sadc kmem_cache named unix:0:kmem_va_28672 sadc kmem_cache named unix:0:kmem_va_32768 sadc kmem_cache named unix:0:kmem_alloc_8 sadc kmem_cache named unix:0:kmem_alloc_16 sadc kmem_cache named unix:0:kmem_alloc_24 sadc kmem_cache named unix:0:kmem_alloc_32 sadc kmem_cache named unix:0:kmem_alloc_40 sadc kmem_cache named unix:0:kmem_alloc_48 sadc kmem_cache named unix:0:kmem_alloc_56 sadc kmem_cache named unix:0:kmem_alloc_64 sadc kmem_cache named unix:0:kmem_alloc_80 sadc kmem_cache named unix:0:kmem_alloc_96 sadc kmem_cache named unix:0:kmem_alloc_112 sadc kmem_cache named unix:0:kmem_alloc_128 sadc kmem_cache named unix:0:kmem_alloc_160 sadc kmem_cache named unix:0:kmem_alloc_192 sadc kmem_cache named unix:0:kmem_alloc_224 sadc kmem_cache named unix:0:kmem_alloc_256 sadc kmem_cache named unix:0:kmem_alloc_320 sadc kmem_cache named unix:0:kmem_alloc_384 sadc kmem_cache named unix:0:kmem_alloc_448 sadc kmem_cache named unix:0:kmem_alloc_512 sadc kmem_cache named unix:0:kmem_alloc_640 sadc kmem_cache named unix:0:kmem_alloc_768 sadc kmem_cache named unix:0:kmem_alloc_896 sadc kmem_cache named unix:0:kmem_alloc_1152 sadc kmem_cache named unix:0:kmem_alloc_1344 sadc kmem_cache named unix:0:kmem_alloc_1600 sadc kmem_cache named unix:0:kmem_alloc_2048 sadc kmem_cache named unix:0:kmem_alloc_2688 sadc kmem_cache named unix:0:kmem_alloc_4096 sadc kmem_cache named unix:0:kmem_alloc_8192 sadc kmem_cache named unix:0:kmem_alloc_12288 sadc kmem_cache named unix:0:kmem_alloc_16384 sadc kmem_cache named unix:0:streams_mblk sadc kmem_cache named unix:0:streams_dblk_64 sadc kmem_cache named unix:0:streams_dblk_128 sadc kmem_cache named unix:0:streams_dblk_320 sadc kmem_cache named unix:0:streams_dblk_576 sadc kmem_cache named unix:0:streams_dblk_1088 sadc kmem_cache named unix:0:streams_dblk_1536 sadc kmem_cache named unix:0:streams_dblk_1984 sadc kmem_cache named unix:0:streams_dblk_2624 sadc kmem_cache named unix:0:streams_dblk_3968 sadc kmem_cache named unix:0:streams_dblk_8192 sadc kmem_cache named unix:0:streams_dblk_12160 sadc kmem_cache named unix:0:streams_dblk_16384 sadc kmem_cache named unix:0:streams_dblk_20352 sadc kmem_cache named unix:0:streams_dblk_24576 sadc kmem_cache named unix:0:streams_dblk_28544 sadc kmem_cache named unix:0:streams_dblk_32768 sadc kmem_cache named unix:0:streams_dblk_36736 sadc kmem_cache named unix:0:streams_dblk_40960 sadc kmem_cache named unix:0:streams_dblk_44928 sadc kmem_cache named unix:0:streams_dblk_49152 sadc kmem_cache named unix:0:streams_dblk_53120 sadc kmem_cache named unix:0:streams_dblk_57344 sadc kmem_cache named unix:0:streams_dblk_61312 sadc kmem_cache named unix:0:streams_dblk_65536 sadc kmem_cache named unix:0:streams_dblk_69504 sadc kmem_cache named unix:0:streams_dblk_73728 sadc kmem_cache named unix:0:streams_dblk_esb sadc kmem_cache named unix:0:streams_fthdr sadc kmem_cache named unix:0:streams_ftblk sadc kmem_cache named unix:0:multidata sadc kmem_cache named unix:0:multidata_pdslab sadc kmem_cache named unix:0:multidata_pattbl sadc kmem_cache named unix:0:taskq_ent_cache sadc kmem_cache named unix:0:taskq_cache sadc kmem_cache named unix:0:kmem_io_512M_128 sadc kmem_cache named unix:0:kmem_io_512M_256 sadc kmem_cache named unix:0:kmem_io_512M_512 sadc kmem_cache named unix:0:kmem_io_512M_1024 sadc kmem_cache named unix:0:kmem_io_512M_2048 sadc kmem_cache named unix:0:kmem_io_512M_4096 sadc kmem_cache named unix:0:kmem_io_16M_128 sadc kmem_cache named unix:0:kmem_io_16M_256 sadc kmem_cache named unix:0:kmem_io_16M_512 sadc kmem_cache named unix:0:kmem_io_16M_1024 sadc kmem_cache named unix:0:kmem_io_16M_2048 sadc kmem_cache named unix:0:kmem_io_16M_4096 sadc kmem_cache named unix:0:id32_cache sadc kmem_cache named unix:0:bp_map_4096 sadc kmem_cache named unix:0:bp_map_8192 sadc kmem_cache named unix:0:bp_map_12288 sadc kmem_cache named unix:0:bp_map_16384 sadc kmem_cache named unix:0:bp_map_20480 sadc kmem_cache named unix:0:bp_map_24576 sadc kmem_cache named unix:0:bp_map_28672 sadc kmem_cache named unix:0:bp_map_32768 sadc kmem_cache named unix:0:mod_hash_entries sadc kmem_cache named unix:0:ipp_mod sadc kmem_cache named unix:0:ipp_action sadc kmem_cache named unix:0:ipp_packet sadc kmem_cache named unix:0:htable_t sadc kmem_cache named unix:0:hment_t sadc kmem_cache named unix:0:hat_t sadc kmem_cache named unix:0:HatHash sadc kmem_cache named unix:0:seg_cache sadc kmem_cache named unix:0:snode_cache sadc kmem_cache named unix:0:dv_node_cache sadc kmem_cache named unix:0:dev_info_node_cache sadc kmem_cache named unix:0:segkp_4096 sadc kmem_cache named unix:0:segkp_8192 sadc kmem_cache named unix:0:segkp_12288 sadc kmem_cache named unix:0:segkp_16384 sadc kmem_cache named unix:0:segkp_20480 sadc kmem_cache named unix:0:thread_cache sadc kmem_cache named unix:0:lwp_cache sadc kmem_cache named unix:0:turnstile_cache sadc kmem_cache named unix:0:cred_cache sadc kmem_cache named unix:0:rctl_cache sadc kmem_cache named unix:0:rctl_val_cache sadc kmem_cache named unix:0:task_cache sadc kmem_cache named unix:0:cyclic_id_cache sadc kmem_cache named unix:0:dnlc_space_cache sadc kmem_cache named unix:0:vn_cache sadc kmem_cache named unix:0:file_cache sadc kmem_cache named unix:0:stream_head_cache sadc kmem_cache named unix:0:queue_cache sadc kmem_cache named unix:0:syncq_cache sadc kmem_cache named unix:0:qband_cache sadc kmem_cache named unix:0:linkinfo_cache sadc kmem_cache named unix:0:ciputctrl_cache sadc kmem_cache named unix:0:serializer_cache sadc kmem_cache named unix:0:as_cache sadc kmem_cache named unix:0:marker_cache sadc kmem_cache named unix:0:anon_cache sadc kmem_cache named unix:0:anonmap_cache sadc kmem_cache named unix:0:segvn_cache sadc kmem_cache named unix:0:flk_edges sadc kmem_cache named unix:0:fdb_cache sadc kmem_cache named unix:0:timer_cache sadc kmem_cache named unix:0:physio_buf_cache sadc kmem_cache named unix:0:ufs_inode_cache sadc kmem_cache named unix:0:directio_buf_cache sadc kmem_cache named unix:0:lufs_save sadc kmem_cache named unix:0:lufs_bufs sadc kmem_cache named unix:0:lufs_mapentry_cache sadc misc raw cpu_stat:0:cpu_stat0 sadc kmem_cache named unix:0:kcf_sreq_cache sadc kmem_cache named unix:0:kcf_areq_cache sadc kmem_cache named unix:0:kcf_context_cache sadc kmem_cache named unix:0:ipsec_actions sadc kmem_cache named unix:0:ipsec_selectors sadc kmem_cache named unix:0:ipsec_policy sadc kmem_cache named unix:0:ipsec_info sadc kmem_cache named unix:0:ip_minor_arena_1 sadc kmem_cache named unix:0:ipcl_conn_cache sadc kmem_cache named unix:0:ipcl_tcpconn_cache sadc kmem_cache named unix:0:ire_cache sadc kmem_cache named unix:0:tcp_timercache sadc kmem_cache named unix:0:tcp_sack_info_cache sadc kmem_cache named unix:0:tcp_iphc_cache sadc kmem_cache named unix:0:squeue_cache sadc kmem_cache named unix:0:sctp_conn_cache sadc kmem_cache named unix:0:sctp_faddr_cache sadc kmem_cache named unix:0:sctp_set_cache sadc kmem_cache named unix:0:sctp_ftsn_set_cache sadc kmem_cache named unix:0:sctpsock sadc kmem_cache named unix:0:sctp_assoc sadc kmem_cache named unix:0:socktpi_cache sadc kmem_cache named unix:0:socktpi_unix_cache sadc kmem_cache named unix:0:ncafs_cache sadc kmem_cache named unix:0:process_cache sadc kmem_cache named unix:0:exacct_object_cache sadc kmem_cache named unix:0:fctl_cache sadc kmem_cache named unix:0:tl_cache sadc kmem_cache named unix:0:keysock_1 sadc kmem_cache named unix:0:spdsock_1 sadc kmem_cache named unix:0:fnode_cache sadc kmem_cache named unix:0:pipe_cache sadc kmem_cache named unix:0:namefs_inodes_1 sadc kmem_cache named unix:0:port_cache sadc kmem_cache named unix:0:lnode_cache sadc kmem_cache named unix:0:clnt_clts_endpnt_cache sadc kmem_cache named unix:0:pty_map sadc kmem_cache named unix:0:sppptun_map sadc kmem_cache named unix:0:dtrace_state_cache sadc kmem_cache named unix:0:qif_head_cache sadc kmem_cache named unix:0:udp_minor_1 sadc kmem_cache named unix:0:authkern_cache sadc kmem_cache named unix:0:authloopback_cache sadc kmem_cache named unix:0:authdes_cache_handle sadc kmem_cache named unix:0:rnode_cache sadc kmem_cache named unix:0:nfs_access_cache sadc kmem_cache named unix:0:client_handle_cache sadc kmem_cache named unix:0:rnode4_cache sadc kmem_cache named unix:0:svnode_cache sadc kmem_cache named unix:0:nfs4_access_cache sadc kmem_cache named unix:0:client_handle4_cache sadc kmem_cache named unix:0:nfs4_ace4vals_cache sadc kmem_cache named unix:0:nfs4_ace4_list_cache sadc kmem_cache named unix:0:NFS_idmap_cache sadc kmem_cache named unix:0:lm_vnode sadc kmem_cache named unix:0:lm_xprt sadc kmem_cache named unix:0:lm_sysid sadc kmem_cache named unix:0:lm_client sadc kmem_cache named unix:0:lm_async sadc kmem_cache named unix:0:lm_sleep sadc kmem_cache named unix:0:lm_config sadc kmem_cache named unix:0:nfslog_small_rec sadc kmem_cache named unix:0:nfslog_medium_rec sadc kmem_cache named unix:0:nfslog_large_rec sadc kmem_cache named unix:0:exi_cache_handle sadc kmem_cache named unix:0:Client_entry_cache sadc kmem_cache named unix:0:OpenOwner_entry_cache sadc kmem_cache named unix:0:OpenStateID_entry_cache sadc kmem_cache named unix:0:LockStateID_entry_cache sadc kmem_cache named unix:0:Lockowner_entry_cache sadc kmem_cache named unix:0:File_entry_cache sadc kmem_cache named unix:0:DelegStateID_entry_cache sadc kmem_cache named unix:0:ip_minor_1 sadc kmem_cache named unix:0:ar_minor_1 sadc kmem_cache named unix:0:icmp_minor_1 sadc kmem_cache named unix:0:crypto_session_cache sadc kmem_cache named unix:0:fcsm_job_cache sadc kmem_cache named unix:0:sd0_cache sadc kmem_cache named unix:0:hsfs_hsnode_cache sadc kmem_cache named unix:0:kmem_magazine_1 sadc misc raw unix:0:sysinfo sadc vm raw unix:0:vminfo sadc misc named unix:0:system_misc sadc kmem_cache named unix:0:file_cache sadc ufs named ufs:0:inode_cache sadc misc raw cpu_stat:0:cpu_stat0 sadc kmem_cache named unix:0:kmem_magazine_1 sadc kmem_cache named unix:0:kmem_magazine_3 sadc kmem_cache named unix:0:kmem_magazine_7 sadc kmem_cache named unix:0:kmem_magazine_15 sadc kmem_cache named unix:0:kmem_magazine_31 sadc kmem_cache named unix:0:kmem_magazine_47 sadc kmem_cache named unix:0:kmem_magazine_63 sadc kmem_cache named unix:0:kmem_magazine_95 sadc kmem_cache named unix:0:kmem_magazine_143 sadc kmem_cache named unix:0:kmem_slab_cache sadc kmem_cache named unix:0:kmem_bufctl_cache sadc kmem_cache named unix:0:kmem_bufctl_audit_cache sadc kmem_cache named unix:0:kmem_va_4096 sadc kmem_cache named unix:0:kmem_va_8192 sadc kmem_cache named unix:0:kmem_va_12288 sadc kmem_cache named unix:0:kmem_va_16384 sadc kmem_cache named unix:0:kmem_va_20480 sadc kmem_cache named unix:0:kmem_va_24576 sadc kmem_cache named unix:0:kmem_va_28672 sadc kmem_cache named unix:0:kmem_va_32768 sadc kmem_cache named unix:0:kmem_alloc_8 sadc kmem_cache named unix:0:kmem_alloc_16 sadc kmem_cache named unix:0:kmem_alloc_24 sadc kmem_cache named unix:0:kmem_alloc_32 sadc kmem_cache named unix:0:kmem_alloc_40 sadc kmem_cache named unix:0:kmem_alloc_48 sadc kmem_cache named unix:0:kmem_alloc_56 sadc kmem_cache named unix:0:kmem_alloc_64 sadc kmem_cache named unix:0:kmem_alloc_80 sadc kmem_cache named unix:0:kmem_alloc_96 sadc kmem_cache named unix:0:kmem_alloc_112 sadc kmem_cache named unix:0:kmem_alloc_128 sadc kmem_cache named unix:0:kmem_alloc_160 sadc kmem_cache named unix:0:kmem_alloc_192 sadc kmem_cache named unix:0:kmem_alloc_224 sadc kmem_cache named unix:0:kmem_alloc_256 sadc kmem_cache named unix:0:kmem_alloc_320 sadc kmem_cache named unix:0:kmem_alloc_384 sadc kmem_cache named unix:0:kmem_alloc_448 sadc kmem_cache named unix:0:kmem_alloc_512 sadc kmem_cache named unix:0:kmem_alloc_640 sadc kmem_cache named unix:0:kmem_alloc_768 sadc kmem_cache named unix:0:kmem_alloc_896 sadc kmem_cache named unix:0:kmem_alloc_1152 sadc kmem_cache named unix:0:kmem_alloc_1344 sadc kmem_cache named unix:0:kmem_alloc_1600 sadc kmem_cache named unix:0:kmem_alloc_2048 sadc kmem_cache named unix:0:kmem_alloc_2688 sadc kmem_cache named unix:0:kmem_alloc_4096 sadc kmem_cache named unix:0:kmem_alloc_8192 sadc kmem_cache named unix:0:kmem_alloc_12288 sadc kmem_cache named unix:0:kmem_alloc_16384 sadc kmem_cache named unix:0:streams_mblk sadc kmem_cache named unix:0:streams_dblk_64 sadc kmem_cache named unix:0:streams_dblk_128 sadc kmem_cache named unix:0:streams_dblk_320 sadc kmem_cache named unix:0:streams_dblk_576 sadc kmem_cache named unix:0:streams_dblk_1088 sadc kmem_cache named unix:0:streams_dblk_1536 sadc kmem_cache named unix:0:streams_dblk_1984 sadc kmem_cache named unix:0:streams_dblk_2624 sadc kmem_cache named unix:0:streams_dblk_3968 sadc kmem_cache named unix:0:streams_dblk_8192 sadc kmem_cache named unix:0:streams_dblk_12160 sadc kmem_cache named unix:0:streams_dblk_16384 sadc kmem_cache named unix:0:streams_dblk_20352 sadc kmem_cache named unix:0:streams_dblk_24576 sadc kmem_cache named unix:0:streams_dblk_28544 sadc kmem_cache named unix:0:streams_dblk_32768 sadc kmem_cache named unix:0:streams_dblk_36736 sadc kmem_cache named unix:0:streams_dblk_40960 sadc kmem_cache named unix:0:streams_dblk_44928 sadc kmem_cache named unix:0:streams_dblk_49152 sadc kmem_cache named unix:0:streams_dblk_53120 sadc kmem_cache named unix:0:streams_dblk_57344 sadc kmem_cache named unix:0:streams_dblk_61312 sadc kmem_cache named unix:0:streams_dblk_65536 sadc kmem_cache named unix:0:streams_dblk_69504 sadc kmem_cache named unix:0:streams_dblk_73728 sadc kmem_cache named unix:0:streams_dblk_esb sadc kmem_cache named unix:0:streams_fthdr sadc kmem_cache named unix:0:streams_ftblk sadc kmem_cache named unix:0:multidata sadc kmem_cache named unix:0:multidata_pdslab sadc kmem_cache named unix:0:multidata_pattbl sadc kmem_cache named unix:0:taskq_ent_cache sadc kmem_cache named unix:0:taskq_cache sadc kmem_cache named unix:0:kmem_io_512M_128 sadc kmem_cache named unix:0:kmem_io_512M_256 sadc kmem_cache named unix:0:kmem_io_512M_512 sadc kmem_cache named unix:0:kmem_io_512M_1024 sadc kmem_cache named unix:0:kmem_io_512M_2048 sadc kmem_cache named unix:0:kmem_io_512M_4096 sadc kmem_cache named unix:0:kmem_io_16M_128 sadc kmem_cache named unix:0:kmem_io_16M_256 sadc kmem_cache named unix:0:kmem_io_16M_512 sadc kmem_cache named unix:0:kmem_io_16M_1024 sadc kmem_cache named unix:0:kmem_io_16M_2048 sadc kmem_cache named unix:0:kmem_io_16M_4096 sadc kmem_cache named unix:0:id32_cache sadc kmem_cache named unix:0:bp_map_4096 sadc kmem_cache named unix:0:bp_map_8192 sadc kmem_cache named unix:0:bp_map_12288 sadc kmem_cache named unix:0:bp_map_16384 sadc kmem_cache named unix:0:bp_map_20480 sadc kmem_cache named unix:0:bp_map_24576 sadc kmem_cache named unix:0:bp_map_28672 sadc kmem_cache named unix:0:bp_map_32768 sadc kmem_cache named unix:0:mod_hash_entries sadc kmem_cache named unix:0:ipp_mod sadc kmem_cache named unix:0:ipp_action sadc kmem_cache named unix:0:ipp_packet sadc kmem_cache named unix:0:htable_t sadc kmem_cache named unix:0:hment_t sadc kmem_cache named unix:0:hat_t sadc kmem_cache named unix:0:HatHash sadc kmem_cache named unix:0:seg_cache sadc kmem_cache named unix:0:snode_cache sadc kmem_cache named unix:0:dv_node_cache sadc kmem_cache named unix:0:dev_info_node_cache sadc kmem_cache named unix:0:segkp_4096 sadc kmem_cache named unix:0:segkp_8192 sadc kmem_cache named unix:0:segkp_12288 sadc kmem_cache named unix:0:segkp_16384 sadc kmem_cache named unix:0:segkp_20480 sadc kmem_cache named unix:0:thread_cache sadc kmem_cache named unix:0:lwp_cache sadc kmem_cache named unix:0:turnstile_cache sadc kmem_cache named unix:0:cred_cache sadc kmem_cache named unix:0:rctl_cache sadc kmem_cache named unix:0:rctl_val_cache sadc kmem_cache named unix:0:task_cache sadc kmem_cache named unix:0:cyclic_id_cache sadc kmem_cache named unix:0:dnlc_space_cache sadc kmem_cache named unix:0:vn_cache sadc kmem_cache named unix:0:file_cache sadc kmem_cache named unix:0:stream_head_cache sadc kmem_cache named unix:0:queue_cache sadc kmem_cache named unix:0:syncq_cache sadc kmem_cache named unix:0:qband_cache sadc kmem_cache named unix:0:linkinfo_cache sadc kmem_cache named unix:0:ciputctrl_cache sadc kmem_cache named unix:0:serializer_cache sadc kmem_cache named unix:0:as_cache sadc kmem_cache named unix:0:marker_cache sadc kmem_cache named unix:0:anon_cache sadc kmem_cache named unix:0:anonmap_cache sadc kmem_cache named unix:0:segvn_cache sadc kmem_cache named unix:0:flk_edges sadc kmem_cache named unix:0:fdb_cache sadc kmem_cache named unix:0:timer_cache sadc kmem_cache named unix:0:physio_buf_cache sadc kmem_cache named unix:0:ufs_inode_cache sadc kmem_cache named unix:0:directio_buf_cache sadc kmem_cache named unix:0:lufs_save sadc kmem_cache named unix:0:lufs_bufs sadc kmem_cache named unix:0:lufs_mapentry_cache sadc kmem_cache named unix:0:kcf_sreq_cache sadc kmem_cache named unix:0:kcf_areq_cache sadc kmem_cache named unix:0:kcf_context_cache sadc kmem_cache named unix:0:ipsec_actions sadc kmem_cache named unix:0:ipsec_selectors sadc kmem_cache named unix:0:ipsec_policy sadc kmem_cache named unix:0:ipsec_info sadc kmem_cache named unix:0:ip_minor_arena_1 sadc kmem_cache named unix:0:ipcl_conn_cache sadc kmem_cache named unix:0:ipcl_tcpconn_cache sadc kmem_cache named unix:0:ire_cache sadc kmem_cache named unix:0:tcp_timercache sadc kmem_cache named unix:0:tcp_sack_info_cache sadc kmem_cache named unix:0:tcp_iphc_cache sadc kmem_cache named unix:0:squeue_cache sadc kmem_cache named unix:0:sctp_conn_cache sadc kmem_cache named unix:0:sctp_faddr_cache sadc kmem_cache named unix:0:sctp_set_cache sadc kmem_cache named unix:0:sctp_ftsn_set_cache sadc kmem_cache named unix:0:sctpsock sadc kmem_cache named unix:0:sctp_assoc sadc kmem_cache named unix:0:socktpi_cache sadc kmem_cache named unix:0:socktpi_unix_cache sadc kmem_cache named unix:0:ncafs_cache sadc kmem_cache named unix:0:process_cache sadc kmem_cache named unix:0:exacct_object_cache sadc kmem_cache named unix:0:fctl_cache sadc kmem_cache named unix:0:tl_cache sadc kmem_cache named unix:0:keysock_1 sadc kmem_cache named unix:0:spdsock_1 sadc kmem_cache named unix:0:fnode_cache sadc kmem_cache named unix:0:pipe_cache sadc kmem_cache named unix:0:namefs_inodes_1 sadc kmem_cache named unix:0:port_cache sadc kmem_cache named unix:0:lnode_cache sadc kmem_cache named unix:0:clnt_clts_endpnt_cache sadc kmem_cache named unix:0:pty_map sadc kmem_cache named unix:0:sppptun_map sadc kmem_cache named unix:0:dtrace_state_cache sadc kmem_cache named unix:0:qif_head_cache sadc kmem_cache named unix:0:udp_minor_1 sadc kmem_cache named unix:0:authkern_cache sadc kmem_cache named unix:0:authloopback_cache sadc kmem_cache named unix:0:authdes_cache_handle sadc kmem_cache named unix:0:rnode_cache sadc kmem_cache named unix:0:nfs_access_cache sadc kmem_cache named unix:0:client_handle_cache sadc kmem_cache named unix:0:rnode4_cache sadc kmem_cache named unix:0:svnode_cache sadc kmem_cache named unix:0:nfs4_access_cache sadc kmem_cache named unix:0:client_handle4_cache sadc kmem_cache named unix:0:nfs4_ace4vals_cache sadc kmem_cache named unix:0:nfs4_ace4_list_cache sadc kmem_cache named unix:0:NFS_idmap_cache sadc kmem_cache named unix:0:lm_vnode sadc kmem_cache named unix:0:lm_xprt sadc kmem_cache named unix:0:lm_sysid sadc kmem_cache named unix:0:lm_client sadc kmem_cache named unix:0:lm_async sadc kmem_cache named unix:0:lm_sleep sadc kmem_cache named unix:0:lm_config sadc kmem_cache named unix:0:nfslog_small_rec sadc kmem_cache named unix:0:nfslog_medium_rec sadc kmem_cache named unix:0:nfslog_large_rec sadc kmem_cache named unix:0:exi_cache_handle sadc kmem_cache named unix:0:Client_entry_cache sadc kmem_cache named unix:0:OpenOwner_entry_cache sadc kmem_cache named unix:0:OpenStateID_entry_cache sadc kmem_cache named unix:0:LockStateID_entry_cache sadc kmem_cache named unix:0:Lockowner_entry_cache sadc kmem_cache named unix:0:File_entry_cache sadc kmem_cache named unix:0:DelegStateID_entry_cache sadc kmem_cache named unix:0:ip_minor_1 sadc kmem_cache named unix:0:ar_minor_1 sadc kmem_cache named unix:0:icmp_minor_1 sadc kmem_cache named unix:0:crypto_session_cache sadc kmem_cache named unix:0:fcsm_job_cache sadc kmem_cache named unix:0:sd0_cache sadc kmem_cache named unix:0:hsfs_hsnode_cache sadc vmem named vmem:16:kmem_oversize sadc disk io cmdk:0:cmdk0 sadc nfs io nfs:1:nfs1 sadc disk io sd:0:sd0 sadc usb_byte_count io usba:0:uhci0,bulk sadc usb_byte_count io usba:0:uhci0,ctrl sadc usb_byte_count io usba:0:uhci0,intr sadc usb_byte_count io usba:0:uhci0,isoch sadc usb_byte_count io usba:0:uhci0,total sadc usb_byte_count io usba:1:uhci1,bulk sadc usb_byte_count io usba:1:uhci1,ctrl sadc usb_byte_count io usba:1:uhci1,intr sadc usb_byte_count io usba:1:uhci1,isoch sadc usb_byte_count io usba:1:uhci1,total sadc misc named unix:0:system_misc sadc kmem_cache named unix:0:file_cache sadc vmem named vmem:16:kmem_oversize sadc ufs named ufs:0:inode_cache sadc misc raw unix:0:var sadc kmem_cache named unix:0:kmem_magazine_1 sadc kmem_cache named unix:0:kmem_magazine_3 sadc kmem_cache named unix:0:kmem_magazine_7 sadc kmem_cache named unix:0:kmem_magazine_15 sadc kmem_cache named unix:0:kmem_magazine_31 sadc kmem_cache named unix:0:kmem_magazine_47 sadc kmem_cache named unix:0:kmem_magazine_63 sadc kmem_cache named unix:0:kmem_magazine_95 sadc kmem_cache named unix:0:kmem_magazine_143 sadc kmem_cache named unix:0:kmem_slab_cache sadc kmem_cache named unix:0:kmem_bufctl_cache sadc kmem_cache named unix:0:kmem_bufctl_audit_cache sadc kmem_cache named unix:0:kmem_va_4096 sadc kmem_cache named unix:0:kmem_va_8192 sadc kmem_cache named unix:0:kmem_va_12288 sadc kmem_cache named unix:0:kmem_va_16384 sadc kmem_cache named unix:0:kmem_va_20480 sadc kmem_cache named unix:0:kmem_va_24576 sadc kmem_cache named unix:0:kmem_va_28672 sadc kmem_cache named unix:0:kmem_va_32768 sadc kmem_cache named unix:0:kmem_alloc_8 sadc kmem_cache named unix:0:kmem_alloc_16 sadc kmem_cache named unix:0:kmem_alloc_24 sadc kmem_cache named unix:0:kmem_alloc_32 sadc kmem_cache named unix:0:kmem_alloc_40 sadc kmem_cache named unix:0:kmem_alloc_48 sadc kmem_cache named unix:0:kmem_alloc_56 sadc kmem_cache named unix:0:kmem_alloc_64 sadc kmem_cache named unix:0:kmem_alloc_80 sadc kmem_cache named unix:0:kmem_alloc_96 sadc kmem_cache named unix:0:kmem_alloc_112 sadc kmem_cache named unix:0:kmem_alloc_128 sadc kmem_cache named unix:0:kmem_alloc_160 sadc kmem_cache named unix:0:kmem_alloc_192 sadc kmem_cache named unix:0:kmem_alloc_224 sadc kmem_cache named unix:0:kmem_alloc_256 sadc kmem_cache named unix:0:kmem_alloc_320 sadc kmem_cache named unix:0:kmem_alloc_384 sadc kmem_cache named unix:0:kmem_alloc_448 sadc kmem_cache named unix:0:kmem_alloc_512 sadc kmem_cache named unix:0:kmem_alloc_640 sadc kmem_cache named unix:0:kmem_alloc_768 sadc kmem_cache named unix:0:kmem_alloc_896 sadc kmem_cache named unix:0:kmem_alloc_1152 sadc kmem_cache named unix:0:kmem_alloc_1344 sadc kmem_cache named unix:0:kmem_alloc_1600 sadc kmem_cache named unix:0:kmem_alloc_2048 sadc kmem_cache named unix:0:kmem_alloc_2688 sadc kmem_cache named unix:0:kmem_alloc_4096 sadc kmem_cache named unix:0:kmem_alloc_8192 sadc kmem_cache named unix:0:kmem_alloc_12288 sadc kmem_cache named unix:0:kmem_alloc_16384 sadc kmem_cache named unix:0:streams_mblk sadc kmem_cache named unix:0:streams_dblk_64 sadc kmem_cache named unix:0:streams_dblk_128 sadc kmem_cache named unix:0:streams_dblk_320 sadc kmem_cache named unix:0:streams_dblk_576 sadc kmem_cache named unix:0:streams_dblk_1088 sadc kmem_cache named unix:0:streams_dblk_1536 sadc kmem_cache named unix:0:streams_dblk_1984 sadc kmem_cache named unix:0:streams_dblk_2624 sadc kmem_cache named unix:0:streams_dblk_3968 sadc kmem_cache named unix:0:streams_dblk_8192 sadc kmem_cache named unix:0:streams_dblk_12160 sadc kmem_cache named unix:0:streams_dblk_16384 sadc kmem_cache named unix:0:streams_dblk_20352 sadc kmem_cache named unix:0:streams_dblk_24576 sadc kmem_cache named unix:0:streams_dblk_28544 sadc kmem_cache named unix:0:streams_dblk_32768 sadc kmem_cache named unix:0:streams_dblk_36736 sadc kmem_cache named unix:0:streams_dblk_40960 sadc kmem_cache named unix:0:streams_dblk_44928 sadc kmem_cache named unix:0:streams_dblk_49152 sadc kmem_cache named unix:0:streams_dblk_53120 sadc kmem_cache named unix:0:streams_dblk_57344 sadc kmem_cache named unix:0:streams_dblk_61312 sadc kmem_cache named unix:0:streams_dblk_65536 sadc kmem_cache named unix:0:streams_dblk_69504 sadc kmem_cache named unix:0:streams_dblk_73728 sadc kmem_cache named unix:0:streams_dblk_esb sadc kmem_cache named unix:0:streams_fthdr sadc kmem_cache named unix:0:streams_ftblk sadc kmem_cache named unix:0:multidata sadc kmem_cache named unix:0:multidata_pdslab sadc kmem_cache named unix:0:multidata_pattbl sadc kmem_cache named unix:0:taskq_ent_cache sadc kmem_cache named unix:0:taskq_cache sadc kmem_cache named unix:0:kmem_io_512M_128 sadc kmem_cache named unix:0:kmem_io_512M_256 sadc kmem_cache named unix:0:kmem_io_512M_512 sadc kmem_cache named unix:0:kmem_io_512M_1024 sadc kmem_cache named unix:0:kmem_io_512M_2048 sadc kmem_cache named unix:0:kmem_io_512M_4096 sadc kmem_cache named unix:0:kmem_io_16M_128 sadc kmem_cache named unix:0:kmem_io_16M_256 sadc kmem_cache named unix:0:kmem_io_16M_512 sadc kmem_cache named unix:0:kmem_io_16M_1024 sadc kmem_cache named unix:0:kmem_io_16M_2048 sadc kmem_cache named unix:0:kmem_io_16M_4096 sadc kmem_cache named unix:0:id32_cache sadc kmem_cache named unix:0:bp_map_4096 sadc kmem_cache named unix:0:bp_map_8192 sadc kmem_cache named unix:0:bp_map_12288 sadc kmem_cache named unix:0:bp_map_16384 sadc kmem_cache named unix:0:bp_map_20480 sadc kmem_cache named unix:0:bp_map_24576 sadc kmem_cache named unix:0:bp_map_28672 sadc kmem_cache named unix:0:bp_map_32768 sadc kmem_cache named unix:0:mod_hash_entries sadc kmem_cache named unix:0:ipp_mod sadc kmem_cache named unix:0:ipp_action sadc kmem_cache named unix:0:ipp_packet sadc kmem_cache named unix:0:htable_t sadc kmem_cache named unix:0:hment_t sadc kmem_cache named unix:0:hat_t sadc kmem_cache named unix:0:HatHash sadc kmem_cache named unix:0:seg_cache sadc kmem_cache named unix:0:snode_cache sadc kmem_cache named unix:0:dv_node_cache sadc kmem_cache named unix:0:dev_info_node_cache sadc kmem_cache named unix:0:segkp_4096 sadc kmem_cache named unix:0:segkp_8192 sadc kmem_cache named unix:0:segkp_12288 sadc kmem_cache named unix:0:segkp_16384 sadc kmem_cache named unix:0:segkp_20480 sadc kmem_cache named unix:0:thread_cache sadc kmem_cache named unix:0:lwp_cache sadc kmem_cache named unix:0:turnstile_cache sadc kmem_cache named unix:0:cred_cache sadc kmem_cache named unix:0:rctl_cache sadc kmem_cache named unix:0:rctl_val_cache sadc kmem_cache named unix:0:task_cache sadc kmem_cache named unix:0:cyclic_id_cache sadc kmem_cache named unix:0:dnlc_space_cache sadc kmem_cache named unix:0:vn_cache sadc kmem_cache named unix:0:file_cache sadc kmem_cache named unix:0:stream_head_cache sadc kmem_cache named unix:0:queue_cache sadc kmem_cache named unix:0:syncq_cache sadc kmem_cache named unix:0:qband_cache sadc kmem_cache named unix:0:linkinfo_cache sadc kmem_cache named unix:0:ciputctrl_cache sadc kmem_cache named unix:0:serializer_cache sadc kmem_cache named unix:0:as_cache sadc kmem_cache named unix:0:marker_cache sadc kmem_cache named unix:0:anon_cache sadc kmem_cache named unix:0:anonmap_cache sadc kmem_cache named unix:0:segvn_cache sadc kmem_cache named unix:0:flk_edges sadc kmem_cache named unix:0:fdb_cache sadc kmem_cache named unix:0:timer_cache sadc kmem_cache named unix:0:physio_buf_cache sadc kmem_cache named unix:0:ufs_inode_cache sadc kmem_cache named unix:0:directio_buf_cache sadc kmem_cache named unix:0:lufs_save sadc kmem_cache named unix:0:lufs_bufs sadc kmem_cache named unix:0:lufs_mapentry_cache sadc misc raw cpu_stat:0:cpu_stat0 sadc kmem_cache named unix:0:kcf_sreq_cache sadc kmem_cache named unix:0:kcf_areq_cache sadc kmem_cache named unix:0:kcf_context_cache sadc kmem_cache named unix:0:ipsec_actions sadc kmem_cache named unix:0:ipsec_selectors sadc kmem_cache named unix:0:ipsec_policy sadc kmem_cache named unix:0:ipsec_info sadc kmem_cache named unix:0:ip_minor_arena_1 sadc kmem_cache named unix:0:ipcl_conn_cache sadc kmem_cache named unix:0:ipcl_tcpconn_cache sadc kmem_cache named unix:0:ire_cache sadc kmem_cache named unix:0:tcp_timercache sadc kmem_cache named unix:0:tcp_sack_info_cache sadc kmem_cache named unix:0:tcp_iphc_cache sadc kmem_cache named unix:0:squeue_cache sadc kmem_cache named unix:0:sctp_conn_cache sadc kmem_cache named unix:0:sctp_faddr_cache sadc kmem_cache named unix:0:sctp_set_cache sadc kmem_cache named unix:0:sctp_ftsn_set_cache sadc kmem_cache named unix:0:sctpsock sadc kmem_cache named unix:0:sctp_assoc sadc kmem_cache named unix:0:socktpi_cache sadc kmem_cache named unix:0:socktpi_unix_cache sadc kmem_cache named unix:0:ncafs_cache sadc kmem_cache named unix:0:process_cache sadc kmem_cache named unix:0:exacct_object_cache sadc kmem_cache named unix:0:fctl_cache sadc kmem_cache named unix:0:tl_cache sadc kmem_cache named unix:0:keysock_1 sadc kmem_cache named unix:0:spdsock_1 sadc kmem_cache named unix:0:fnode_cache sadc kmem_cache named unix:0:pipe_cache sadc kmem_cache named unix:0:namefs_inodes_1 sadc kmem_cache named unix:0:port_cache sadc kmem_cache named unix:0:lnode_cache sadc kmem_cache named unix:0:clnt_clts_endpnt_cache sadc kmem_cache named unix:0:pty_map sadc kmem_cache named unix:0:sppptun_map sadc kmem_cache named unix:0:dtrace_state_cache sadc kmem_cache named unix:0:qif_head_cache sadc kmem_cache named unix:0:udp_minor_1 sadc kmem_cache named unix:0:authkern_cache sadc kmem_cache named unix:0:authloopback_cache sadc kmem_cache named unix:0:authdes_cache_handle sadc kmem_cache named unix:0:rnode_cache sadc kmem_cache named unix:0:nfs_access_cache sadc kmem_cache named unix:0:client_handle_cache sadc kmem_cache named unix:0:rnode4_cache sadc kmem_cache named unix:0:svnode_cache sadc kmem_cache named unix:0:nfs4_access_cache sadc kmem_cache named unix:0:client_handle4_cache sadc kmem_cache named unix:0:nfs4_ace4vals_cache sadc kmem_cache named unix:0:nfs4_ace4_list_cache sadc kmem_cache named unix:0:NFS_idmap_cache sadc kmem_cache named unix:0:lm_vnode sadc kmem_cache named unix:0:lm_xprt sadc kmem_cache named unix:0:lm_sysid sadc kmem_cache named unix:0:lm_client sadc kmem_cache named unix:0:lm_async sadc kmem_cache named unix:0:lm_sleep sadc kmem_cache named unix:0:lm_config sadc kmem_cache named unix:0:nfslog_small_rec sadc kmem_cache named unix:0:nfslog_medium_rec sadc kmem_cache named unix:0:nfslog_large_rec sadc kmem_cache named unix:0:exi_cache_handle sadc kmem_cache named unix:0:Client_entry_cache sadc kmem_cache named unix:0:OpenOwner_entry_cache sadc kmem_cache named unix:0:OpenStateID_entry_cache sadc kmem_cache named unix:0:LockStateID_entry_cache sadc kmem_cache named unix:0:Lockowner_entry_cache sadc kmem_cache named unix:0:File_entry_cache sadc kmem_cache named unix:0:DelegStateID_entry_cache sadc kmem_cache named unix:0:ip_minor_1 sadc kmem_cache named unix:0:ar_minor_1 sadc kmem_cache named unix:0:icmp_minor_1 sadc kmem_cache named unix:0:crypto_session_cache sadc kmem_cache named unix:0:fcsm_job_cache sadc kmem_cache named unix:0:sd0_cache sadc kmem_cache named unix:0:hsfs_hsnode_cache sadc kmem_cache named unix:0:kmem_magazine_1 sadc misc raw unix:0:sysinfo sadc vm raw unix:0:vminfo sadc misc named unix:0:system_misc sadc kmem_cache named unix:0:file_cache sadc ufs named ufs:0:inode_cache sadc misc raw cpu_stat:0:cpu_stat0 sadc kmem_cache named unix:0:kmem_magazine_1 sadc kmem_cache named unix:0:kmem_magazine_3 sadc kmem_cache named unix:0:kmem_magazine_7 sadc kmem_cache named unix:0:kmem_magazine_15 sadc kmem_cache named unix:0:kmem_magazine_31 sadc kmem_cache named unix:0:kmem_magazine_47 sadc kmem_cache named unix:0:kmem_magazine_63 sadc kmem_cache named unix:0:kmem_magazine_95 sadc kmem_cache named unix:0:kmem_magazine_143 sadc kmem_cache named unix:0:kmem_slab_cache sadc kmem_cache named unix:0:kmem_bufctl_cache sadc kmem_cache named unix:0:kmem_bufctl_audit_cache sadc kmem_cache named unix:0:kmem_va_4096 sadc kmem_cache named unix:0:kmem_va_8192 sadc kmem_cache named unix:0:kmem_va_12288 sadc kmem_cache named unix:0:kmem_va_16384 sadc kmem_cache named unix:0:kmem_va_20480 sadc kmem_cache named unix:0:kmem_va_24576 sadc kmem_cache named unix:0:kmem_va_28672 sadc kmem_cache named unix:0:kmem_va_32768 sadc kmem_cache named unix:0:kmem_alloc_8 sadc kmem_cache named unix:0:kmem_alloc_16 sadc kmem_cache named unix:0:kmem_alloc_24 sadc kmem_cache named unix:0:kmem_alloc_32 sadc kmem_cache named unix:0:kmem_alloc_40 sadc kmem_cache named unix:0:kmem_alloc_48 sadc kmem_cache named unix:0:kmem_alloc_56 sadc kmem_cache named unix:0:kmem_alloc_64 sadc kmem_cache named unix:0:kmem_alloc_80 sadc kmem_cache named unix:0:kmem_alloc_96 sadc kmem_cache named unix:0:kmem_alloc_112 sadc kmem_cache named unix:0:kmem_alloc_128 sadc kmem_cache named unix:0:kmem_alloc_160 sadc kmem_cache named unix:0:kmem_alloc_192 sadc kmem_cache named unix:0:kmem_alloc_224 sadc kmem_cache named unix:0:kmem_alloc_256 sadc kmem_cache named unix:0:kmem_alloc_320 sadc kmem_cache named unix:0:kmem_alloc_384 sadc kmem_cache named unix:0:kmem_alloc_448 sadc kmem_cache named unix:0:kmem_alloc_512 sadc kmem_cache named unix:0:kmem_alloc_640 sadc kmem_cache named unix:0:kmem_alloc_768 sadc kmem_cache named unix:0:kmem_alloc_896 sadc kmem_cache named unix:0:kmem_alloc_1152 sadc kmem_cache named unix:0:kmem_alloc_1344 sadc kmem_cache named unix:0:kmem_alloc_1600 sadc kmem_cache named unix:0:kmem_alloc_2048 sadc kmem_cache named unix:0:kmem_alloc_2688 sadc kmem_cache named unix:0:kmem_alloc_4096 sadc kmem_cache named unix:0:kmem_alloc_8192 sadc kmem_cache named unix:0:kmem_alloc_12288 sadc kmem_cache named unix:0:kmem_alloc_16384 sadc kmem_cache named unix:0:streams_mblk sadc kmem_cache named unix:0:streams_dblk_64 sadc kmem_cache named unix:0:streams_dblk_128 sadc kmem_cache named unix:0:streams_dblk_320 sadc kmem_cache named unix:0:streams_dblk_576 sadc kmem_cache named unix:0:streams_dblk_1088 sadc kmem_cache named unix:0:streams_dblk_1536 sadc kmem_cache named unix:0:streams_dblk_1984 sadc kmem_cache named unix:0:streams_dblk_2624 sadc kmem_cache named unix:0:streams_dblk_3968 sadc kmem_cache named unix:0:streams_dblk_8192 sadc kmem_cache named unix:0:streams_dblk_12160 sadc kmem_cache named unix:0:streams_dblk_16384 sadc kmem_cache named unix:0:streams_dblk_20352 sadc kmem_cache named unix:0:streams_dblk_24576 sadc kmem_cache named unix:0:streams_dblk_28544 sadc kmem_cache named unix:0:streams_dblk_32768 sadc kmem_cache named unix:0:streams_dblk_36736 sadc kmem_cache named unix:0:streams_dblk_40960 sadc kmem_cache named unix:0:streams_dblk_44928 sadc kmem_cache named unix:0:streams_dblk_49152 sadc kmem_cache named unix:0:streams_dblk_53120 sadc kmem_cache named unix:0:streams_dblk_57344 sadc kmem_cache named unix:0:streams_dblk_61312 sadc kmem_cache named unix:0:streams_dblk_65536 sadc kmem_cache named unix:0:streams_dblk_69504 sadc kmem_cache named unix:0:streams_dblk_73728 sadc kmem_cache named unix:0:streams_dblk_esb sadc kmem_cache named unix:0:streams_fthdr sadc kmem_cache named unix:0:streams_ftblk sadc kmem_cache named unix:0:multidata sadc kmem_cache named unix:0:multidata_pdslab sadc kmem_cache named unix:0:multidata_pattbl sadc kmem_cache named unix:0:taskq_ent_cache sadc kmem_cache named unix:0:taskq_cache sadc kmem_cache named unix:0:kmem_io_512M_128 sadc kmem_cache named unix:0:kmem_io_512M_256 sadc kmem_cache named unix:0:kmem_io_512M_512 sadc kmem_cache named unix:0:kmem_io_512M_1024 sadc kmem_cache named unix:0:kmem_io_512M_2048 sadc kmem_cache named unix:0:kmem_io_512M_4096 sadc kmem_cache named unix:0:kmem_io_16M_128 sadc kmem_cache named unix:0:kmem_io_16M_256 sadc kmem_cache named unix:0:kmem_io_16M_512 sadc kmem_cache named unix:0:kmem_io_16M_1024 sadc kmem_cache named unix:0:kmem_io_16M_2048 sadc kmem_cache named unix:0:kmem_io_16M_4096 sadc kmem_cache named unix:0:id32_cache sadc kmem_cache named unix:0:bp_map_4096 sadc kmem_cache named unix:0:bp_map_8192 sadc kmem_cache named unix:0:bp_map_12288 sadc kmem_cache named unix:0:bp_map_16384 sadc kmem_cache named unix:0:bp_map_20480 sadc kmem_cache named unix:0:bp_map_24576 sadc kmem_cache named unix:0:bp_map_28672 sadc kmem_cache named unix:0:bp_map_32768 sadc kmem_cache named unix:0:mod_hash_entries sadc kmem_cache named unix:0:ipp_mod sadc kmem_cache named unix:0:ipp_action sadc kmem_cache named unix:0:ipp_packet sadc kmem_cache named unix:0:htable_t sadc kmem_cache named unix:0:hment_t sadc kmem_cache named unix:0:hat_t sadc kmem_cache named unix:0:HatHash sadc kmem_cache named unix:0:seg_cache sadc kmem_cache named unix:0:snode_cache sadc kmem_cache named unix:0:dv_node_cache sadc kmem_cache named unix:0:dev_info_node_cache sadc kmem_cache named unix:0:segkp_4096 sadc kmem_cache named unix:0:segkp_8192 sadc kmem_cache named unix:0:segkp_12288 sadc kmem_cache named unix:0:segkp_16384 sadc kmem_cache named unix:0:segkp_20480 sadc kmem_cache named unix:0:thread_cache sadc kmem_cache named unix:0:lwp_cache sadc kmem_cache named unix:0:turnstile_cache sadc kmem_cache named unix:0:cred_cache sadc kmem_cache named unix:0:rctl_cache sadc kmem_cache named unix:0:rctl_val_cache sadc kmem_cache named unix:0:task_cache sadc kmem_cache named unix:0:cyclic_id_cache sadc kmem_cache named unix:0:dnlc_space_cache sadc kmem_cache named unix:0:vn_cache sadc kmem_cache named unix:0:file_cache sadc kmem_cache named unix:0:stream_head_cache sadc kmem_cache named unix:0:queue_cache sadc kmem_cache named unix:0:syncq_cache sadc kmem_cache named unix:0:qband_cache sadc kmem_cache named unix:0:linkinfo_cache sadc kmem_cache named unix:0:ciputctrl_cache sadc kmem_cache named unix:0:serializer_cache sadc kmem_cache named unix:0:as_cache sadc kmem_cache named unix:0:marker_cache sadc kmem_cache named unix:0:anon_cache sadc kmem_cache named unix:0:anonmap_cache sadc kmem_cache named unix:0:segvn_cache sadc kmem_cache named unix:0:flk_edges sadc kmem_cache named unix:0:fdb_cache sadc kmem_cache named unix:0:timer_cache sadc kmem_cache named unix:0:physio_buf_cache sadc kmem_cache named unix:0:ufs_inode_cache sadc kmem_cache named unix:0:directio_buf_cache sadc kmem_cache named unix:0:lufs_save sadc kmem_cache named unix:0:lufs_bufs sadc kmem_cache named unix:0:lufs_mapentry_cache sadc kmem_cache named unix:0:kcf_sreq_cache sadc kmem_cache named unix:0:kcf_areq_cache sadc kmem_cache named unix:0:kcf_context_cache sadc kmem_cache named unix:0:ipsec_actions sadc kmem_cache named unix:0:ipsec_selectors sadc kmem_cache named unix:0:ipsec_policy sadc kmem_cache named unix:0:ipsec_info sadc kmem_cache named unix:0:ip_minor_arena_1 sadc kmem_cache named unix:0:ipcl_conn_cache sadc kmem_cache named unix:0:ipcl_tcpconn_cache sadc kmem_cache named unix:0:ire_cache sadc kmem_cache named unix:0:tcp_timercache sadc kmem_cache named unix:0:tcp_sack_info_cache sadc kmem_cache named unix:0:tcp_iphc_cache sadc kmem_cache named unix:0:squeue_cache sadc kmem_cache named unix:0:sctp_conn_cache sadc kmem_cache named unix:0:sctp_faddr_cache sadc kmem_cache named unix:0:sctp_set_cache sadc kmem_cache named unix:0:sctp_ftsn_set_cache sadc kmem_cache named unix:0:sctpsock sadc kmem_cache named unix:0:sctp_assoc sadc kmem_cache named unix:0:socktpi_cache sadc kmem_cache named unix:0:socktpi_unix_cache sadc kmem_cache named unix:0:ncafs_cache sadc kmem_cache named unix:0:process_cache sadc kmem_cache named unix:0:exacct_object_cache sadc kmem_cache named unix:0:fctl_cache sadc kmem_cache named unix:0:tl_cache sadc kmem_cache named unix:0:keysock_1 sadc kmem_cache named unix:0:spdsock_1 sadc kmem_cache named unix:0:fnode_cache sadc kmem_cache named unix:0:pipe_cache sadc kmem_cache named unix:0:namefs_inodes_1 sadc kmem_cache named unix:0:port_cache sadc kmem_cache named unix:0:lnode_cache sadc kmem_cache named unix:0:clnt_clts_endpnt_cache sadc kmem_cache named unix:0:pty_map sadc kmem_cache named unix:0:sppptun_map sadc kmem_cache named unix:0:dtrace_state_cache sadc kmem_cache named unix:0:qif_head_cache sadc kmem_cache named unix:0:udp_minor_1 sadc kmem_cache named unix:0:authkern_cache sadc kmem_cache named unix:0:authloopback_cache sadc kmem_cache named unix:0:authdes_cache_handle sadc kmem_cache named unix:0:rnode_cache sadc kmem_cache named unix:0:nfs_access_cache sadc kmem_cache named unix:0:client_handle_cache sadc kmem_cache named unix:0:rnode4_cache sadc kmem_cache named unix:0:svnode_cache sadc kmem_cache named unix:0:nfs4_access_cache sadc kmem_cache named unix:0:client_handle4_cache sadc kmem_cache named unix:0:nfs4_ace4vals_cache sadc kmem_cache named unix:0:nfs4_ace4_list_cache sadc kmem_cache named unix:0:NFS_idmap_cache sadc kmem_cache named unix:0:lm_vnode sadc kmem_cache named unix:0:lm_xprt sadc kmem_cache named unix:0:lm_sysid sadc kmem_cache named unix:0:lm_client sadc kmem_cache named unix:0:lm_async sadc kmem_cache named unix:0:lm_sleep sadc kmem_cache named unix:0:lm_config sadc kmem_cache named unix:0:nfslog_small_rec sadc kmem_cache named unix:0:nfslog_medium_rec sadc kmem_cache named unix:0:nfslog_large_rec sadc kmem_cache named unix:0:exi_cache_handle sadc kmem_cache named unix:0:Client_entry_cache sadc kmem_cache named unix:0:OpenOwner_entry_cache sadc kmem_cache named unix:0:OpenStateID_entry_cache sadc kmem_cache named unix:0:LockStateID_entry_cache sadc kmem_cache named unix:0:Lockowner_entry_cache sadc kmem_cache named unix:0:File_entry_cache sadc kmem_cache named unix:0:DelegStateID_entry_cache sadc kmem_cache named unix:0:ip_minor_1 sadc kmem_cache named unix:0:ar_minor_1 sadc kmem_cache named unix:0:icmp_minor_1 sadc kmem_cache named unix:0:crypto_session_cache sadc kmem_cache named unix:0:fcsm_job_cache sadc kmem_cache named unix:0:sd0_cache sadc kmem_cache named unix:0:hsfs_hsnode_cache sadc vmem named vmem:16:kmem_oversize sadc disk io cmdk:0:cmdk0 sadc nfs io nfs:1:nfs1 sadc disk io sd:0:sd0 sadc usb_byte_count io usba:0:uhci0,bulk sadc usb_byte_count io usba:0:uhci0,ctrl sadc usb_byte_count io usba:0:uhci0,intr sadc usb_byte_count io usba:0:uhci0,isoch sadc usb_byte_count io usba:0:uhci0,total sadc usb_byte_count io usba:1:uhci1,bulk sadc usb_byte_count io usba:1:uhci1,ctrl sadc usb_byte_count io usba:1:uhci1,intr sadc usb_byte_count io usba:1:uhci1,isoch sadc usb_byte_count io usba:1:uhci1,total Yep, to print the four fields from "sar -u 1 1", sadc read the ENTIRE KSTAT TREE FIVE TIMES. Comparing the effect of this to vmstat, # ptime vmstat 1 6 kthr memory page disk faults cpu r b w swap free re mf pi po fr de sr cd s0 -- -- in sy cs us sy id 0 0 43 907784 115324 29 124 34 1 1 0 4 2 0 0 0 277 470 210 1 2 97 0 0 38 750856 172304 1 40 0 0 0 0 0 0 0 0 0 230 224 130 1 1 98 0 0 38 750856 172304 0 0 0 0 0 0 0 0 0 0 0 219 168 111 0 1 99 0 0 38 750856 172304 0 0 0 0 0 0 0 0 0 0 0 226 109 113 0 0 100 0 0 38 750856 172304 0 0 0 0 0 0 0 0 0 0 0 225 246 137 1 1 98 0 0 38 750856 172304 0 0 0 0 0 0 0 0 0 0 0 222 175 119 0 1 99 real 5.060 user 0.006 sys 0.013 Ok, so vmstat causes a total of 13 ms of sys time - much of which would be the fork and exec. Now lets try sar, # ptime sar -u 1 5 SunOS jupiter 5.10 Generic i86pc 04/21/2006 23:42:55 %usr %sys %wio %idle 23:42:56 0 3 0 97 23:42:57 1 2 0 97 23:42:58 0 2 0 98 23:42:59 1 3 0 96 23:43:00 0 2 0 98 Average 0 2 0 97 real 5.148 user 0.010 sys 0.127 Phwaorr - 127 ms of sys time to measure 5 samples. That is a LOT.