Mon May 19 03:00:01 EDT 2025 HEXSERVER1 Out of service Internal 3ware 3.7TB (RAID5) =================================================================== HEXSERVER2 Out of service: Promise Ultratrak 15000 15x250GB drive 2.8TB total (RAID 5) =================================================================== HEXSERVER3 Out of service: Promise Vtrak 15110 15x400GB drive 5.2TB total (RAID 5) tgt: 3, lun: 0-2 dev: sdm,n,o Promise Vtrak 15100 15x300GB drive 3.6TB total (RAID 5) tgt: 2, lun: 0,1 dev: sdm,n {md124} Promise Vtrak m610p 16x1TB drive 13TB total (RAID 6) LD 0-7 tgt: 1, lun: 0-7 Promise Vtrak m610p-2 16x1TB drive 13TB total (RAID 6) LD 0-7 tgt: 2, lun: 0-7 Promise Vtrak m610p-3 16x1TB drive 13TB total (RAID 6) LD 0-7 tgt: 3, lun: 0-7 Promise Vtrak m610p-4 16x1TB drive 13TB total (RAID 6) LD 0-7 tgt: 4, lun: 0-7 =================================================================== HEXSERVER4 Promise Vtrak e610s (16 disks x2TB) JBOD1 (24 disks x2TB) JBOD2 (24 disks x2TB) e610s-2 (16 disks x3TB) JBOD1 (24 disks x4TB) JBOD2 (24 disks x3TB, dead) box disks array logical drive drive letters ----- ----- - - ---------- e610s 1-15 0 0 sda 24TB PV VG e610s e610s 16 spare jbod1 17-28 1 1 sdb 18T PV VG e610s jbod1 29-39 2 2 sdc 16T PV VG e610s jbod1 40 spare jbod2 41-52 3 3 sdd 18T PV VG e610s jbod2 53-63 4 4 sde 16T PV VG e610s jbod2 64 spare e610s-2 1-15 0 0 sdf 35TB PV VG e610s-2 e610s-2 16 spare jbod1 17-27 1 2 sdh 33TB PV VG e610s-2-jbod jbod1 28 spare jbod1 29-39 2 3 sdi 33TB PV VG e610s-2-jbod jbod1 40 spare jbod2 41-52 5 1 sdg 27TB PV VG cms1 (JBOD dead) jbod2 53-63 6 10 sdj 25TB PV VG cms1 (JBOD dead) jbod2 64 spare (JBOD dead) NOTE: The above drive letters may change after reboot! =================================================================== HEXSERVER5-OLD Striped set of two disks FIXME box disks array logical drive drive letters ----- ----- - - ---------- e610s 1-15 0 0 sda e610s 16 spare jbod1 17-28 1 1 sdb jbod1 29 spare Physical Volumes: PV VG Fmt Attr PSize PFree /dev/sda hxs5-2 lvm2 a--u 3.64T 0 /dev/sdb hxs5-2 lvm2 a--u 3.64T 0 Volume Groups: VG #PV #LV #SN Attr VSize VFree hxs5-2 2 1 0 wz--n- 7.28T 0 Logical Volumes: LV VG Attr LSize Pool Origin Data% Meta% Move Log Cpy%Sync Convert hetfast hxs5-2 -wi-ao---- 7.28T /dev/mapper/hxs5--2-hetfast /hetfast 7.3T 5.9T 1.4T 81% /het/p4 =================================================================== HEXSERVER5 Promise Vtrak e610s-3 (16 disks x4TB) JBOD1 (24 disks x4TB) JBOD2 (24 disks x4TB) box disks array logical drive drive letters ----- ----- - - ---------- e610s 1-15 0 0 sda e610s 16 spare jbod1 17-28 1 1 sdb jbod1 29 spare jbod1 30-39 2 2 sdc jbod1 40 spare jbod2 41-52 3 3 sdd jbod2 53-63 4 4 sde jbod2 64 spare Promise Vtrak e5800f (24 disks x8TB) JBOD1 (24 disks x8TB) JBOD2 (24 disks x8TB) box disks array logical drive drive letters ----- ----- - - ---------- e5800f 1-11 0 0 sdl e5800f 12 spare e5800f 12-23 1 1 sdi e5800f 24 spare jbod1 25-35 2 2 sdm jbod1 36 spare jbod1 37-47 3 3 sdj jbod1 48 spare jbod2 49-59 4 4 sdn jbod2 60 spare jbod2 61-71 5 5 sdk jbod2 72 spare NOTE: The above drive letters may change after reboot! Physical Volumes: PV VG Fmt Attr PSize PFree /dev/sda hxs5-1 lvm2 a-- 47.29T 0 /dev/sdb hxs5-1 lvm2 a-- <36.38T 0 /dev/sdc hxs5-1 lvm2 a-- 32.74T 0 /dev/sdd hxs5-1 lvm2 a-- <36.38T 0 /dev/sde hxs5-1 lvm2 a-- 32.74T <2.03T /dev/sdf fcjbod1 lvm2 a-- 65.49T 0 /dev/sdg fcjbod1 lvm2 a-- 65.49T 74.00G /dev/sdh fcjbod1 lvm2 a-- 65.49T 1.98T /dev/sdi fcjbod1 lvm2 a-- 65.49T 0 /dev/sdj fcjbod1 lvm2 a-- 65.49T 0 /dev/sdk cmsse lvm2 a-- 65.49T 503.60G Volume Groups: VG #PV #LV #SN Attr VSize VFree cmsse 1 2 0 wz--n- 65.49T 503.60G fcjbod1 5 33 0 wz--n- <327.46T <2.06T hxs5-1 5 10 0 wz--n- <185.54T <2.03T Logical Volumes: LV VG Attr LSize Pool Origin Data% Meta% Move Log Cpy%Sync Convert cmssephedex cmsse -wi-ao---- 63.00T cmssestore cmsse -wi-ao---- 2.00T akobert fcjbod1 -wi-ao---- 15.00T ar2029 fcjbod1 -wi-ao---- 2.00T as2689 fcjbod1 -wi-ao---- 3.00T backups-c fcjbod1 -wi-ao---- 15.00T ccahoughton-c fcjbod1 -wi-ao---- 2.00T chiarito-c fcjbod1 -wi-ao---- 4.00T glc67 fcjbod1 -wi-ao---- 500.00G gomez-c fcjbod1 -wi-ao---- 6.00T heindl-c fcjbod1 -wi-ao---- 4.00T higgslonglived-c fcjbod1 -wi-ao---- 20.00T joey fcjbod1 -wi-ao---- 700.00G jordanm fcjbod1 -wi-ao---- 1.00T jsj108 fcjbod1 -wi-ao---- 1.00T jwf80 fcjbod1 -wi-ao---- 4.00T jwf82 fcjbod1 -wi-ao---- 1.00T kaur fcjbod1 -wi-ao---- 500.00G mbuckley fcjbod1 -wi-ao---- 2.00T multilepton-4 fcjbod1 -wi-ao---- 35.00T nla49 fcjbod1 -wi-ao---- 2.00T pab266 fcjbod1 -wi-ao---- 5.00T qc89 fcjbod1 -wi-ao---- 1.00T rand fcjbod1 -wi-ao---- 500.00G rz282-c fcjbod1 -wi-ao---- 10.00T sclark-2-c fcjbod1 -wi-ao---- 10.00T sclark-copy2 fcjbod1 -wi-ao---- 3.00T scoutingtau fcjbod1 -wi-ao---- 40.00T siyuan0126 fcjbod1 -wi-ao---- 500.00G sm2991 fcjbod1 -wi-ao---- 2.00T threejet-3-c fcjbod1 -wi-ao---- 40.00T threejet-4 fcjbod1 -wi-ao---- 20.00T twoprong fcjbod1 -wi-ao---- <44.77T xaastorage-3 fcjbod1 -wi-ao---- 10.00T xaastorage-c fcjbod1 -wi-ao---- 20.00T backups2 hxs5-1 -wi-ao---- 2.00T gadkari hxs5-1 -wi-ao---- 1.00T heavyion hxs5-1 -wi-ao---- 10.00T hetp1 hxs5-1 -wi-ao---- 20.00T joey-hxs5-1-test hxs5-1 -wi-ao---- 20.00G kar352 hxs5-1 -wi-ao---- 5.00T multilepton-2 hxs5-1 -wi-ao---- 50.00T multilepton-3 hxs5-1 -wi-ao---- <35.49T threejet-2 hxs5-1 -wi-ao---- 20.00T vlq hxs5-1 -wi-ao---- 40.00T /dev/mapper/cmsse-cmssephedex /cmssephedex 63T 49T 15T 78% UNUSED /dev/mapper/cmsse-cmssestore /cmssestore 2.0T 802G 1.3T 40% /cmsse/store /dev/mapper/fcjbod1-akobert /akobert 15T 13T 2.5T 84% /cms/akobert /dev/mapper/fcjbod1-ar2029 /ar2029 2.0T 1.3G 2.0T 1% /cms/ar2029 /dev/mapper/fcjbod1-as2689 /as2689 3.0T 295G 2.8T 10% /cms/as2689 /dev/mapper/fcjbod1-backups--c /backups 15T 7.1T 8.0T 47% /backup/HTCondor /backup/bin /backup/cdshome /backup/cdsimages /backup/cdsinstall /backup/cms /backup/cmsuser2 /backup/dirtree /backup/h2 /backup/h3 /backup/homelinks /backup/images /backup/log /backup/nodes /backup/setree /dev/mapper/fcjbod1-ccahoughton--c /ccahoughton 2.0T 1.7T 346G 84% /cms/ccahoughton /dev/mapper/fcjbod1-chiarito--c /chiarito 4.0T 298G 3.8T 8% /cms/chiarito /dev/mapper/fcjbod1-glc67 /glc67 500G 33M 500G 1% /cms/glc67 /dev/mapper/fcjbod1-gomez--c /4jets2016 6.0T 5.5T 609G 91% /cms/4jets2016 /dev/mapper/fcjbod1-heindl--c /heindl 4.0T 3.6T 413G 90% /cms/heindl /dev/mapper/fcjbod1-higgslonglived--c /higgslonglived 20T 17T 3.6T 83% /cms/higgslonglived /dev/mapper/fcjbod1-joey /joey 700G 202G 499G 29% /cms/joey /dev/mapper/fcjbod1-jordanm /jordanm 1.0T 33M 1.0T 1% /cms/jordanm /dev/mapper/fcjbod1-jsj108 /jsj108 1.0T 91G 933G 9% /cms/jsj108 /dev/mapper/fcjbod1-jwf80 /jwf80 4.0T 589G 3.5T 15% /cms/jwf80 /dev/mapper/fcjbod1-jwf82 /jwf82 1.0T 616G 408G 61% /cms/jwf82 /dev/mapper/fcjbod1-kaur /kaur 500G 63G 438G 13% /cms/kaur /dev/mapper/fcjbod1-mbuckley /mbuckley 2.0T 1.4T 654G 69% /het/mbuckley /dev/mapper/fcjbod1-multilepton--4 /multilepton-4 35T 35T 70G 100% /cms/multilepton-4 /dev/mapper/fcjbod1-nla49 /nla49 2.0T 1.3T 775G 63% /cms/nla49 /dev/mapper/fcjbod1-pab266 /pab266 5.0T 4.8T 305G 95% /cms/pab266 /dev/mapper/fcjbod1-qc89 /qc89 1.0T 14G 1010G 2% /cms/qc89 /dev/mapper/fcjbod1-rand /rand 500G 101G 399G 21% /cms/rand /dev/mapper/fcjbod1-rz282--c /rz282 10T 4.6T 5.5T 46% /cms/rz282 /dev/mapper/fcjbod1-sclark--2--c /sclark-2 10T 9.2T 882G 92% /cms/sclark-2 /dev/mapper/fcjbod1-sclark--copy2 /sclark 3.0T 2.1T 948G 70% /cms/sclark /dev/mapper/fcjbod1-scoutingtau /scoutingtau 40T 37T 3.6T 92% /cms/scoutingtau /dev/mapper/fcjbod1-siyuan0126 /siyuan0126 500G 314G 187G 63% /cms/siyuan0126 /dev/mapper/fcjbod1-sm2991 /sm2991 2.0T 805G 1.3T 40% /cms/sm2991 /dev/mapper/fcjbod1-threejet--3--c /threejet-3 40T 34T 6.5T 84% /cms/threejet-3 /dev/mapper/fcjbod1-threejet--4 /threejet-4 20T 11T 9.1T 55% /cms/threejet-4 /dev/mapper/fcjbod1-twoprong /twoprong 45T 44T 1.3T 98% /cms/twoprong /dev/mapper/fcjbod1-xaastorage--3 /xaastorage-3 10T 5.7T 4.4T 57% /cms/xaastorage-3 /dev/mapper/fcjbod1-xaastorage--c /xaastorage 20T 20T 282G 99% /cms/xaastorage /dev/mapper/hxs5--1-backups2 /backups2 2.0T 933G 1.1T 46% /backup/INACTIVE /dev/mapper/hxs5--1-gadkari /gadkari 1.0T 2.1G 1022G 1% /cms/gadkari /dev/mapper/hxs5--1-heavyion /heavyion 10T 33M 10T 1% /cms/heavyion /dev/mapper/hxs5--1-hetp1 /hetp1 20T 8.9T 12T 45% /het/p1 /dev/mapper/hxs5--1-joey--hxs5--1--test /joey-hxs5-1-test 20G 3.0G 17G 15% /cms/joey-hxs5-1-test /dev/mapper/hxs5--1-kar352 /kar352 5.0T 4.9T 202G 97% /cms/kar352 /dev/mapper/hxs5--1-multilepton--2 /multilepton-2 50T 41T 9.4T 82% /cms/multilepton-2 /dev/mapper/hxs5--1-multilepton--3 /multilepton-3 36T 33T 3.1T 92% /cms/multilepton-3 /dev/mapper/hxs5--1-threejet--2 /threejet-2 20T 8.4T 12T 42% /cms/threejet-2 /dev/mapper/hxs5--1-vlq /vlq 40T 36T 4.2T 90% /cms/vlq =================================================================== HEXSERVER6 Promise Vtrak e5800f-2 (24 disks x16TB) FIXME DETAILS JBOD1 (24 disks x16TB) # box disks array logical drive drive letters # ----- ----- - - ---------- # e5800f-2 1-11 0 0 sdl # e5800f-2 12 spare # # e5800f-2 12-23 1 1 sdi # e5800f-2 24 spare # # jbod1 25-35 2 2 sdm # jbod1 36 spare # jbod1 37-47 3 3 sdj # jbod1 48 spare # # NOTE: The above drive letters may change after reboot! Physical Volumes: PV VG Fmt Attr PSize PFree /dev/nvme1N1 vgflash6 lvm2 a-- <1.75T <1.26T /dev/sdg fcjbod2 lvm2 a-- 87.31T 138.16G /dev/sdh fcjbod2 lvm2 a-- <72.76T 777.80G /dev/sdi fcjbod2 lvm2 a-- <72.76T 43.56T /dev/sdj fcjbod2 lvm2 a-- 87.31T 87.31T /dev/sdk fcjbod2 lvm2 a-- <72.76T <72.76T /dev/sdl fcjbod2 lvm2 a-- <72.76T <72.76T Volume Groups: VG #PV #LV #SN Attr VSize VFree fcjbod2 6 15 0 wz--n- 465.66T <277.29T vgflash6 1 1 0 wz--n- <1.75T <1.26T Logical Volumes: LV VG Attr LSize Pool Origin Data% Meta% Move Log Cpy%Sync Convert ab2625 fcjbod2 -wi-ao---- 1.00T abhijith fcjbod2 -wi-ao---- <14.20T ahart fcjbod2 -wi-ao---- 7.00T ajl357 fcjbod2 -wi-ao---- 500.00G al1655 fcjbod2 -wi-ao---- 500.00G daj111 fcjbod2 -wi-ao---- 1.00T gershtein fcjbod2 -wi-ao---- 1.00T hetp2 fcjbod2 -wi-ao---- 10.00T insta fcjbod2 -wi-ao---- 30.00T jvora fcjbod2 -wi-ao---- 1.20T scoutingtau-2 fcjbod2 -wi-ao---- 50.00T smd376 fcjbod2 -wi-ao---- 2.00T thayil fcjbod2 -wi-ao---- 5.00T threejet fcjbod2 -wi-ao---- 50.00T twoprong-2 fcjbod2 -wi-ao---- 15.00T flash6 vgflash6 -wi-ao---- 500.00G /dev/mapper/fcjbod2-ab2625 /ab2625 1.0T 29G 995G 3% /cms/ab2625 /dev/mapper/fcjbod2-abhijith /abhijith 15T 15T 113G 100% /cms/abhijith /dev/mapper/fcjbod2-ahart /ahart 7.0T 7.0T 71G 100% /cms/ahart /dev/mapper/fcjbod2-ajl357 /ajl357 500G 412G 89G 83% /cms/ajl357 /dev/mapper/fcjbod2-al1655 /al1655 500G 39G 462G 8% /cms/al1655 /dev/mapper/fcjbod2-daj111 /daj111 1.0T 652G 373G 64% /cms/daj111 /dev/mapper/fcjbod2-gershtein /gershtein 1.0T 270G 755G 27% /cms/gershtein /dev/mapper/fcjbod2-hetp2 /hetp2 10T 184G 9.9T 2% /het/p2 /dev/mapper/fcjbod2-insta /insta 30T 13T 18T 41% /cms/insta /dev/mapper/fcjbod2-jvora /jvora 1.2T 1.1T 126G 90% /cms/jvora /dev/mapper/fcjbod2-scoutingtau--2 /scoutingtau-2 50T 636G 50T 2% /cms/scoutingtau-2 /dev/mapper/fcjbod2-smd376 /smd376 2.0T 823G 1.2T 41% /cms/smd376 /dev/mapper/fcjbod2-thayil /thayil 5.0T 2.1T 3.0T 42% /cms/thayil /dev/mapper/fcjbod2-threejet /threejet 50T 414G 50T 1% /cms/threejet /dev/mapper/fcjbod2-twoprong--2 /twoprong-2 15T 9.1T 6.0T 61% /cms/twoprong-2 /dev/mapper/vgflash6-flash6 /flash6 500G 33G 467G 7% /sysadmin_test/flash6 =================================================================== HEXSERVER7 Promise Vtrak e5800f-3 (24 disks x16TB) FIXME DETAILS and mention unallocated array + its capacity JBOD1 (24 disks x16TB) # box disks array logical drive drive letters # ----- ----- - - ---------- # e5800f-3 1-11 0 0 sdl # e5800f-3 12 spare # # e5800f-3 12-23 1 1 sdi # e5800f-3 24 spare # # jbod1 25-35 2 2 sdm # jbod1 36 spare # jbod1 37-47 3 3 sdj # jbod1 48 spare # # NOTE: The above drive letters may change after reboot! Physical Volumes: PV VG Fmt Attr PSize PFree /dev/sdd cmsse lvm2 a-- 101.86T 0 /dev/sdf fcjbod3 lvm2 a-- 87.31T 23.82T /dev/sdg fcjbod3 lvm2 a-- <72.76T <22.76T /dev/sdh fcjbod3 lvm2 a-- <72.76T <72.76T /dev/sdj cmsse lvm2 a-- 87.31T 0 Volume Groups: VG #PV #LV #SN Attr VSize VFree cmsse 2 1 0 wz--n- 189.17T 0 fcjbod3 3 9 0 wz--n- 232.83T 119.34T Logical Volumes: LV VG Attr LSize Pool Origin Data% Meta% Move Log Cpy%Sync Convert cmssephedex-c cmsse -wi-ao---- 189.17T evah fcjbod3 -wi-ao---- 500.00G higgslonglived-2 fcjbod3 -wi-ao---- 30.00T johnpaul fcjbod3 -wi-ao---- 2.00T multilepton fcjbod3 -wi-ao---- 50.00T osherson fcjbod3 -wi-ao---- 1.00T ps1390 fcjbod3 -wi-ao---- 1.00T th544 fcjbod3 -wi-ao---- 2.00T threejet-5 fcjbod3 -wi-ao---- 20.00T xaastorage-2 fcjbod3 -wi-ao---- 7.00T /dev/mapper/cmsse-cmssephedex--c /cmssephedex 190T 83T 107T 44% /cmsse/phedex /dev/mapper/fcjbod3-evah /evah 500G 435G 65G 88% /cms/evah /dev/mapper/fcjbod3-higgslonglived--2 /higgslonglived-2 30T 8.8T 22T 30% /cms/higgslonglived-2 /dev/mapper/fcjbod3-johnpaul /johnpaul 2.0T 28G 2.0T 2% /cms/johnpaul /dev/mapper/fcjbod3-multilepton /multilepton 50T 34T 17T 68% /cms/multilepton /dev/mapper/fcjbod3-osherson /osherson 1.0T 931G 94G 91% /cms/osherson /dev/mapper/fcjbod3-ps1390 /ps1390 1.0T 452G 572G 45% /cms/ps1390 /dev/mapper/fcjbod3-th544 /th544 2.0T 1.5T 542G 74% /cms/th544 /dev/mapper/fcjbod3-threejet--5 /threejet-5 20T 7.1T 13T 36% /cms/threejet-5 /dev/mapper/fcjbod3-xaastorage--2 /xaastorage-2 7.0T 4.7T 2.4T 66% /cms/xaastorage-2 ===================================================================