{"id":338,"date":"2021-04-20T23:16:28","date_gmt":"2021-04-20T14:16:28","guid":{"rendered":"http:\/\/blog.gurees.net\/?p=338"},"modified":"2021-07-07T22:46:46","modified_gmt":"2021-07-07T13:46:46","slug":"centos7-9%e3%81%a7infiniband%e3%81%a7iscsi%e3%81%aa%e3%82%b5%e3%83%bc%e3%83%90%e3%82%92%e7%b5%84%e3%82%804","status":"publish","type":"post","link":"https:\/\/blog.gurees.net\/?p=338","title":{"rendered":"CentOS7.9\u3067InfiniBand\u3067iSCSI\u306a\u30b5\u30fc\u30d0\u3092\u7d44\u3080(4)"},"content":{"rendered":"\n<p>\u7d06\u4f59\u66f2\u6298\u3042\u308a\u307e\u3057\u305f\u304c\u3001\u30d0\u30c3\u30af\u30d7\u30ec\u30fc\u30f3\u30dc\u30fc\u30c9\u304c\u5c4a\u3044\u305f\u306e\u3067\u3001\u53d6\u308a\u4ed8\u3051\u30661TB\u271514\u3067RAID\u3092\u7d44\u3082\u3046\u3068\u601d\u3044\u307e\u3059\u3002<\/p>\n\n\n\n<p>IBM x3650 M4\u306b\u306fIBM m5110e\u3068\u3044\u3046RAID\u30ab\u30fc\u30c9\u304c\u642d\u8f09\u3055\u308c\u3066\u307e\u3059\u304c\u3001\u57fa\u672c\u7684\u306b\u306fRAID6\u306b\u306f\u5bfe\u5fdc\u3057\u3066\u307e\u305b\u3093\u3002\u307e\u305f\u3001\u30c7\u30a3\u30b9\u30af\u3092RAID\u69cb\u6210\u306a\u3057\u3067\u653e\u7f6e\u3059\u308b\u3068\u30a8\u30e9\u30fc\u3092\u5410\u304f\u306e\u3067\u3001RAID0\u3067\uff11\u53f0\u69cb\u6210\u306b\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002<\/p>\n\n\n\n<p>\u6570\u53f0\u7a0b\u5ea6\u306a\u3089\u826f\u3044\u306e\u3067\u3059\u304c\u300114\u53f0\u3092WebBIOS\u3067\u8a2d\u5b9a\u3059\u308b\u306e\u306f\u9aa8\u304c\u6298\u308c\u305f\u306e\u3067\u3001\u30b3\u30de\u30f3\u30c9\u304b\u3089\u306a\u3093\u3068\u304b\u3057\u3088\u3046\u3068\u601d\u3044\u307e\u3059\u3002<\/p>\n\n\n\n<!--more-->\n\n\n\n<p>MegaCli\u3092\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3057\u3066\u3001\u30a8\u30a4\u30ea\u30a2\u30b9\u3092\u5207\u3063\u3066\u304a\u304d\u307e\u3059\u3002\u4ee5\u964d\u30a8\u30a4\u30ea\u30a2\u30b9\u3042\u308a\u3067\u30b3\u30de\u30f3\u30c9\u306f\u8a18\u8f09\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"generic\" data-enlighter-theme=\"\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\">wget https:\/\/ginernet.com\/downloads\/MegaCli-8.07.14-1.noarch.rpm\nrpm -Uhv MegaCli-8.07.14-1.noarch.rpm \n\nalias megacli='\/opt\/MegaRAID\/MegaCli\/MegaCli64'<\/pre>\n\n\n\n<p>\u3068\u308a\u3042\u3048\u305a\u3001\u30ab\u30fc\u30c9\u306e\u60c5\u5831\u3092\u53d6\u308a\u307e\u3059\u3002<br>\u5897\u8a2d\u306e\u90fd\u5408\u3067RAID\u30ab\u30fc\u30c9\u304c\uff12\u679a\u3042\u308a\u307e\u3059\u304c\u3001\u30d0\u30c3\u30af\u30d7\u30ec\u30fc\u30f3\u306b\u306fSASExpander\u304c\u4ed8\u5c5e\u3060\u3063\u305f\u306e\u3067\u3001Controller 1\u306e\u65b9\u306f\u4eca\u56de\u4f7f\u3044\u307e\u305b\u3093\u3002<\/p>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"generic\" data-enlighter-theme=\"\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\"># megacli -AdpGetPciInfo -aAll\nPCI information for Controller 0\n--------------------------------\nBus Number      : 16\nDevice Number   : 0\nFunction Number : 0\n\nPCI information for Controller 1\n--------------------------------\nBus Number      : 8b\nDevice Number   : 0\nFunction Number : 0\n\n\nExit Code: 0x00<\/pre>\n\n\n\n<p>\u7269\u7406\u30c7\u30a3\u30b9\u30af\u69cb\u6210\u3092\u78ba\u8a8d\u3057\u307e\u3059\u3002<br>\u9577\u3044\u306e\u3067\u4e2d\u7565\u3067\u3059\u304c\u3001boot\u7528\u306bSAS 137GB\u27152\u3068SATA 1TB\u271514\u3067\u3059\u3002<\/p>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"generic\" data-enlighter-theme=\"\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\"># megacli -PDList -aALL\n\nAdapter #0\n\nEnclosure Device ID: 20\nSlot Number: 0\nDrive's position: DiskGroup: 0, Span: 0, Arm: 0\nEnclosure position: 1\nDevice Id: 19\nWWN: 5000C50068629614\nSequence Number: 2\nMedia Error Count: 0\nOther Error Count: 0\nPredictive Failure Count: 0\nLast Predictive Failure Event Seq Number: 0\nPD Type: SAS\n\nRaw Size: 136.731 GB [0x11176d60 Sectors]\nNon Coerced Size: 136.231 GB [0x11076d60 Sectors]\nCoerced Size: 135.972 GB [0x10ff2000 Sectors]\nSector Size:  512\nLogical Sector Size:  512\nPhysical Sector Size:  512\nFirmware state: Online, Spun Up\nCommissioned Spare : No\nEmergency Spare : No\nDevice Firmware Level: B63B\nShield Counter: 0\nSuccessful diagnostics completion on :  N\/A\nSAS Address(0): 0x5000c50068629615\nSAS Address(1): 0x0\nConnected Port Number: 0(path0)\nInquiry Data: IBM-ESXSST9146853SS     B63B6XM2PYVF1018B63B\nIBM FRU\/CRU: 90Y8927\nFDE Capable: Not Capable\nFDE Enable: Disable\nSecured: Unsecured\nLocked: Unlocked\nNeeds EKM Attention: No\nForeign State: None\nDevice Speed: 6.0Gb\/s\nLink Speed: 6.0Gb\/s\nMedia Type: Hard Disk Device\nDrive:  Not Certified\nDrive Temperature :28C (82.40 F)\nPI Eligibility:  No\nDrive is formatted for PI information:  No\nPI: No PI\nPort-0 :\nPort status: Active\nPort's Linkspeed: 6.0Gb\/s\nPort-1 :\nPort status: Active\nPort's Linkspeed: 6.0Gb\/s\nDrive has flagged a S.M.A.R.T alert : No\n\n\n\nEnclosure Device ID: 20\nSlot Number: 1\nDrive's position: DiskGroup: 0, Span: 0, Arm: 1\nEnclosure position: 1\nDevice Id: 18\nWWN: 5000C500683F6544\nSequence Number: 2\nMedia Error Count: 0\nOther Error Count: 0\nPredictive Failure Count: 0\nLast Predictive Failure Event Seq Number: 0\nPD Type: SAS\n\nRaw Size: 136.731 GB [0x11176d60 Sectors]\nNon Coerced Size: 136.231 GB [0x11076d60 Sectors]\nCoerced Size: 135.972 GB [0x10ff2000 Sectors]\nSector Size:  512\nLogical Sector Size:  512\nPhysical Sector Size:  512\nFirmware state: Online, Spun Up\nCommissioned Spare : No\nEmergency Spare : No\nDevice Firmware Level: B63B\nShield Counter: 0\nSuccessful diagnostics completion on :  N\/A\nSAS Address(0): 0x5000c500683f6545\nSAS Address(1): 0x0\nConnected Port Number: 0(path0)\nInquiry Data: IBM-ESXSST9146853SS     B63B6XM2P96W1018B63B\nIBM FRU\/CRU: 90Y8927\nFDE Capable: Not Capable\nFDE Enable: Disable\nSecured: Unsecured\nLocked: Unlocked\nNeeds EKM Attention: No\nForeign State: None\nDevice Speed: 6.0Gb\/s\nLink Speed: 6.0Gb\/s\nMedia Type: Hard Disk Device\nDrive:  Not Certified\nDrive Temperature :28C (82.40 F)\nPI Eligibility:  No\nDrive is formatted for PI information:  No\nPI: No PI\nPort-0 :\nPort status: Active\nPort's Linkspeed: 6.0Gb\/s\nPort-1 :\nPort status: Active\nPort's Linkspeed: 6.0Gb\/s\nDrive has flagged a S.M.A.R.T alert : No\n\n\n\nEnclosure Device ID: 20\nSlot Number: 2\nEnclosure position: 1\nDevice Id: 26\nWWN: 5000c5003539094f\nSequence Number: 1\nMedia Error Count: 0\nOther Error Count: 0\nPredictive Failure Count: 0\nLast Predictive Failure Event Seq Number: 0\nPD Type: SATA\n\nRaw Size: 931.512 GB [0x74706db0 Sectors]\nNon Coerced Size: 931.012 GB [0x74606db0 Sectors]\nCoerced Size: 930.390 GB [0x744c8000 Sectors]\nSector Size:  512\nLogical Sector Size:  512\nPhysical Sector Size:  512\nFirmware state: Unconfigured(good), Spun Up\nDevice Firmware Level: SN02\nShield Counter: 0\nSuccessful diagnostics completion on :  N\/A\nSAS Address(0): 0x500507603ea9640b\nConnected Port Number: 0(path0)\nInquiry Data:             9XG0ERFCST91000640NS                            SN02  \nFDE Capable: Not Capable\nFDE Enable: Disable\nSecured: Unsecured\nLocked: Unlocked\nNeeds EKM Attention: No\nForeign State: None\nDevice Speed: 6.0Gb\/s\nLink Speed: 6.0Gb\/s\nMedia Type: Hard Disk Device\nDrive:  Not Certified\nDrive Temperature :27C (80.60 F)\nPI Eligibility:  No\nDrive is formatted for PI information:  No\nPI: No PI\nDrive's NCQ setting : Enabled\nPort-0 :\nPort status: Active\nPort's Linkspeed: 6.0Gb\/s\nDrive has flagged a S.M.A.R.T alert : No\n\n### \u9577\u3044\u306e\u3067\u4e2d\u7565 ####\n\nEnclosure Device ID: 20\nSlot Number: 15\nEnclosure position: 1\nDevice Id: 35\nWWN: 5000c50035121495\nSequence Number: 1\nMedia Error Count: 0\nOther Error Count: 0\nPredictive Failure Count: 0\nLast Predictive Failure Event Seq Number: 0\nPD Type: SATA\n\nRaw Size: 931.512 GB [0x74706db0 Sectors]\nNon Coerced Size: 931.012 GB [0x74606db0 Sectors]\nCoerced Size: 930.390 GB [0x744c8000 Sectors]\nSector Size:  512\nLogical Sector Size:  512\nPhysical Sector Size:  512\nFirmware state: Unconfigured(good), Spun Up\nDevice Firmware Level: SN02\nShield Counter: 0\nSuccessful diagnostics completion on :  N\/A\nSAS Address(0): 0x500507603ea96408\nConnected Port Number: 0(path0)\nInquiry Data:             9XG0BV54ST91000640NS                            SN02  \nFDE Capable: Not Capable\nFDE Enable: Disable\nSecured: Unsecured\nLocked: Unlocked\nNeeds EKM Attention: No\nForeign State: None\nDevice Speed: 6.0Gb\/s\nLink Speed: 6.0Gb\/s\nMedia Type: Hard Disk Device\nDrive:  Not Certified\nDrive Temperature :26C (78.80 F)\nPI Eligibility:  No\nDrive is formatted for PI information:  No\nPI: No PI\nDrive's NCQ setting : Enabled\nPort-0 :\nPort status: Active\nPort's Linkspeed: 6.0Gb\/s\nDrive has flagged a S.M.A.R.T alert : No\n\n\n\nAdapter #1\n\n\nExit Code: 0x00<\/pre>\n\n\n\n<p>RAID0\u3067Enclosure Device ID: 20,Slot Number: 2\u306e\u30c7\u30a3\u30b9\u30af\u3067RAID\u3092\u7d44\u307f\u307e\u3059\u3002<br>-r0\u304cRAID\u30ec\u30d9\u30eb\u3001[20:2]\u304c\u30a8\u30f3\u30af\u30ed\u30fc\u30b8\u30e3\u30fc:\u30b9\u30ed\u30c3\u30c8\u3001-a0\u304c\u30a2\u30c0\u30d7\u30bf0\u306e\u6307\u5b9a\u3067\u3059\u3002<\/p>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"generic\" data-enlighter-theme=\"\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\"># megacli -CfgLdAdd -r0 [20:2] -a0\n\nAdapter 0: Created VD 1\n\nAdapter 0: Configured the Adapter!!\n\nExit Code: 0x00<\/pre>\n\n\n\n<p>\u304b\u3093\u305f\u3093\u3067\u3059\u306d\u3002<br>\u6b8b\u308a\u3082\u4ee5\u4e0b\u306e\u30b3\u30de\u30f3\u30c9\u3067\u540c\u69d8\u306b\u4f5c\u308a\u307e\u3059\u3002<\/p>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"generic\" data-enlighter-theme=\"\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\"> megacli -CfgLdAdd -r0 [20:3] -a0\n megacli -CfgLdAdd -r0 [20:4] -a0\n megacli -CfgLdAdd -r0 [20:5] -a0\n megacli -CfgLdAdd -r0 [20:6] -a0\n megacli -CfgLdAdd -r0 [20:7] -a0\n megacli -CfgLdAdd -r0 [20:8] -a0\n megacli -CfgLdAdd -r0 [20:9] -a0\n megacli -CfgLdAdd -r0 [20:10] -a0\n megacli -CfgLdAdd -r0 [20:11] -a0\n megacli -CfgLdAdd -r0 [20:12] -a0\n megacli -CfgLdAdd -r0 [20:13] -a0\n megacli -CfgLdAdd -r0 [20:14] -a0\n megacli -CfgLdAdd -r0 [20:15] -a0<\/pre>\n\n\n\n<p>IMM2\u304b\u3089\u78ba\u8a8d\u3059\u308b\u3068RAID0\u306714\u30d7\u30fc\u30eb\u3067\u304d\u3066\u3044\u308b\u3053\u3068\u304c\u308f\u304b\u308a\u307e\u3059\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><a href=\"https:\/\/blog.gurees.net\/wp-content\/uploads\/2021\/04\/image-1.png\"><img loading=\"lazy\" decoding=\"async\" width=\"736\" height=\"440\" src=\"https:\/\/blog.gurees.net\/wp-content\/uploads\/2021\/04\/image-1.png\" alt=\"\" class=\"wp-image-339\" srcset=\"https:\/\/blog.gurees.net\/wp-content\/uploads\/2021\/04\/image-1.png 736w, https:\/\/blog.gurees.net\/wp-content\/uploads\/2021\/04\/image-1-300x179.png 300w, https:\/\/blog.gurees.net\/wp-content\/uploads\/2021\/04\/image-1-624x373.png 624w\" sizes=\"auto, (max-width: 736px) 100vw, 736px\" \/><\/a><\/figure>\n\n\n\n<p>\u305d\u308c\u305e\u308c\u30d1\u30fc\u30c6\u30a3\u30b7\u30e7\u30f3\u3092\u5207\u308a\u307e\u3059\u3002<\/p>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"generic\" data-enlighter-theme=\"\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\">#parted -s -a optimal \/dev\/sdb -- mkpart primary xfs 1 -1\n#parted -s -a optimal \/dev\/sdc -- mkpart primary xfs 1 -1\n#parted -s -a optimal \/dev\/sdd -- mkpart primary xfs 1 -1\n#parted -s -a optimal \/dev\/sde -- mkpart primary xfs 1 -1\n#parted -s -a optimal \/dev\/sdf -- mkpart primary xfs 1 -1\n#parted -s -a optimal \/dev\/sdg -- mkpart primary xfs 1 -1\n#parted -s -a optimal \/dev\/sdh -- mkpart primary xfs 1 -1\n#parted -s -a optimal \/dev\/sdi -- mkpart primary xfs 1 -1\n#parted -s -a optimal \/dev\/sdj -- mkpart primary xfs 1 -1\n#parted -s -a optimal \/dev\/sdk -- mkpart primary xfs 1 -1\n#parted -s -a optimal \/dev\/sdl -- mkpart primary xfs 1 -1\n#parted -s -a optimal \/dev\/sdm -- mkpart primary xfs 1 -1\n#parted -s -a optimal \/dev\/sdn -- mkpart primary xfs 1 -1\n#parted -s -a optimal \/dev\/sdo -- mkpart primary xfs 1 -1<\/pre>\n\n\n\n<p>\u524d\u56de\u540c\u69d8\u306bmd\u3067RAID6\u3092\u7d44\u307f\u307e\u3059\u3002<\/p>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"generic\" data-enlighter-theme=\"\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\"># mdadm --create \/dev\/md\/md12tb --level=raid6 --name=md12tb --raid-devices=14 \/dev\/sdb1 \/dev\/sdc1 \/dev\/sdd1 \/dev\/sde1 \/dev\/sdf1 \/dev\/sdg1 \/dev\/sdh1 \/dev\/sdi1 \/dev\/sdj1 \/dev\/sdk1 \/dev\/sdl1 \/dev\/sdm1 \/dev\/sdn1 \/dev\/sdo1\n# mdadm --detail --scan > \/etc\/mdadm.conf<\/pre>\n\n\n\n<p>\u30d9\u30f3\u30c1\u3057\u307e\u3059\u3002<br>\u524d\u56de\u304c432MB\/s\u3060\u3063\u305f\u306e\u3067\u30013\u500d\u5f31\u3067\u3059\u306d\u3002<\/p>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"generic\" data-enlighter-theme=\"\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\"># hdparm -t \/dev\/md\/md12tb\n\n\/dev\/md\/md12tb:\n Timing buffered disk reads: 3620 MB in  3.00 seconds = 1206.25 MB\/sec<\/pre>\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>\u7d06\u4f59\u66f2\u6298\u3042\u308a\u307e\u3057\u305f\u304c\u3001\u30d0\u30c3\u30af\u30d7\u30ec\u30fc\u30f3\u30dc\u30fc\u30c9\u304c\u5c4a\u3044\u305f\u306e\u3067\u3001\u53d6\u308a\u4ed8\u3051\u30661TB\u271514\u3067RAID\u3092\u7d44\u3082\u3046\u3068\u601d\u3044\u307e\u3059\u3002 IBM x3650 M4\u306b\u306fIBM m5110e\u3068\u3044\u3046RAID\u30ab\u30fc\u30c9\u304c\u642d\u8f09\u3055\u308c\u3066\u307e\u3059\u304c\u3001\u57fa\u672c\u7684\u306b\u306fRAID6\u306b [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[19,23],"tags":[],"class_list":["post-338","post","type-post","status-publish","format-standard","hentry","category-linux","category-system-x3650-m4"],"_links":{"self":[{"href":"https:\/\/blog.gurees.net\/index.php?rest_route=\/wp\/v2\/posts\/338","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.gurees.net\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.gurees.net\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.gurees.net\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.gurees.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=338"}],"version-history":[{"count":4,"href":"https:\/\/blog.gurees.net\/index.php?rest_route=\/wp\/v2\/posts\/338\/revisions"}],"predecessor-version":[{"id":372,"href":"https:\/\/blog.gurees.net\/index.php?rest_route=\/wp\/v2\/posts\/338\/revisions\/372"}],"wp:attachment":[{"href":"https:\/\/blog.gurees.net\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=338"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.gurees.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=338"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.gurees.net\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=338"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}