{"id":355,"date":"2021-04-26T09:41:04","date_gmt":"2021-04-26T00:41:04","guid":{"rendered":"http:\/\/blog.gurees.net\/?p=355"},"modified":"2021-04-28T23:29:08","modified_gmt":"2021-04-28T14:29:08","slug":"centos7-9%e3%81%a7infiniband%e3%81%a7iscsi%e3%81%aa%e3%82%b5%e3%83%bc%e3%83%90%e3%82%92%e7%b5%84%e3%82%806","status":"publish","type":"post","link":"https:\/\/blog.gurees.net\/?p=355","title":{"rendered":"CentOS7.9\u3067InfiniBand\u3067iSCSI\u306a\u30b5\u30fc\u30d0\u3092\u7d44\u3080(6)"},"content":{"rendered":"\n<p>NIC\u3092CA05954-2101\u306b\u4ea4\u63db\u3057\u307e\u3057\u305f\u3002ConnectX-3\u306e\u5bcc\u58eb\u901a\u306eOEM\u3067\u3059\u3002<\/p>\n\n\n\n<p>FDR\uff0f40GbE\u304c\u4f7f\u3048\u308b\u306f\u305a\u3067\u3059\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><a href=\"https:\/\/blog.gurees.net\/wp-content\/uploads\/2021\/04\/Ezp52FkVgAEZMW8-1-rotated.jpg\"><img loading=\"lazy\" decoding=\"async\" width=\"900\" height=\"506\" src=\"https:\/\/blog.gurees.net\/wp-content\/uploads\/2021\/04\/Ezp52FkVgAEZMW8-1-rotated.jpg\" alt=\"\" class=\"wp-image-357\" srcset=\"https:\/\/blog.gurees.net\/wp-content\/uploads\/2021\/04\/Ezp52FkVgAEZMW8-1-rotated.jpg 900w, https:\/\/blog.gurees.net\/wp-content\/uploads\/2021\/04\/Ezp52FkVgAEZMW8-1-300x169.jpg 300w, https:\/\/blog.gurees.net\/wp-content\/uploads\/2021\/04\/Ezp52FkVgAEZMW8-1-768x432.jpg 768w, https:\/\/blog.gurees.net\/wp-content\/uploads\/2021\/04\/Ezp52FkVgAEZMW8-1-624x351.jpg 624w\" sizes=\"auto, (max-width: 900px) 100vw, 900px\" \/><\/a><\/figure>\n\n\n\n<p>\u3068\u308a\u3042\u3048\u305aOFED\u3092\u5165\u308c\u307e\u3059\u3002<\/p>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"generic\" data-enlighter-theme=\"\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\"># yum install gtk2 atk cairo gcc-gfortran tcsh lsof tcl tk\n# mount -o ro,loop MLNX_OFED_LINUX-4.9-2.2.4.0-rhel7.9-x86_64.iso \/mnt\n# cd \/mnt\n# \/mnt\/mlnxofedinstall\n# reboot<\/pre>\n\n\n\n<p>OFED\u3092\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3059\u308b\u3068\u30d5\u30a1\u30fc\u30e0\u30a2\u30c3\u30d7\u30c7\u30fc\u30c8\u306b\u5931\u6557\u3057\u305f\u65e8\u306e\u30a8\u30e9\u30fc\u304c\u51fa\u308b\u3068\u601d\u3044\u307e\u3059\u3002\u305b\u3063\u304b\u304f\u306a\u306e\u3067\u5bcc\u58eb\u901a\u306e\u30b5\u30a4\u30c8\u304b\u3089\u30d5\u30a1\u30fc\u30e0\u30a6\u30a7\u30a2\u3092\u30c0\u30a6\u30f3\u30ed\u30fc\u30c9\u3057\u3066\u30a2\u30c3\u30d7\u30c7\u30fc\u30c8\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<p>\u4ee5\u4e0b\u306eULR\u304b\u3089\u30d5\u30a1\u30e0\u30a6\u30a7\u30a2\u3092\u30c0\u30a6\u30f3\u30ed\u30fc\u30c9\u3057\u3001F1025573.exe\u3092WindowsPC\u3067\u5b9f\u884c\u3059\u308b\u3068\u89e3\u51cd\u3055\u308c\u308b\u306e\u3067\u3001\u300c242500F1.bin\u300d\u3092\u30b5\u30fc\u30d0\u306b\u30b3\u30d4\u30fc\u3057\u307e\u3059\u3002<br>https:\/\/azby.fmworld.net\/app\/customer\/driversearch\/ia\/drviadownload?driverNumber=F1025573<\/p>\n\n\n\n<p>\u30b3\u30d4\u30fc\u3067\u304d\u305f\u3089mst status\u3067\u30c7\u30d0\u30a4\u30b9\u3092\u78ba\u8a8d\u3057\u3001flint\u3067\u30d5\u30a1\u30fc\u30e0\u30a2\u30c3\u30d7\u30c7\u30fc\u30c8\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"generic\" data-enlighter-theme=\"\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\"># mst start\nStarting MST (Mellanox Software Tools) driver set\nLoading MST PCI module - Success\nLoading MST PCI configuration module - Success\nCreate devices\n-W- Missing \"lsusb\" command, skipping MTUSB devices detection\n# mst status\nMST modules:\n------------\n    MST PCI module loaded\n    MST PCI configuration module loaded\n\nMST devices:\n------------\n\/dev\/mst\/mt4099_pciconf0         - PCI configuration cycles access.\n                                   domain:bus:dev.fn=0000:86:00.0 addr.reg=88 data.reg=92 cr_bar.gw_offset=-1\n                                   Chip revision is: 01\n\/dev\/mst\/mt4099_pci_cr0          - PCI direct access.\n                                   domain:bus:dev.fn=0000:86:00.0 bar=0x90100000 size=0x100000\n                                   Chip revision is: 01\n# flint -d \/dev\/mst\/mt4099_pci_cr0 -i 242500F1.bin burn\n\n    Current FW version on flash:  2.11.1250\n    New FW version:               2.42.5000\n\nBurning FS2 FW image without signatures - OK\nRestoring signature                     - OK\n# reboot<\/pre>\n\n\n\n<p>ESXi6.7\u304cInfiniBand\u3067\u63a5\u7d9a\u3067\u304d\u306a\u3044\u306e\u3067\u3001ETH\u30e2\u30fc\u30c9\u306b\u5909\u66f4\u3057\u307e\u3059\u3002<\/p>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"generic\" data-enlighter-theme=\"\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\"># mst start\nStarting MST (Mellanox Software Tools) driver set\nLoading MST PCI module - Success\nLoading MST PCI configuration module - Success\nCreate devices\n-W- Missing \"lsusb\" command, skipping MTUSB devices detection\n[root@sv5 ~]# mlxconfig -d \/dev\/mst\/mt4099_pci_cr0 s LINK_TYPE_P1=ETH\n\nDevice #1:\n----------\n\nDevice type:    ConnectX3\nDevice:         \/dev\/mst\/mt4099_pci_cr0\n\nConfigurations:                              Next Boot       New\n         LINK_TYPE_P1                        VPI(3)          ETH(2)\n\n Apply new Configuration? (y\/n) [n] : y\nApplying... Done!\n-I- Please reboot machine to load new configurations.\n# reboot<\/pre>\n\n\n\n<p>\u518d\u8d77\u52d5\u3067\u304d\u305f\u3089\u3001ibstat\u3067\u78ba\u8a8d\u3057\u307e\u3059\u3002<br>Link layer\u304cEthernet\u306b\u306a\u3063\u3066\u3044\u308b\u306e\u3067OK\u3067\u3059\u3002<\/p>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"generic\" data-enlighter-theme=\"\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\"># ibstat\nCA 'mlx4_0'\n        CA type: MT4099\n        Number of ports: 1\n        Firmware version: 2.42.5000\n        Hardware version: 1\n        Node GUID: 0x0002c90300221790\n        System image GUID: 0x0002c90300221793\n        Port 1:\n                State: Active\n                Physical state: LinkUp\n                Rate: 40\n                Base lid: 0\n                LMC: 0\n                SM lid: 0\n                Capability mask: 0x00010000\n                Port GUID: 0x0202c9fffe221790\n                Link layer: Ethernet<\/pre>\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>NIC\u3092CA05954-2101\u306b\u4ea4\u63db\u3057\u307e\u3057\u305f\u3002ConnectX-3\u306e\u5bcc\u58eb\u901a\u306eOEM\u3067\u3059\u3002 FDR\uff0f40GbE\u304c\u4f7f\u3048\u308b\u306f\u305a\u3067\u3059\u3002 \u3068\u308a\u3042\u3048\u305aOFED\u3092\u5165\u308c\u307e\u3059\u3002 OFED\u3092\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3059\u308b\u3068\u30d5\u30a1\u30fc\u30e0\u30a2\u30c3\u30d7\u30c7\u30fc\u30c8\u306b\u5931\u6557\u3057\u305f [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[19,24,23],"tags":[],"class_list":["post-355","post","type-post","status-publish","format-standard","hentry","category-linux","category-network","category-system-x3650-m4"],"_links":{"self":[{"href":"https:\/\/blog.gurees.net\/index.php?rest_route=\/wp\/v2\/posts\/355","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.gurees.net\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.gurees.net\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.gurees.net\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.gurees.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=355"}],"version-history":[{"count":3,"href":"https:\/\/blog.gurees.net\/index.php?rest_route=\/wp\/v2\/posts\/355\/revisions"}],"predecessor-version":[{"id":362,"href":"https:\/\/blog.gurees.net\/index.php?rest_route=\/wp\/v2\/posts\/355\/revisions\/362"}],"wp:attachment":[{"href":"https:\/\/blog.gurees.net\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=355"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.gurees.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=355"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.gurees.net\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=355"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}