[NEC Topics] Osaka University D3 Center and NEC exhibit 100Gbps file transfer experiment demo at international conference and exhibition SC24
NEC Corporation Press release: November 11, 2024 Osaka University D3 Center and NEC exhibit 100Gbps file transfer experiment demo at international conference and exhibition SC24 Image
URL: https://prcdn.freetls.fastly.net/release_image/78149/755/78149-755-934ba8a726886b19b7c053c9fc6fb923-788×542.png
universities and other research institutions to promote open science, which involves sharing research data with society as a whole. At the G7 Sendai Science and Technology Ministers’ Meeting held in Sendai in May 2023, the “Joint Statement of the G7 Science and Technology Ministers” was issued as a common understanding among the G7 countries and the EU, and the promotion of open science was mentioned in it. I am. To this end, it is essential to build a data infrastructure that allows the research data produced in daily academic research to be shared with various research institutions, managed in a usable format, and made widely available to society. . Against this background, the Osaka University D3 Center is conducting a trial run of the data aggregation platform ONION (Osaka university Next-generation Infrastructure for Open research and innovation), which allows researchers inside and outside the university to accumulate and share research data. We have been doing this since May 2021. The High Performance Computing and Data Analysis Fusion Platform Collaborative Research Institute has been working on the research and development of RED-ONION (Research EnhanceD ONION), which enhances the data aggregation platform ONION, which is currently in trial use, by providing high-speed data transfer services. Today, when large volumes of research data are shared between collaborative research groups, it is necessary to transfer it using extremely slow networks, which takes a considerable amount of time. In some cases, methods such as copying research data onto a hard disk and physically transporting it are also taken. For this reason, data sharing is extremely time-consuming and labor-intensive, which has been an obstacle to promoting research using data. RED-ONION aims to support highly efficient academic research that handles large volumes and large-scale data, and the vast amount of research data generated within the university is shared between major centers within the university, with the data aggregation platform ONION at its core. We provide a high-speed data transfer service that allows you to move and share data at high speed. This will not only improve the circulation of research data within the Osaka University campus, but will also significantly contribute to the productivity of today’s academic research, which requires
high-performance computing and high-performance data analysis that handle large volumes and large-scale data. I aim for that. At this research institute, we are developing a prototype of a high-speed data transfer system that will enable the rapid sharing of huge amounts of research data between research centers in order to realize RED-ONION. This high-speed data transfer system is centered around the ONION data aggregation platform, and will deploy high-speed networks, servers, and storage dedicated to research data transfer at major campus locations. This system will not only allow large-scale, large-scale research data to be moved and shared quickly and efficiently between major centers within the university, but will also be able to be stored on ONION, the data aggregation platform currently in trial operation. The results of this research will be system technology that streamlines the transfer of huge amounts of research data. Research data accumulated in the storage of one research center can be easily and quickly transferred to the storage of another research center or the shared storage of the D3 Center at a speed of approximately 100 Gbps. The feature of this technology is that it enables high-speed transfer of one large file accumulated in one storage to another storage with a single copy command. In preliminary testing, we confirmed that the transfer of one large file of research data consisting of 1 TB was completed in 87 seconds (effective 92.0 Gbps), and that network performance of 100 Gbps could be brought out to near its limit. At SC24, we will conduct long-distance transfer experiments using high-speed data transfer systems and display them at a research exhibition booth run by the National Institute of Information and Communications Technology (NICT Note 2). This experiment was not limited to sharing research data within the university, but also confirmed the performance in long-distance data transfer, assuming data sharing with other domestic universities and other research organizations, and even data sharing with overseas research groups. The purpose is Using the developed prototype, we conducted data transfer experiments between Japan and the U.S. and within the U.S., assuming long-distance international data transfer, using network lines and networks built by NICT with the cooperation of NREN (Note 3) in Japan and overseas. We plan to conduct this using an experimental environment. For this experiment and the development of the prototype, we received technical assistance from Clairinlink Technology Co., Ltd., which develops the high-speed file transfer software Archaea. Additionally, the server equipment was provided by Super Micro Co., Ltd., the storage device was provided by Data Direct Networks Japan Co., Ltd., and some of the network equipment was provided by Macnica Co., Ltd. More (Note 1) High Performance Computing and Data Analysis Collaborative Research Institute https://www.nri.cmc.osaka-u.ac.jp/ja/ (Note 2) National Institute of Information and Communications Technology (NICT): Japan’s only public research institution
specializing in the field of information and communications
https://www.nict.go.jp/ (Note 3) Institutions that cooperated in building the Japan-U.S. experimental network: NII, SingAREN, Internet2, PacificWave, TransPAC, NICT Institutions that cooperated in building the US experimental network: SCinet, Internet2, CENIC Osaka University D3 Center Collaborative Research Institute for High Performance Computing and Data Analysis Fusion Platform
E-mail：date@cmc.osaka-u.ac.jp NEC Education and Science Integration Department E-mail: nec-daigaku-kenkyu-3sol@elsd.jp.nec.com