AI/autonomous driving high-performance training storage
Support file/HDFS/S3 multi-protocol interoperability, zero copy of data collection, labeling, training, and model publishing in the whole process; high-performance architecture meets the performance requirements of AI model training on bare metal servers and Kubernetes platforms
EDA design, industrial simulation and modeling
Self-developed high-performance XPC parallel client to meet the high-performance storage requirements of HPC applications; XCache provides read-ahead acceleration for large model files, and can adaptively adjust the read-ahead efficiency
Data lake, lake warehouse integrated storage base
Supports the native HDFS storage protocol, providing applications with an authentic big data storage experience; provides enterprise-level big data storage features, compatible with Kerberos, LDAP, Ranger, Sentry authentication and authentication components
Reality 3D, Rendering, 4K/8K NLE
The SMB service provides a high OPS access experience with extremely low memory usage; fine-grained file lock support provides the basis for high concurrent access for rendering and other services
Centralized disaster recovery resource pool
High disk acquisition rate, horizontal expansion, rolling upgrade, permanent data storage, meet disaster recovery storage requirements; can form a complete disaster recovery system through product combination with X3DS (XSKY three-dimensional data management system) and XOCP (XSKY open content platform) solution
Video surveillance, media storage
Supports flexible erasure code (EC) strategies and lossless compression to minimize costs while ensuring data security; supports file pooling strategies, enabling different types of resources/files to be stored in resource pools composed of different media to achieve best cost performance
File sharing, enterprise office storage
Support NFS/CIFS/FTP/S3 multi-protocol interoperable file and bucket sharing; support local, AD, LDAP authentication methods, support read, write, delete, rename, file/directory ACL permission management
User Needs
The development of emerging data-intensive applications brings new challenges to storage
With the innovation of algorithms, the enhancement of computing power and the continuous accumulation of data resources, traditional high-performance computing is rapidly evolving from modeling/simulation applications to big data and AI-based applications. Its main feature is the shift from computationally intensive to data intensive workloads. From computing-centric to data-centric, this is driven by the demand for data-intensive applications, as well as the development of technologies such as big data and AI. Diverse analysis applications bring new challenges to data storage performance and multi-protocol interoperability.
AI technology evolves to form new workflows
Data collection and injection, data preparation, training, inference, and archiving, with new workflows creating new storage loads: a hybrid model of sequential large I/O and random small I/O
Diverse data processing is the new normal
Cloud, big data, and AI technologies are reconstructing the traditional data processing process. A data analysis will involve multiple protocol data access such as file, object, and big data. The traditional method of building a chimney-style storage system based on storage protocols brings continuous data copying and loading, resulting in inefficient business execution
Product Description
XGFS helps users cope with emerging data-intensive challenges, with extremely high cost performance
XGFS (XSKY Global File System) is a new generation of distributed file storage system provided by XSKY. XGFS can implement a unified namespace, and for the same file, it can not only meet the traditional POSIX, NFS, SMB/CIFS, FTP file protocols, but also meet the access requirements of HDFS big data protocol and S3 object storage protocol.
Based on the self-developed high-performance metadata service and all-flash/mixed-flash distributed storage pool, XGFS can bring ultra-high storage access performance to the business and meet the needs of mixed loads. At the same time, the self-developed XCache cache of XGFS can flexibly customize the cache strategy according to the business load, and solve the problem of fast access under different loads and different data models.
According to the data released by IDC in "China SDS File Market Key Vendor Analysis, Year 2022", XSKY ranks sixth and is the only independent SDS vendor on the list, with a large number of customer cases and perfect enterprise-level file storage build experience along with leading technology features.
Product Advantages
Help users respond flexibly and efficiently to the growth of unstructured data
Rich ecological access capabilities
- Satisfies applications' access to traditional POSIX, NFS, SMB/CIFS, and FTP file storage protocols
- Supports HDFS and S3 new storage protocols to meet big data and object ecological application access
- In the unified namespace, interoperability between multiple protocols can be realized, that is, the same data can be accessed using multiple protocols
- Through the self-developed Kubernetes CSI Driver and OpenStack Manila Driver, access to multiple computing platforms is realized
High Performance File System
- Provide XPC parallel private client for extreme performance scenarios to meet the performance requirements of applications to the greatest extent
- Self-developed XCache caching service, which can provide rich business acceleration capabilities such as data caching, metadata caching, data pre-reading, directory pre-fetching, write caching, and Readdir acceleration
- Detailed design and implementation for each protocol channel to meet the performance requirements of the business to the greatest extent
Comprehensive Data Protection
- Extend active-active through files, support file system active-active disaster recovery, and zero data loss
- Combined with X3DS products, it can provide cross-regional asynchronous replication disaster recovery
- Realize all-round data protection through rich features such as snapshot, recycle bin, WORM, audit log, etc.
Convenient operation and maintenance feature support
- Full graphical display of the file system directory tree, extended to the management of advanced features of the directory
- End-to-end full IO link performance indicators can be observed, and multi-dimensional and all-round observations can be made for gateways, metadata, storage pools, file systems, and shared directories
- The product has built-in DNS and load balancing strategies to simplify the complexity of system construction; at the same time, the multi-gateway partition feature can bring more flexible network planning capabilities
- Combined with XOCP products, it can realize the second-level query experience of tens of millions of files, and supports multiple file metadata queries at the same time
