IBM SPECTRUM & TRANSFER SERVICES
mmTransfer is a file replication tool that is integrated with the GPFS policy engine to eliminate filesystem scans. Its tunable parallel architecture ensures maximum transfer performance.
mmTransfer can be used across LAN and WAN networks to perform bulk transfer and continuous replication at any directory level between POSIX filesystems, with NFSv4 ACLS. Performance tuning can deliver maximum parallel transfer rates or throttle with server-managed QoS. Server resource tuning includes server load averages and memory allocation to limit end-user disruption.
Integration with the Spectrum Scale policy engine delivers precise control of file selection and filtering based on filesystem metadata, without the lengthy file scans required by traditional migration or synchronization tools.
mmTransfer can be launched as a push or pull architecture in archive, validation, and compression modes.
mmTransfer FILE REPLICATION TOOL HIGHLIGHTS
- Parallel data transfers from Spectrum Scale storage to Scale, NFS or cloud targets
- Integrated with Spectrum Scale policy engine, eliminates time to perform file system scans
- Eliminates single threaded performance bottlenecks in Spectrum Scale AFM, rsync and rclone
- Add encryption and compression
- Bi-direction or one-way synchronization of file systems
- Snapshot replication for point-in-time consistency (source and target must be Spectrum Scale)
- Self-tuning throughput based on ingest rate, file size and network QoS limit
- Perfect for SoNAS and V7000 Unified upgrade to Spectrum Scale
mmTransfer PERFORMANCE – BIG DATA TRANSFERS
Originally written to replace single-threaded file migration tools like Spectrum Scale Active File Management and rsync, mmTransfer was used to migrate 2.9 billion files (~300TB) from an IBM SoNAS to a new Spectrum Scale cluster. After initial and follow-up synchronizations, the transfer to a new Spectrum Scale cluster required less that 1-hour of downtime. mmTransfer performance from the existing SoNAS to the Spectrum Scale cluster averaged 7.5 million files per hour.
