Massive amounts of data are being generated across all aspects of the natural resources industry. Whether it’s seismic readings of the earth’s surface generated during upstream exploration, equipment and drill site records used to optimize active deposits, or massive backups being generated for disaster recovery - natural resources is generating data in a larger variety, volume, and velocity than ever before.
All of this data is coming from a wide variety of diverse and remote areas spanning the globe. They travel great distances across a myriad of connections such as satellite, wireless and terrestrial links - all with varying strength, quality, and performance. Storage locations are also becoming just as diverse; spanning on-premise, cloud or hybrid.
Once the data is stored, it may not remain stationary. Raw exploration data has to be sent to High Power Computing (HPC) firms to be processed and rendered into visual maps that can be analyzed. The processed data has to then return from the HPC facility back into storage. Then it has to be shared across your organization’s departments, experts and endpoints. This data also has to be transferred to backup storage for disaster recovery. Across the workflow, big data is always travelling great distances - and waiting for transfers is an unacceptable and costly inconvenience.
To work and collaborate effectively with this vast and varied data, a fast and reliable connection is vital. Traditional transfer methods including HTTP, FTP, and TCP weren’t designed to transfer data of this size and scope (multiple-petabytes), and they all suffer from speed degradation caused by latency and packet loss. These factors create speed degradation that can sometimes equal days, meaning lost time, wasted resources and a direct impact on efficiency and ROI.
FileCatalyst's fast file transfer solutions are designed to accelerate and optimize file transfers across these vast and varied networks to maximize throughput and minimize wait times. This is a perfect solution for remote work sites including offshore rigs, remote mines, and anywhere else weak connections and latency are commonplace.
Once exploration commences and the data is delivered to storage, organizations are left with a large collection of complex datasets made up of sophisticated algorithms and code. The various image, video and other file formats require high-performance processing power to be manipulated, rendered, analyzed, converted into 3D models and more.
Wait times can grow significantly when sending data to and from HPC facilities. FileCatalyst’s accelerated file transfer technology sends all of this data, regardless of size, format or distance, in record time by overcoming the transfer challenges faced by traditional transfer methods such as FTP and TCP.
Data Sharing and Collaboration
Once the data has been processed and analyzed at HPC facilities, insights can be gained from the post-stack data and action can be taken. However, these large files have to travel across the organization's network of departments to the hands of engineers, geophysicists and other experts. These connections can be very vast, varied and unreliable when trying to move big data.
FileCatalyst’s synchronization features, found within FileCatalyst Direct’s client application HotFolder, ensure that everyone throughout every phase of the workflow has access to the most recent versions without the need for human interaction. Simply set the synchronization intervals on each endpoint and they will begin to synchronize.
"Upstream Exploration And Extraction"
Remote sensors, geospatial map files and equipment data are some of the forms that big data takes while prospecting new drill sites and exploring potential oil deposits. Today, these datasets are often multi-terabyte in size and they are continually growing in volume, variety and velocity. To be utilized, all of this data coming in from a variety of different sources has to make it to your on-premise, cloud, or hybrid storage. Regardless of what type of stroage you use, or where it's located, FileCatalyst’s patented UDP-based protocol can send these large datasets to any storage location at exceptionally fast speeds, reaching up to 10 Gbps.
Large amounts of time, resources and efforts have been spent collecting and leveraging this data. Losing it is unthinkable, so a proper disaster recovery process must be in place to ensure no harm comes to all of this valuable data. FileCatalyst’s delta transfer feature provides accelerated data-mirroring to off-site backups, ensuring that your backups remain up to date. Industry standard 256-bit AES encryption provides security and byte-by-byte MD5 checksums ensure that every file maintains its integrity.
PGS And FileCatalyst
Learn about how PGS leveraged FileCatalyst Direct to gain speed improvements, unparalleled control of their transfers and use their 10 Gbps line speed to its full extent.