Globus Connect Server Stream Gateway
Introduction
Globus streaming enables applications to stream data securely across wide area networks (WANs). Example use cases include streaming data from scientific instruments to high-performance computing (HPC) centers for real-time processing. The bidirectional nature of these streams enables feedback loops, supporting scenarios requiring near-real-time steering or control of remote instruments.
As a capability of Globus Connect Server (GCS), Globus data streaming leverages the same mechanisms used for establishing data transfer channels. An administrator deploys a stream gateway on the GCS endpoint and configures a stream access point. Stream access points support the same authentication and authorization mechanisms available for mapped collections used for data transfer, ensuring a consistent security posture across these constructs.
Users authenticate to stream access points and establish secure tunnels between them. The tunnel information is then used by applications to seamlessly stream data to each other via the tunnel. Globus provides a library that transparently handles tunnel communications. Applications simply read from and write to local ports while the library routes traffic through the secure tunnel without requiring application code modifications.
The Globus web application and CLI offer interfaces for discovering stream access points, creating tunnels, and monitoring and managing established tunnels.
Key Highlights
-
Provides authenticated, bidirectional data streaming across WAN without requiring pre-deployed keys (e.g., SSH keys)
-
The entire tunnel route is authenticated securing each leg of the connection. End-to-end encryption is left to the users' applications.
-
Leverages well-established mechanisms for secure wide area network connections used in Globus data transfer
-
Consistent security model, where GCS security configuration (authentication and authorization policies) is applied to streaming capabilities
-
Globus provided tooling for minimal to no code change in the applications that stream data
Commands
- globus-connect-server stream-gateway create
-
Create a stream gateway
- globus-connect-server stream-gateway delete
-
Delete a stream gateway
- globus-connect-server stream-gateway list
-
List stream gateways
- globus-connect-server stream-gateway show
-
Show a stream gateway definition
- globus-connect-server stream-gateway update
-
Update an existing stream gateway