Minimal initialization of pixel streaming to a angular app

This is a forked and tweaked version of Embed streaming into a Webpage (no iframe solution) for a streaming ui implementation using angular framework.
Method 2 of this document can be used without changing the source code of the target application. By simply using the server provided in this doc, we can achieve single use token system.

Repo:

https://github.com/e3ds/full-html-control/tree/angularJs

For this tutorial, you must use this Control Panel for now.

This document describes guidelines on how to use the E3DS core library for a frontend application to stream a UE app inside the web application. To make the system work one must have an account in the E3DS platform, upload a UE app, and create a configuration in the control panel.

Method 1: Manually add a token before accessing the stream

Let’s create an angular app using @angular/cli.

CODE

ng create streaming-ui --skip-tests

After this is completed, we will take a look at the index.html in the public folder.

HTML

<!doctype html>
<html lang="en">
<head>
  <meta charset="utf-8">
  <title>StreamingUI</title>
  <base href="/">
  <meta name="viewport" content="width=device-width, initial-scale=1">
  <link rel="icon" type="image/x-icon" href="favicon.ico">
</head>
<body>
  <app-root></app-root>
</body>
</html>

Now we are going to put the script e3dsCore.min.js provided by E3DS into the src/scripts folder. We move on to connecting to our index.html file now. By inserting our script inside the head tag, the index.html becomes the following:

HTML

<!doctype html>
<html lang="en">
<head>
  <meta charset="utf-8">
  <title>StreamingUI</title>
  <base href="/">
  <meta name="viewport" content="width=device-width, initial-scale=1">
  <link rel="icon" type="image/x-icon" href="favicon.ico">
  <script type="text/javascript" defer="defer" src="scripts/e3dsCore.min.js"></script>
</head>
<body>
  <app-root></app-root>
</body>
</html>

And in angular.json, go to projects.streaming-ui.architect.options.assets and add "src/scripts". Otherwise the angular serve would not conside the script folder when serving the application.

However, nothing will happen. To intilaize the process you need to call a function main() which can be referenced by e3ds_controller object produced by e3dsCore.min.js file.

JS

e3ds_controller.main(e3ds_session_token, clientUserName)

We will call it inside window.onload() https://www.w3schools.com/jsref/event_onload.asp. With inserting our script inside the head tag, our html becomes the following:

HTML

<!doctype html>
<html lang="en">
<head>
  <meta charset="utf-8">
  <title>StreamingUI</title>
  <base href="/">
  <meta name="viewport" content="width=device-width, initial-scale=1">
  <link rel="icon" type="image/x-icon" href="favicon.ico">
  <script type="text/javascript" defer="defer" src="scripts/e3dsCore.min.js"></script>
  <script>
    window.onload = function () {
      e3ds_controller.main()
    }
  </script>
</head>
<body>
  <app-root></app-root>
</body>
</html>

We will get invalid e3ds_session_token error which indicates that we forgot to provide a token.

CODE

<!doctype html>
<html lang="en">
<head>
  <meta charset="utf-8">
  <title>StreamingUI</title>
  <base href="/">
  <meta name="viewport" content="width=device-width, initial-scale=1">
  <link rel="icon" type="image/x-icon" href="favicon.ico">
  <script type="text/javascript" defer="defer" src="scripts/e3dsCore.min.js"></script>
  <script>
    window.onload = function () {
      e3ds_controller.main("myToken")
    }
  </script>
</head>
<body>
  <app-root></app-root>
</body>
</html>

We need to provide username too. Otherwise we’ll get the invalid clientUserName error.

CODE

<!doctype html>
<html lang="en">
<head>
  <meta charset="utf-8">
  <title>StreamingUI</title>
  <base href="/">
  <meta name="viewport" content="width=device-width, initial-scale=1">
  <link rel="icon" type="image/x-icon" href="favicon.ico">
  <script type="text/javascript" defer="defer" src="scripts/e3dsCore.min.js"></script>
  <script>
    window.onload = function () {
      e3ds_controller.main("myToken", "myUserName")
    }
  </script>
</head>
<body>
  <app-root></app-root>
</body>
</html>

This token was not found because system doesn't have any reference which indicates that this token was created via the system.

We need to generate a token here, and to make this token work with our present task, we have to generate it against a specific payload, which has to be a JSON object. For our task's purpose, this payload has to have at least these fields:

JSON

{
  "core": {
    "domain": "streaming domain",
    "userName": "clientUserName",
    "appName": "App available in your control panel",
    "configurationName": "config available in your control panel"
  }
}

userName: the username for which it will stream
appName: the name of the app that will stream
configurationName: the name of the configuration in the control panel with which the app will stream

To make things more clear, let's grab all those pieces of information from a working version of the streaming URL. Here, for the purpose of this tutorial, I will be using a URL from Eagle 3D’s account. In your case, you have to use a URL from your own account.

First, I made sure that this URL works and streams without any issues: https://connector.eagle3dstreaming.com/v5/demo/E3DSFeaturesTemplate/E3DS-Iframe-Demo.

If we can construct a payload object for token generation based on that URL, then it will be like this: https://connector.eagle3dstreaming.com/v5/demo/E3DSFeaturesTemplate/E3DS-Iframe-Demo.

CODE

{
    "core": {
        "domain": "connector.eagle3dstreaming.com",
        "userName": "demo",
        "appName": "E3DSFeaturesTemplate",
        "configurationName": "E3DS-Iframe-Demo"
    }
}

Now go to https://account.eagle3dstreaming.com/streaming-session-token-generator and follow the steps 1, 2, 3 and 4 sequentially as shown in the image.

Also you will need your username as mentioned in step 5.

In step 4 you will copy the token and paste it into the index.html page code as well as username. Final code for me looked like this:

CODE

<!doctype html>
<html lang="en">
<head>
  <meta charset="utf-8">
  <title>StreamingUI</title>
  <base href="/">
  <meta name="viewport" content="width=device-width, initial-scale=1">
  <link rel="icon" type="image/x-icon" href="favicon.ico">
  <script type="text/javascript" defer="defer" src="scripts/e3dsCore.min.js"></script>
  <script>
    window.onload = function () {
      const myToken = "45512103744459228983927333258117025538266633378182/U2FsdGVkX1/dSKsPFLOETXew6MuQWokkIQJJvqRwltuEDsDUu395F3RI7Z3OgkrvEXsP2MlyS8VrvBt3K7FMaG1wDGcgA7Nsqrj9FUDRFCf5Wh5Y/fFFI8N+uDMtBoCXEyGz96HANR8qAb6uE4n8fOnmqZwhQA0M7+D8zifM6F6fhApar3AxiN8Q/T73XFIeFmRw4fkC3Kk+X8dCtBn92WC4Fb6Ny+Nhh55FPn8KOuDLZt2+8/BSOaCbscBSo6VFIrigyo82TLZXkGYiwZXx8BZZeNjL3aAvt9riw+R1IIBV2rN1JPl/pddM17EETZoXe/j4AJSrxFPBpJ78PPIfyZAtf+2DAxHPkdVAJXoPGh4="
      const myUserName = "demo"
      e3ds_controller.main(myToken, myUserName);
    }
  </script>
</head>
<body>
  <app-root></app-root>
</body>
</html>

Now I get this error:

This is because, for rendering our video stream, we need a video-type element that will be displayed on the webpage. To add that, we need to include the following div with the structure exactly as given, with respected IDs and styles, inside our Angular App. For that we can change the functional component in app.component.html as such:

JS

<div id="playerUI" style="{display: block;}">
  <div id="player" style="{display: block}">
    <video id="streamingVideo">
      <source src="" type="video/mp4"/>
    </video>
  </div>
</div>

Stream will start on the left side.

It might take some time to load, especially on the first load after a recent update and due to many other factors. That's why we need to show a progress bar and other elements to keep the user entertained during the process of loading the stream.

The whole source code can be found in the branch:
GitHub - e3ds/angular-static-file-server as demo-static-token

Method 2: Generating a token at html fetch from server

Generating a token every time could be a problematic process. So, I have provided a Node.js app that uses our token API, and it can be found in this branch:
GitHub - e3ds/angular-static-file-server at main

This is a combined app. First part contains the built version of the angular app. Second part contains a rudimentary express.js app. This method only works with a prod build of the angular app since it uses the express.js app to serve the file. So, angular serve or live reload mode doesn’t work.

1. Checkout the branch
2. Open src/server.js
3. In angular.json, go to projects.streaming-ui.architect.options.assets and add "src/server.js" after "src/scripts". Otherwise the angular build would not take the server.js file when building the application.
4. You have to replace these info in this image, Or you can try with these for now:

5. you can collect API key from this URL: https://account.eagle3dstreaming.com/api-keys-management

6. Run setup.bat
7. Run build.bat
8. Then run token-server.bat
9. Open browser and go to: http://localhost:4200/

If all info was provided correctly, the session will start automatically.

How it works:

When a browser tries to fetch the index.html, the server queries the token from e3ds server and injects into the html along with clientUserName and serves it to the browser.

Useful Global Functions:

Useful Global Functions in streaming ui( No-Iframe) Solution

Communication between web app and UE app

To send message to UE app from the web app call “e3ds_controller.sendToUnreal” .
we will do some major change into it soon. right now it expects a json object. we are planning to change it to a string
Example:

CODE

    window?.e3ds_controller.sendToUnreal({
      Teleport: pos
    });

When a message comes from the UE app the “onResponseFromUnreal(descriptor)“ function is called in global scope. The parameter of the function holds the message.