Wendelin Big Data Learning Track

This learning track contains a sequence of lectures teaching how to setup and use Wendelin. After finishing this learning track, you should have a ready-to-use Wendelin system and be familiar with setting up a sensor, retrieve, analyse and visualize data. 

Lecture 1: Wendelin Introduction

This lecture will introduce Wendelin and underlying concepts.

• Presentation: Introduction to Wendelin

Lecture 2: Setup

There are three ways to setup Wendelin - Wendelin standalone in a VM, Wendelin provisioned through the SlapOS panel, and Wendelin provisioned in a SlapOS Theia IDE environment.
Wendelin Standalone is a quick way to test Wendelin and to do the tutorials in Lecture 3.
Wendelin provisioned with SlapOS is recommended for production.
Wendelin deployed in a SlapOS Theia IDE environment is recommended for developers.
If you are planning to do all the tutorials, Wendelin provisioned with SlapOS (setup B below) is advised.

Setup A: Wendelin Standalone on a VM

• HowTo Install Wendelin Standalone

Setup B: Wendelin through the SlapOS Panel

These tutorials describe the installation process of Wendelin through the SlapOS Panel. You will need a dedicated setup provided by RapidSpace to perform this correctly (ask us by email if one has not been provided for you).

• HowTo Request Wendelin in the SlapOS Panel (Presentation)
• HowTo Request a Frontend with Ciphers (Presentation)
• HowTo Configure Wendelin (Presentation)

Setup C: Wendelin in a SlapOS IDE environment

These tutorials describe the installation process of Wendelin in a SlapOS IDE environment (based on Theia). You will need a SlapOS IDE environment provided by RapidSpace to do this (ask us by email). Note that this SlapOS IDE environment is usually abbreviated as just "Theia" in the documentation.

• HowTo Supply A Software And Request An Instance On Theia (Presentation) (use wendelin instead of html5as-base)
• HowTo Configure Wendelin (Presentation)

Lecture 3: Wendelin for Data Scientists

This section teaches how to use Data Lakes in Wendelin, how to easily upload and download data using ebulk. 

Lecture 3.1: Data Lake Basics

• HowTo Enable User Registration (Presentation)
• HowTo Ingest Data in Wendelin with ebulk (Presentation) 

Lecture 3.2: Big Data Collaboration

• Data Lake Security Model (Presentation)
• HowTo Use Wendelin for Big Data Collaboration (Presentation)

Lecture 4: Wendelin for Data Science Industrialisation

This section shows on a specific example how to configure wendelin, receive streaming data using fluentd and batch data using embulk, as well as how to create simple notebook and visualise data.

• Introduction to Wendelin for Data Science Industrialisation (Presentation)

Lecture 4.1: Dynamic Ingestion Policies

• HowTo Create Data Product (Presentation)
• HowTo Create Data Acquisition Unit (Presentation)
• HowTo Create Data Supply (Presentation)

Lecture 4.2: Automated Data Streaming

• HowTo setup Sensor and IOT Gateway (Presentation)
• HowTo setup Fluentd on IOT Gateway (Presentation) 
• HowTo setup Fluentd on Sensor (Presentation)
• HowTo check data arrival (Presentation)
• HowTo setup fluent-bit on Sensor (Presentation)

Lecture 4.3: Data Processing Workflow

• HowTo Transform Data (Presentation)
• HowTo Resample Data (Presentation)

Lecture 4.4: Data Visualisation

• HowTo Create Notebook with Graphs (Presentation)
• HowTo Create Notebook with Plotly Chart Editor

Lecture 4.5: Industrialize Machine Learning

• HowTo Create Basic Prediction with scikit-learn (Presentation)