faas-edge

SmartHome app deployed in openwhisk as a set of actions

Getting started

1. run minikube
2. port forward owdev-nginx
3. config wks

Actions & FaasEdge Architecture

This section will describe all the actions briefly. At the bottom of section the faas diagtam will be posted.

Processing Action (PA)

Simple action which should provide pre-processing of sensor data.

• remove NaN values
• remove missing values
• format scientific notation

After data preprocessing, PA sends PURE data to SA.

Storing Action (SA)

SA provides a store mechanism to PostgreSQL. SA is in the chain with Processing Action.

As DB has been deployed in K8S, the following connection string shoud be set:

conn=psycopg2.connect("host=pg-minikube-postgresql.default port=5432 dbname=postgres user=postgres password=postgres")

Sequence prst (PRocessing & SToring)

Sequence prst represents chain of two actions, PA and SA in our case. Output from PA is Input in SA.

Create sequnce

wsk action create prst --sequence processingv010,storingv005

Trigger sequnce:

curl -u "789c46b1-71f6-4ed5-8c54-816aa4f8c502:abczO3xZCLrMN6v2BKK1dXYFpXlPkccOFqm12CdAsMgRU4VrNZ9lyGVCGuMDGIwP" \
 "http://localhost:8080/api/v1/namespaces/_/actions/prst?blocking=true&result=true" \
  -X POST -H "Content-Type: application/json" \
  -d '{"data":"1451624436,0.932833333,0.003483333,0.932833333,3.33E-05,0.0207,0.061916667,0.442633333,0.12415,0.006983333,0.013083333,0.000416667,0.00015,0,0.03135,0.001016667,0.004066667,0.001516667,0.003483333,36.14,clear-night,0.62,10,Clear,29.26,1016.91,9.18,cloudCover,282,0,24.4,0"}'

Report Action (RA)

Main functionality of this action is to generate monthy report of Energy Consumption. So this action has been connected to trigger.

Action generate report like the following:

How do we execute RA monthly? Using CronJob in k8s.

Controller Action (CA)

This actions should allow user to turn on/off SAVE mode to provide more efficient energy consumtion.

Device Reader

This is a small app that collect all the data from devices and send it to edge system for advanced EDGE processing/reporting/alerting. This app define SAVE_MODE on app (its False by default).

Architectural diagram:

Development

Useful commands

minikube

Start minikube:

minikube start --addons=ingress

Port-forward owdev nginx:

kubectl port-forward svc/owdev-nginx -n openwhisk 8080:80

Postgres DB in minikube

helm repo add bitnami https://charts.bitnami.com/bitnami
helm install pg-minikube --set auth.postgresPassword=postgres bitnami/postgresql
# For locac development port-forward
kubectl port-forward svc/pg-minikube-postgresql -n default 5432:5432

Openwhisk

Configure wsk:

wsk property set --auth owdev-whisk.auth.system --apihost http://localhost:8080

Deploy action with external packages (zip):

wsk action create processingv8 --kind python:3 --main main processing.zip

Deploy action:

wsk action create helloJS hello.js

Delete action:

wsk action delete helloJS

Pack external python libraries within action:

docker run --rm -v "$PWD:/tmp" openwhisk/python3action bash   -c "cd tmp && virtualenv virtualenv && source virtualenv/bin/activate && pip install -r requirements.txt"

SMTP & MySQL

In smtp directory are stored some k8s manifests related to smtp server.

Why SMTP server?

Well we want to send to user's mail a monthy reports usign cron triggers from openwhisk.

Change config.json in a way to meet requirements of your MySQL.

Also, there is a two DB scripts, which should create table for smtp.

Some SQL notes:

In way all to be working from localhost, we should port-forward web and service of smtp.

kubectl port-forward svc/smtp-service -n default 8085
kubectl port-forward svc/smtp-service -n default 8080

Install DB usingl following commands:

helm repo add bitnami https://charts.bitnami.com/bitnami
helm install my-release bitnami/mysql

Run smpt in docker :

docker pull marcopas/docker-mailslurper
docker run -it -p 2500:2500 -p 8080:8080 -p 8085:8085 --rm docker-mailslurper

Curl

curl -u owdev-whisk.auth.system \
"http://localhost:8080/api/v1/namespaces/_/actions/ACTION_NAME?blocking=true&result=true" \
-X POST -H "Content-Type: application/json"

with body:

curl -u owdev-whisk.auth.system \
 "http://localhost:8080/api/v1/namespaces/_/actions/ACTION_NAME?blocking=true&result=true" \
 -X POST -H "Content-Type: application/json" \
 -d '{"data":"1451624400,0.932833333,0.003483333,0.932833333,3.33E-05,0.0207,0.061916667,0.442633333,0.12415,0.006983333,0.013083333,0.000416667,0.00015,0,0.03135,0.001016667,0.004066667,0.001516667,0.003483333,36.14,clear-night,0.62,10,Clear,29.26,1016.91,9.18,cloudCover,282,0,24.4,0"}'