TensorFlow.js (Google IO)

TensorFlow & Deep Learning SG

Martin Andrews @ redcatlabs.com
Martin Andrews @ reddragon.ai

17 May 2018

About Me

  • Machine Intelligence / Startups / Finance
    • Moved from NYC to Singapore in Sep-2013
  • 2014 = 'fun' :
    • Machine Learning, Deep Learning, NLP
    • Robots, drones
  • Since 2015 = 'serious' :: NLP + deep learning
    • & Papers...
    • & Dev Course...

Outline

  • We went to Google IO!
  • Cool stuff (for later)
  • Javascript and Deep Learning
  • Javascript and TensorFlow

Google IO

Keynote end

End of the Duplex Announcement

Google IO

In the crowd

Spotted in the audience

ENHANCE!

ENHANCE!

Other Cool Stuff

May cover these soon

  • TensorFlow lite ~ small-TF
  • ML-Kit ~ Firebase machine learning
  • TFX ~ TensorFlow framework...
    • ... for training and serving ML models
  • Swift ~ "Coming soon" language

Some visibility...

TensorFlow Ecosystem

Who knew? Google has been updating their site..

Javascript Deep Learning

  • Some history...
  • Javascript development is more of a bazaar...

Convnet.js

Convnet.js

(actual contributor in 2014)

TensorFlow Playground

TensorFlow Playground

Written 'ad-hoc'

Meta-Learning Demo

OpenAI Reptile 3-boxes demo

Uses jsNet

Distill

Distill CNN interpretation

Nice CNN interpretability write-up

Javascript TensorFlow

TensorFlow.js

Google IO Announcement

Actual announcement (and demos)

Code example

( Boring )

Code example

Exciting!

Use existing models

Import from Keras !

# Python
import tensorflowjs as tfjs
def train(...):
    model = keras.models.Sequential()   # for example
    #...
    model.fit(...)
    tfjs.converters.save_keras_model(model, tfjs_target_dir)  
    
# JS
import * as tf from '@tensorflow/tfjs';
const model = await tf.loadModel('https://foo.bar/tfjs_artifacts/model.json');
const example = tf.fromPixels(webcamElement);  // for example
const prediction = model.predict(example);

See the tutorial

Browser Benchmark

Browser performance

Not same as native, but not bad

Node.js Deep Learning

  • Javascript isn't only for the browser
  • Node.js support announced at Google IO
  • Still "Experimental" ...

Server Stack

Server TF node stack

Server Benchmark

Server performance

Already on a par with Python

Wrap-up

  • TensorFlow.js now part of ecosystem
  • Welcoming JS devs = Awesome
  • Democratisation may be messy
GitHub - mdda

* Please add a star... *

Deep Learning
MeetUp Group

BONUS !

  • Now FREE from Google via Kaggle (aka Colab) :

( Don't use for Mining )

Deep Learning : Jump-Start Workshop

  • Dates + Cost : End-June, S$600
    • Full day (week-end)
    • Play with real models
    • Get inspired!
    • Pick-a-Project to do at home
    • 1-on-1 support online
    • Regroup on subsequent week-nights

Deep Learning
Developer Course

  • Plan : Advanced modules in September/October
  • JumpStart module is ~ prerequisite
  • Each 'module' will include :
    • Instruction
    • Individual Projects
    • Support by SG govt (planned)
  • Location : SGInnovate
  • Status : TBA

- QUESTIONS -


Martin.Andrews @
RedCatLabs.com

Martin.Andrews @
RedDragon.AI


My blog : http://blog.mdda.net/

GitHub : mdda