About Me

• Machine Intelligence / Startups / Finance
• • Moved from NYC to Singapore in Sep-2013
• 2014 = 'fun' :
• • Machine Learning, Deep Learning, NLP
  • Robots, drones
• Since 2015 = 'serious' :: NLP + deep learning
• • GDE ML; TF&DL co-organiser
  • Red Dragon AI...

About Red Dragon AI

• Google Partner : Deep Learning Consulting & Prototyping
• SGInnovate/Govt : Education / Training
• Research : NeurIPS / EMNLP
• Products :
• • Conversational Computing
  • Natural Voice Generation - multiple languages
  • Knowledgebase interaction & reasoning

Outline

• whoami = DONE
• What is TensorBoard?
• • Demo - part 1
• Why did I build tb_lite?
• • Demo - part 2
• Wrap-up

TensorBoard FTW

• Visualisation Tool :
• • Metrics
  • Structure
  • Weight distributions
  • Performance

Marketing Animation

Demo Part 1

• Have a look at TensorBoard in Colab

TensorBoard WTF

• Metrics is must-have
• Over optimised (?)
• • Sometimes says "No"
  • Particularly with PyTorch interop
• Need for consistency
• Need for better colours

tb_lite

• Visualisation Tool :
• • Metrics
  • .. the End.
• On GitHub : colab_helper

Marketing Animation

• Error: Category Mis-match...

Demo Part 2

• Have a look at tb_lite in Colab

Deep Learning
MeetUp Group

• MeetUp.com / TensorFlow-and-Deep-Learning-Singapore
• Next Meeting:
• • Date : January, hosted at Google
• Typical Contents :
• • Talk for people starting out
  • Something from the bleeding-edge
  • Lightning Talks

MetaInit

Quick Paper Shoutout

• Google Poster at NeurIPS : MetaInit
• Idea:
• • Initialisation of networks is tricky
  • Standard methods don't account for structure
  • Create metric for 'good initialisation'
  • Train initial weight norms for that
  • No need for BatchNorm
• Works on MNIST ... ImageNet

Deep Learning : Jump-Start Workshop

• First part of Full Developer Course
• Dates : January 15, 16 + online
• • 2 week-days + online content
  • Play with real models & Pick-a-Project
  • Certificates, etc
• Cost is heavily subsidised for SC/PR!
• SGInnovate - Talent - Talent Development -
  Deep Learning Developer Series

Deep Learning
Developer Course

• Module #1 : JumpStart (see previous slide)
• Each 'module' includes :
• • Instruction
  • Individual Projects
  • 70%-100% funding via IMDA for SG/PR
• Module #2 : (est) Feb 2020 : Advanced Computer Vision
• Module #3 : (est) March 2020 : Advanced NLP
• Location : SGInnovate/BASH