AI Events - Rumours from the trade show floor

AI Insights


After of a couple of weeks sunning and sailplane racing in Florida it was straight back into the saddle for a London-based Quarterly Business Review and the excellent “Rise of AI” event in Berlin. Following a year of attending various international AI events I’m starting to develop a feel for their differing textures and here is my current evaluation.

So far, I’ve sampled:

  • Pure AI events
  • High Performance Computing (HPC) events which include some AI
  • Vendor events promoting technology which can accommodate AI
  • AI pavilions at general computing events
  • AI technology conferences (like NVIDIA GPU technology conferences))
  • AI user groups

I enjoy the pure AI events the most, likely because most of the material and concepts are new and interesting. The “Rise of AI” last week had a great cross section of the AI industry attendees including a few veterans from the 80s 'expert systems' era but more commonly freshly minded PhDs in machine learning. The three speaking tracks had a great balance of industry predictions, AI technologies and product showcases with only standing room remaining at many of the sessions.

As an industrial scale data center specialising in HPC and intensive computing, we’re rather attracted to the deep neural network (DNN) training folks who needs 100s of kW of servers and GPUs running non-stop, hence I focused on the DNN crowd attending in abundance. It’s amazing that you often get better engagement with good prospects queuing for coffee than standing on a booth! Such was my luck. My favourite sales and technical guys work both angles well. Below is the excellent Verne Global team we had at the conference:

I struggle to pick the best speaking slots from the extensive event programs. I was sure that the Natural Language session would be fascinating based on the large quantity of it being trained in our data center (check out DeepL as an example of that). So, I made a bee-line for the “Natural Language Processing – The Magic of Communication” by Dr. Aljoscha Burchardt. I arrived early to get a seat and caught the last 15 minutes of the previous talk “Can neuroscience inspire AI?” by Dr. Prateep Beed (below), and my goodness this was a real gem, introducing some concepts that have the capability to evolve the way we approach neural network training, it’s a pity that I missed the earlier part.

Deep neural network training today applies once unimaginable amounts of compute power to configure the network to efficiently perform a task like image recognition. Our brains have evolved much more efficient ways of doing that. Imagine how many times you need to be nearly eaten by some animal to learn to keep your distance. Some of Dr. Beed’s research is looking for these accelerators and how to improve the way machines learn. He gave us a primer on some neuroscience basics with catchy aide memoires:

Neurons that fire together wire together - A repeated task or observation will imprint itself effectively increasing your sensitivity to it.

Memories are actively remembered and forgotten - I always assumed that when I forgot something it was rather random. Something I tried to remember would disappear and others that had no real importance would loiter for years. Clearly, I need to work on my programming! The concept that our intelligence manages which data/DNN component is cached for immediate use, stored locally, stored for long-term retrieval or discarded is fascinating and will become increasingly important as DNNs have prolonged production environments.

Timing of, and direction of synaptic signals impactful - The DNNs I’ve encountered are unidirectional with the data entering at one end and the result being delivered at the other. Human synapses can have electrical or chemical neurotransmitters to build their logic. The electrical ones can be bi-directional, and the uni-directional chemical ones have many state options beyond the binary on/off. In both cases the neurotransmitters have a lifespan after which their activation is no longer effective. Just imagine how much more powerful today’s DNNs would be with some of these more complex attributes.

Transference problem - solve issue with modest data - We can transfer learning from one problem to the next like using tennis skills in badminton. Imagine the possibilities if tasks can be recognised as similar using DNN components from one to another, to solve a similar puzzle, when there is insufficient data for the second’s own DNN training.

This sort of neuroscience-based insight maybe why IBM added native NVLink support to their Power8/9 CPUs. I keep finding folks who want to test their machine vision type DNN training on Power9 to verify the rumours that it significantly reduces DNN training time.

These insights imply that we are just beginning a long DNN adventure where the current technology is analogous to Bell 212, 1,200 bits per second, modems of the pre-Internet era. The next 30 years will be a blast!

My next AI event will be the AI Summit in London June 13/14th which looks like it could be superb. Let’s chat there. One of my colleagues, Wil Wellington, will also be presenting at the German AI meet-up in Hamburg on June 22nd and expects to have a great dialog with the experts there. And remember, all AI training roads lead to Iceland!


Written by Bob Fletcher

See Bob Fletcher's blog

Bob, a veteran of the telecommunications and technology industries, is Verne Global's VP of Strategy. He has a keen interest in HPC and the continuing evolution of AI and deep neural networks (DNN). He's based in Boston, Massachusetts.

Related blogs

AI Icelandic Style – Deep Learning in Reykjavik

Last week I was privileged to be part of our AI and HPC Field Trip to Iceland. The goal of the trip was to share insight and observations around the evolution of AI deep neural network (DNN) training and to tour our HPC-optimised data center. The attendees spanned DNN veterans like Eric Sigler of OpenAI, large enterprise data science leaders like Pardeep Bassi of Liverpool Victoria Insurance (LVE) and start-up pioneers like Max Gerer of e-bot7.

Read more


Heavy metal and tag lines – Rumours from the trade show floor

On the cusp of spring I regularly refresh my GPU technology suntan at the Nvidia GPU Technology Conference (GTC) in San Jose. This year was fascinating as the speed and scale of both AI and Virtual Reality industries has leapt forward. Here are my takeaways...

Read more


Talking Ai with London Cab Drivers

Being a daytime Londoner one of my favourite pastimes is to take an occasional ride in a proper London black cab and have a natter along the way. That is often a pretty cathartic experience - probably more so for the driver than the passenger, but I find it entertaining being the listening post, and London cab drivers are a good measure of the mood of the city. Recently I've had some great conversations about Ai and it's impact on society.

Read more

We use cookies to ensure we give you the best experience on our website, to analyse our website traffic, and to understand where our visitors are coming from. By browsing our website, you consent to our use of cookies and other tracking technologies. Read our Privacy Policy for more information.