Two things happened recently that 99% of the ICT world would normally miss. After all microprocessor and chip interconnect technology is quite the geek area where we generally don’t venture into. So why would I want to bring this to your attention?
We are excited about the innovation that analytics, machine learning (ML) and all things real time processing will bring to our lives and the way we run our business. The data center, be it on an enterprise premise or truly on a cloud service provider’s infrastructure is being pressured to provide compute, memory, input/output (I/O) and storage requirements to take advantage of the hardware engineers would call ‘accelerators’. In its most simple form, an accelerator microprocessor does the specialty work for ML and analytics algorithms while the main microprocessor is trying to hold everything else together to ensure that all of the silicon parts are in sync. If we have a ML accelerator that is too fast with its answers, it will sit and wait for everyone else as its outcomes squeezed down a narrow, slow pipe or interconnect – in other words, the servers that are in the data center are not optimized for these workloads. The connection between the accelerators and the main components becomes the slowest and weakest link…. So now back to the news of the day.
A new high speed CPU-to-device interconnect standard, the Common Express Link (CXL) 1.0 was announced by Intel and a consortium of leading technology companies (Huawei and Cisco in the network infrastructure space, HPE and Dell EMC in the server hardware market, and Alibaba, Facebook, Google and Microsoft for the cloud services provider markets). CXL joins a crowded field of other standards already in the server link market including CAPI, NVLINK, GEN-Z and CCIX. CXL is being positioned to improve the performance of the links between FPGA and GPUs, the most common accelerators to be involved in ML-like workloads.
Of course there were some names that were absent from the launch – Arm, AMD, Nvidia, IBM, Amazon and Baidu. Each of them are members of the other standards bodies and probably are playing the waiting game.
Now let’s pause for a moment and look at the other announcement that happened at the same time. Nvidia and Mellanox announced that the two companies had reached a definitive agreement under which Nvidia will acquire Mellanox for $6.9 billion. Nvidia puts the acquisition reasons as “The data and compute intensity of modern workloads in AI, scientific computing and data analytics is growing exponentially and has put enormous performance demands on hyperscale and enterprise datacenters. While computing demand is surging, CPU performance advances are slowing as Moore’s law has ended. This has led to the adoption of accelerated computing with Nvidia GPUs and Mellanox’s intelligent networking solutions.”
So to me it seems that despite Intel working on CXL for four years, it looks like they might have been outbid by Nvidia for Mellanox. Mellanox has been around for 20 years and was the major supplier of Infiniband, a high speed interconnect that is common in high performance workloads and very well accepted by the HPC industry. (Note: Intel was also one of the founders of the Infiniband Trade Association, IBTA, before they opted to refocus on the PCI bus). With the growing need for fast links between the accelerators and the microprocessors, it would seem like Mellanox persistence had paid off and now has the market coming to it. One can’t help but think that as soon as Intel knew that Nvidia was getting Mellanox, it pushed forward with the CXL announcement – rumors that have had no response from any of the parties.
Advice for Tech Suppliers:
The two announcements are great for any vendor who is entering the AI, intense computing world using graphics and floating point arithmetic functions. We know that more digital-oriented solutions are asking for analytics based outcomes so there will be a growing demand for broader commoditized server platforms to support them. Tech suppliers should avoid backing or picking one of either the CXL or Infiniband at the moment until we see how the CXL standard evolves and how nVidia integrates Mellanox.
Advice for Tech Users:
These two announcements reflect innovation that is generally so far away from the end user, that it can go unnoticed. However, think about how USB (Universal Serial Bus) has changed the way we connect devices to our laptops, servers and other mobile devices. The same will true for this connection as more and more data is both read and outcomes generated by the ‘accelerators’ for the way we drive our cars, digitize our factories, run our hospitals, and search the Internet. Innovation in this space just got a shot in the arm from these two announcements.
When I wrapped up my visit to this year’s Mobile World Congress (MWC) in Barcelona, I had wondered if my pre-trip question of what would the 5G story be after several years of being told that each preceding year was ‘the’ year. However, this year had a very distinct vibe to it, and I was rewarded for my pilgrimage to the Grand Fira.
Let’s not forget that technology takes longer to roll out that all of us want to think and 5G is no different. We have had no excuses since we only have to look at how long it took 3G and LTE to become mainstream and how long the transition from the prior technology took to move to the next generation.
However, the mobile and telecom industry is not the same as it was when earlier telecommunication tech was being upgraded. In the past hardware, benchmarks feeds and speeds dominated the marketing messages, but now it is about software, cloud and ecosystem collaboration. Gone are the days when the telecom equipment vendors ruled the conversation about their technology – that has clearly been replaced by IT companies leading the charge with topics such as virtualization, IoT, analytics and new services. Once there was a US automobile commercial that touted the latest edition of its cars was ‘This is not your father’s Oldsmobile’. Well, 5G is not your father’s telecom infrastructure!
This time around, operator and equipment vendors may have to take the collaborative partner role in any new digital solution. Instead of 5G projects being dominated by Ericsson or Huawei for example, there is a role for the likes of VMware, Microsoft, and Salesforce to be the lead company. In some cases, it could be Bosch, PTC, or Siemens while in others it could be Audi, BMW or Mercedes. The overall trend here is that all of these companies are being digitally driven to deliver new services to a customer that is firmly at the center of an ecosystem. The one industry sector who might lose out could be the telco operators who could be squeezed by the surge from IT vendor relevance, despite them investing heavily on 5G licenses. However, this time the operators are in a much stronger position to be the perfect channel for the massive amount of intelligence-laden data being created by smart connected devices that are not typical mobile devices.
So what was the outcome at MWC? I visited both the Huawei and Ericsson booths following pre-MWC briefing sessions to see if the customer buzz was there – and indeed it was.
Ericsson may have won the prize for the most crowded booth, while Huawei’s sprawling booth wins the most lavish and largest booth. The two company’s 5G messages could not have been more different.
The Big Two
For me, Huawei had invested heavily in making its hardware products very compelling for operators to install. Clearly, there had been a lot of research had gone into replacing existing infrastructure with massive performance upgrades and deployment friendly attributes e.g. size and weight of base stations that could be mounted by individuals rather than by cranes. The result of this strategy is that Huawei’s customers can quickly deploy 5G platforms with lower CapEx and OpEx thus creating significant incentives for operators to migrate to 5G networks.
Ericsson’s leading story was about migrating to 5G by highlighting its key enablers (i.e. carrier aggregation, LTE-NR spectrum sharing, and dual mode 5G cloud core). It appeared that Ericsson had moved its message off hardware (which, by the way, is still table stakes in any selection process and Ericsson had plenty of new 5G related offerings) and onto a strategy of smooth evolution and deployment at scale – a much more business leader discussion than a network, driven by software. Finally, both companies had strong messages around their AI capabilities to help their service providers make sense of the growing complexity of services that will be generated by the connected smart IoT devices.
The Importance of IT Software On 5G
IT and industrial companies played an increasingly important role at this year’s MWC as service providers and they became involved in deeper partnerships. 2019 was the year when the gaps for 5G between the network and IT services were being filled in. For example, I saw AR (augmented reality) solutions by PTC supported by Microsoft and being fed by data off a 5G network. This showed how industry, cloud and network service providers will accelerate new technologies.
In another example, Salesforce showed how Edge Computing events triggered Salesforce SaaS-based enterprise management services while being supported by AT&T’s 5G network and the modules being designed and tested at AT&T’s Foundry. Here, AT&T 5G network was being used as a high-value channel for Salesforce’s customers to run their business functions at the edge of the network.
Digital twins have shown up as a digital representation of a physical device or asset. However, this year, I saw a Wipro example of how 5G could drive digital twin concepts beyond physical assets and into the workflow, supply chain management, logistics and worker safety. Every ‘asset’ that was to be used in a factory floor was digitized into a digital twin and then a 5G network was used to monitor and manage every aspect of the factory. It seemed that Industry 4.0 had arrived in its full glory.
Finally, VMware continues to be the IT company that service providers will either love or dislike – I still don’t know which one it will be. VMware’s virtualization and cloud management capabilities have been extended right into 5G networks. For example, NFV (Network Function Virtualization) is critical to operators as they slice the 5G bandwidth into the appropriate services. VMware has its strategy correct when it says that it could virtualize the network just as it has with the cloud, but in doing so is making itself either a partner or a competitor of the operators for their 5G services revenues. 2018 was the year when VMware made a big splash at MWC, 2019 was the year when they showed that they have something to offer – will 2020 be the year when they take over the network software virtualization profit pools just as they did with the enterprise server virtualization market?
Crawl, Walk, Run
In conclusion, MWC 2019 was the year that the 5G gaps to make end-to-end infrastructure solutions where clearly being filled in. Service providers had stepped up their willingness to be part of the customer-centric ecosystem that is almost certainly being led by IT software companies. Telecom equipment vendors were offering technology solutions to speed up 5G deployments while making forward compatible solutions much easier. Finally, 5G-supported applications remain the last piece of the puzzle that MWC hasn’t addressed fully. As a result of the massively varied 5G use cases, there is still a look of curiosity on which industry will be the lead for 5G – will it be the auto industry with autonomous cars, will it be Industry 4.0 and the smart factory, or will it be smart cities with video surveillance. In addition, it is certain that IoT is still very much a necessary part of any 5G strategy just as AI outcomes continue to fuel IoT-based sensors in technologies such as the self-driving cars, AR, and digital twins. 2019 may have been the year that decided that it won’t matter whether the connected IoT device used licensed (NB-IoT) or unlicensed (LoRa) spectrum protocols as both will be seamlessly connected to a 5G network. IoT was not dead, it had simply grown up and was now integrated with more valuable solutions.