In my last Ecosystm Insight, I spoke about the importance of data architecture in defining the data flow, data management systems required, the data processing operations, and AI applications. Data Mesh and Data Fabric are both modern architectural approaches designed to address the complexities of managing and accessing data across a large organisation. While they share some commonalities, such as improving data accessibility and governance, they differ significantly in their methodologies and focal points.
Data Mesh
- Philosophy and Focus. Data Mesh is primarily focused on the organisational and architectural approach to decentralise data ownership and governance. It treats data as a product, emphasising the importance of domain-oriented decentralised data ownership and architecture. The core principles of Data Mesh include domain-oriented decentralised data ownership, data as a product, self-serve data infrastructure as a platform, and federated computational governance.
- Implementation. In a Data Mesh, data is managed and owned by domain-specific teams who are responsible for their data products from end to end. This includes ensuring data quality, accessibility, and security. The aim is to enable these teams to provide and consume data as products, improving agility and innovation.
- Use Cases. Data Mesh is particularly effective in large, complex organisations with many independent teams and departments. It’s beneficial when there’s a need for agility and rapid innovation within specific domains or when the centralisation of data management has become a bottleneck.
Data Fabric
- Philosophy and Focus. Data Fabric focuses on creating a unified, integrated layer of data and connectivity across an organisation. It leverages metadata, advanced analytics, and AI to improve data discovery, governance, and integration. Data Fabric aims to provide a comprehensive and coherent data environment that supports a wide range of data management tasks across various platforms and locations.
- Implementation. Data Fabric typically uses advanced tools to automate data discovery, governance, and integration tasks. It creates a seamless environment where data can be easily accessed and shared, regardless of where it resides or what format it is in. This approach relies heavily on metadata to enable intelligent and automated data management practices.
- Use Cases. Data Fabric is ideal for organisations that need to manage large volumes of data across multiple systems and platforms. It is particularly useful for enhancing data accessibility, reducing integration complexity, and supporting data governance at scale. Data Fabric can benefit environments where there’s a need for real-time data access and analysis across diverse data sources.
Both approaches aim to overcome the challenges of data silos and improve data accessibility, but they do so through different methodologies and with different priorities.
Data Mesh and Data Fabric Vendors
The concepts of Data Mesh and Data Fabric are supported by various vendors, each offering tools and platforms designed to facilitate the implementation of these architectures. Here’s an overview of some key players in both spaces:
Data Mesh Vendors
Data Mesh is more of a conceptual approach than a product-specific solution, focusing on organisational structure and data decentralisation. However, several vendors offer tools and platforms that support the principles of Data Mesh, such as domain-driven design, product thinking for data, and self-serve data infrastructure:
- Thoughtworks. As the originator of the Data Mesh concept, Thoughtworks provides consultancy and implementation services to help organisations adopt Data Mesh principles.
- Starburst. Starburst offers a distributed SQL query engine (Starburst Galaxy) that allows querying data across various sources, aligning with the Data Mesh principle of domain-oriented, decentralised data ownership.
- Databricks. Databricks provides a unified analytics platform that supports collaborative data science and analytics, which can be leveraged to build domain-oriented data products in a Data Mesh architecture.
- Snowflake. With its Data Cloud, Snowflake facilitates data sharing and collaboration across organisational boundaries, supporting the Data Mesh approach to data product thinking.
- Collibra. Collibra provides a data intelligence cloud that offers data governance, cataloguing, and privacy management tools essential for the Data Mesh approach. By enabling better data discovery, quality, and policy management, Collibra supports the governance aspect of Data Mesh.
Data Fabric Vendors
Data Fabric solutions often come as more integrated products or platforms, focusing on data integration, management, and governance across a diverse set of systems and environments:
- Informatica. The Informatica Intelligent Data Management Cloud includes features for data integration, quality, governance, and metadata management that are core to a Data Fabric strategy.
- Talend. Talend provides data integration and integrity solutions with strong capabilities in real-time data collection and governance, supporting the automated and comprehensive approach of Data Fabric.
- IBM. IBM’s watsonx.data is a fully integrated data and AI platform that automates the lifecycle of data across multiple clouds and systems, embodying the Data Fabric approach to making data easily accessible and governed.
- TIBCO. TIBCO offers a range of products, including TIBCO Data Virtualization and TIBCO EBX, that support the creation of a Data Fabric by enabling comprehensive data management, integration, and governance.
- NetApp. NetApp has a suite of cloud data services that provide a simple and consistent way to integrate and deliver data across cloud and on-premises environments. NetApp’s Data Fabric is designed to enhance data control, protection, and freedom.
The choice of vendor or tool for either Data Mesh or Data Fabric should be guided by the specific needs, existing technology stack, and strategic goals of the organisation. Many vendors provide a range of capabilities that can support different aspects of both architectures, and the best solution often involves a combination of tools and platforms. Additionally, the technology landscape is rapidly evolving, so it’s wise to stay updated on the latest offerings and how they align with the organisation’s data strategy.
In our previous Ecosystm Insights, Ecosystm Principal Advisor, Gerald Mackenzie, highlighted the key drivers for boosting ESG maturity and the need to transition from standalone ESG projects to integrating ESG goals into organisational strategy and operations.
This shift can be difficult, requiring an alignment of ESG objectives with broader strategic aims and using organisational capabilities effectively. The solution involves prioritising essential goals, knitting them into overall business strategy, quantifying success metrics, and establishing incentives and governance for effective execution.
The benefits are proven and significant. Stronger Customer and Employee Value Propositions, better bottom line, improved risk profile, and more attractive enterprise valuations for investors and lenders.
According to Gerald, here are 5 things to keep in mind when starting on an ESG journey.
Download ‘Embedding Sustainability in Corporate Strategy and Operations’ as a PDF
COVID-19 has been a major disruption for people-intensive industries and the BPO sector is no exception. However, some of the forward-looking BPO organisations are using this disruption as an opportunity to re-evaluate how they do business and how they can make themselves resilient and future-proof. In many of these conversations, technology and process reengineering are emerging as the two common themes in their journey to transform into a New Age BPO provider.
In 2022 BPO providers will focus on mitigating their key challenges around handling client expectations, better people management and investing in the right technologies for their own transformation journeys.
Read on to find out what Ecosystm Advisors Audrey William and Venu Reddy think will be the key trends for the New Age BPO in 2022.
Click here to download Ecosystm Predicts: The Top 5 Trends for the New Age BPO in 2022 as PDF
AI has become intrinsic to our personal lives – we are often completely unaware of technology’s influence on our daily lives. For enterprises too, tech solutions often come embedded with AI capabilities. Today, an organisation’s ability to automate processes and decisions is often dependent more on their desire and appetite for tech adoption, than the technology itself.
In 2022 the key focus for enterprises will be on being able to trust their Data & AI solutions. This will include trust in their IT infrastructure, architecture and AI services; and stretch to being able to participate in trusted data sharing models. Technology vendors will lead this discussion and showcase their solutions in the light of trust.
Read what Ecosystm analysts, Darian Bird, Niloy Mukherjee, Peter Carr and Tim Sheedy think will be the leading Data & AI trends in 2022.
Click here to download Ecosystm Predicts: The Top 5 Trends for Data & AI in 2022 as PDF
The term “intranet” won’t die. It should. I don’t think I have ever seen a good intranet in 24 years since I first started writing about business intranets in 1997 (yes – by writing about this market I was a part of the problem!). I’d even argue that there is no such concept as a “good intranet” – as it is an inherently flawed idea. An intranet effectively tries to bring together all the stuff that employees don’t access or don’t want to access and puts it somewhere that employees might actually use.
Intranets don’t help employees do their jobs
Why don’t we access these systems? Because they are generally not “core” to our jobs. Employees will find and access the systems and applications that are core to getting their jobs done – even if they are terrible to use (even in this “designed for humans, SaaS-world” there are still plenty of core systems that are terrible to use). Some companies try to integrate their intranet and core applications; making employees access the intranet to login to their essential apps. This might make life easier for IT responsible for deploying, managing and securing the applications. It also excites HR as they hope that along the way to accessing these systems, a “schmear” of company culture or information might rub off on them. But many employees quickly work out ways around these systems by bookmarking sites or using dedicated applications.
One of the reasons that company intranets are generally so poor is because they don’t actually help people do their job. There are often no guided processes or checklists to ensure follow through on tasks. Remember how many salespeople didn’t (or still don’t) use the CRM system because it didn’t help them actually sell? Well, intranets suffer from the same problem.
Some software providers looked to solve this problem by bringing the company intranet and core application together into a single interface. Salesforce has limited success with Chatter – but many users of Chatter spent much of their energy telling employees they “weren’t using Chatter the right way” – which sounds awfully like a design problem, not a user one.
Now is a good time to review your company intranet
Why now? Because the big collaboration players (Microsoft in particular) are improving their offerings in this space, creating partnerships, and painting a vision of a world where employees might actually WANT to access company intranets.
Which brings me to Microsoft Viva. We wrote about Viva when it was initially launched as a concept and businesses (and more importantly, their employees) can now experience the capabilities. Viva helps resolve some of the challenges with business intranets:
- It makes some of the collaboration systems more usable and insightful
- It actually provides outcomes for employees (through the learning module in particular)
- It integrates with existing processes and exposes these application-centric processes through Teams
At the same time, it is trying to be a “cultural change agent” by having a single place to go to view company news and announcements. This is similar to many company intranets, and like many of them, is likely to be an abandoned sideshow – the only time many employees visit it will be when they are forced to – like when the CEO sends an all-company email saying that there is an announcement on the company intranet that everyone needs to see. Which is the digital equivalent of posting you a letter to inform you that you have an email!
The challenge for Viva is that employees need to be using Teams to get the most out of it – and I don’t just mean “using Teams for chat and calling” but using the collaboration elements effectively – ALL the time. And the challenge with this is that (a) many employees don’t EVER use these features of Teams (or use them sporadically), and (b) some companies (and teams within companies) have multiple platforms for collaboration and sharing (Slack, Trello, Basecamp, Jira etc).
But either way, Viva looks like a positive step forward for collaboration – and more importantly, it gives businesses some guidelines on how to improve their existing intranet.
How to Make your Intranet work?
Integrate the work that people have KPIs on, with collaboration and intranet systems
Design processes so the intranet makes it EASIER for people to do their jobs – by removing unnecessary handing of information, copying and pasting, multiple levels of authentication and moving between many applications or screens. Leave requests or approving invoices have already been integrated into email – so managers can click a button in the email to send the approval. But what if there were a page on the intranet where all the leave requests or approvals for funding or payment were in a single spot? What if the system provided insight around these requests (such as Mary Singh only has 1 day leave left, or Company ABC takes 90 days to pay on average)? And if all leave requests could be approved with a single click, it actually makes the employees life easier.
Build processes into the systems to solve employee pain points
Many intranets are ostensibly used for helping employees find each other or find experts on specific topics. But they don’t guide this process – they just say “there’s lots of information here – use the search tool and good luck!”. Design guided processes for outcomes people actually want to achieve. Survey your employees to find out what they’d like the intranet to help them achieve – and build some employee journey maps across various roles to understand the challenges and pain points. If it makes sense, use the intranet to help resolve those pain points.
Make your existing tools more powerful and easier to use
Your employees generally want to collaborate. Don’t get me wrong – many don’t wake up each morning thinking that they’d love to share some documents with unknown team members today – but they do want to work together more easily than they do today. So take a look at what stops them from achieving this and look to solve those problems by making existing tools more powerful and easier to use. Adding analytics helps employees and their managers better manage their time and their interactions. Automating file sharing and discovery will help employees find the information they need without adding additional work for the content creator.
Businesses need to think of their intranets as “places to get things done”
Too many intranets seem to be designed for 4pm on Friday afternoon versus 9am Monday morning. And if this is yours, then don’t be surprised that employees don’t use it that often or give it little time. The more you can use an intranet to make employees lives easier, the more likely that you will be creating a resource which improves the productivity and happiness of the employees you serve.
As economies around the world are beginning to recover from the recessions and slowdowns caused by the pandemic, we are beginning to witness, what I like to call, the “Great Bounce Forward”.
Why the Great Bounce Forward? Because too many businesses, journalists and economists are talking about businesses “bouncing back”. But there is no bounce back. We are bouncing into the “economic unknown”. The trading conditions we see today are nothing like what they were at the beginning of 2020. While many people refer to the “new normal” I have heard few talks about how they are or will benefit from these new market conditions.
Bouncing back may not be relevant as we negotiate the economic unknown – it is time to evaluate how we can bounce forward!
Leaping Ahead Through Digital First
Customer interactions have changed – digital-first is now a requirement – and many customers expect a personalised and optimised experience. Many companies are starting to personalise experiences today – thinking they are “delighting customers” through personalised transactions and journeys. But you don’t delight customers by giving them what they want – you disappoint them if you don’t offer a true personalised experience.
Digital changes are coming thick and fast. For example, Australia Post has announced that online sales are currently 20% higher than what they were at the previous highest peak in December 2020. Yes – much of Australia is in a lockdown, but online sales are dwarfing what they were during lockdowns in 2020.
But it is not just about offering online sales. In the digital world, customers now expect to be able to track packages, get alerts when they are delivered, and have access to easy and free returns. Again – if you don’t do this today, you are creating poor customer experiences and are most likely losing business to those that offer great experiences.
Here is what organisations are witnessing:
The need to evolve their CRM solution. Salespeople expect the CRM to give them insights on who to sell to, why to sell to them and what approach will work best. CRM systems that don’t provide this analysis are letting businesses and salespeople down.
Analytics has to be turned into actions. More businesses are telling their analytics partners to stop telling them what to do, and just do it! Automating the outcomes of BI and analytics is beginning to be expected.
Ease of use has become essential. Interactions and processes need to be intelligent and easy to automate. We no longer throw teams of people at challenges – we automate the outcomes and use technology to deliver entirely new experiences without teams of employees pulling strings behind the scenes.
Process and technology changes happen quickly and seamlessly. We have been taught this by Zoom, Microsoft, AWS and Google. If you aren’t doing this today, you are behind the market and behind the expectations of your employees and customers.
Ecosystems are emerging to enable this agility and innovation. We can now innovate with a growing range of partners. Companies can partner for a single sale and move on. Start-ups are being embraced by dinosaurs, and competitors are becoming partners. More companies than ever are involving their own customers in their innovation processes. Ecosystems are changing the ability of technology and business teams to offer new and improved services to customers and employees.
Time for a Shift in Organisational Culture
Seemingly, the world changed overnight. But many of these changes have been in the works for years. It just took a global crisis to highlight how important they are and how much organisations need to change to embrace these opportunities. The only thing holding businesses back from thriving in the Great Bounce Forward are their people and culture. If you can embrace these changes, your businesses will move forward and emerge as different companies to the ones that entered the pandemic in early 2020. You’ll be more open, agile, innovative and digitally aware. You’ll be able to move in new, unheralded directions, driving improved customer, shareholder, or citizen value.
So stop thinking about how your business will bounce back. Make plans for it to bounce forward into the unknown.
Cisco has recently announced their intention to acquire Socio Labs, a US-based event technology platform – the latest in a series of acquisitions. Cisco’s Webex Events provides meeting, webinar and webcast capabilities, including polling, Q&A, chat and real-time translation. This acquisition will allow Webex Events to cater to large-scale, hybrid events and conferences. Solution capabilities will include live streaming, sponsorship, networking, and advanced analytics – including for pre-event and post-event activities.
Collaboration Platforms are Here to Stay
2020 was the year video conferencing and collaboration finally became mainstream. With the exponential rise of remote and hybrid working, the investments in collaboration technologies has increased – and Ecosystm research shows that the trend is continuing well into 2021.
The other aspect that has been impacted by the pandemic is the Events business. With social distancing regulations, Events and Marketing teams are being challenged in their outreach and go-to-market initiatives. Even when countries allow in-person events, it is becoming increasingly difficult to get people to attend events. With most organisations allowing remote working many attendees are away from the CBD/ commercial areas and are reluctant to commute to attend events. This has seen the rise of a hybrid event model that caters to both in-person and virtual attendees.
While some countries are beginning to bring back in-person events, they will remain largely virtual. Event organisers will have to cater for those who are happy to attend in-person and those who want to access the event virtually. Providing a better experience for hybrid events, will require richer features using video and collaboration platforms to allow live streaming, chat, feedback, analytics – to gauge audience engagement – polling and other interesting ways to retain audience attention. Additionally, it will be important for these platforms to facilitate sponsorship, registrations and even ticketing capabilities directly from within the platform. These new dimensions to step up engagements for both virtual and in-person events have become necessary for the world we are living in.
Cisco Strengthening Collaboration Capabilities
Cisco is enhancing the virtual/hybrid meeting and events experience they provide and this has been evident from their recent acquisitions. They clearly see the need to enhance audience participation and engagement from pure static video and collaboration environments. Socio Labs’ business accelerated during the pandemic and they built a platform that offers a deeper engagement with the audience. Their customers include Google, Microsoft, PepsiCo and Hyundai.
Last year Cisco acquired BabbleLabs, a noise removal technology provider and the product has been integrated into their Webex platform, to improve the audio experience. Earlier this month Cisco also completed their acquisition of Slido. This means that Webex users can now leverage Slido’s capability of gathering real-time audience feedback, rather than just asking questions via text or chat. The solution can also enhance the learning experience during team training sessions and offers built-in analytics to gauge audience participation and where the gaps are. These acquisitions are an indication that Cisco is serious about their market presence in the video and collaboration space – and is keen on making a mark in the Events market.
Much has been written (and discussed on webinars) about the demands of managing the work-from-anywhere experience. We were all thrown into this last year, and are still working our way through the challenges. For most employees it has been a positive experience – but there is still a lot more we can and should do to improve experiences for employees and their managers.
Workplace Analytics Gains Significance
At the start of 2020, my colleague Audrey William and I discussed the need for workplace analytics when predicting workplace trends for the year, but the pandemic delayed many of these investments. As working from home (or from anywhere) becomes a long-term trend, we are learning that managers need tools to better empower their employees to deliver what the business needs. There are many reports of employees working overtime; working longer days; not taking breaks; being in back-to-back meetings for days on end; skipping meals; and wearing themselves out.
There are many benefits of remote work – employees have the freedom to manage the day as they choose, they have no commute and (conceptually) more harmony between work and home duties. But there are also many processes that are harder. It is not as easy to find the right person to connect to or learn from, get the best information or answer to a question, and get coaching and new skills. Managers need to understand their employee work experience because they don’t sit with or supervise them all day. Self-service for employees used to mean walking around the office and having a conversation or meeting. Today, we need to make these outcomes easier for every worker regardless of location.
Microsoft Lauches Viva
Microsoft has announced the release of Viva – a new product suite to help businesses overcome these challenges. They have published a “Future of Employee Experience” video here as part of the launch – but don’t watch it – or if you do, be prepared to be disappointed when you see the actual products… The good news is that we have moved from oval-shaped phones in Future of Work videos in 2000 (because all web content is designed for round screens right?) to transparent phones in 2010 (who needs to be able to see what’s on the screen?) to virtual screens in Future of Work videos in 2021… Guess they’ll never become a reality either!
Based off the early reviews and commentary about Viva, I believe Microsoft is really onto a winner here:
- Managers need better analytics about how their team spends their days and employees need insights as to how to increase their productivity or find a better balance in their life.
- Employees need to find the people and information in their business to connect with and learn from – how often do employees reach out to others to ask for help or information when the answers they were looking for weren’t too far away. This information needs to be easier to find – even surfaced to employees before they go looking for it.
- Everyone in your business needs to keep learning within their flow of work – the formal training programs offered by most businesses today are useless if employees are too busy to take the course.
- Business leaders need to drive cultural change more effectively or support their broader business initiatives by linking employees with the information and insights that can help reinforce or change organisational culture.
Viva should support these outcomes. Microsoft is partnering with many other businesses to make this work (systems integrators, training providers, workplace and HR platforms etc). If the products deliver as promised, they might provide the missing link that many businesses need today to keep their employees safe, productive, happy and connected.
Learn about the factors that have been accelerating the shift towards the new ways of working. The top 5 Future of Work Trends For 2021 are available for download from the Ecosystm platform. Signup for Free to download the report.
SAS announced that it has acquired Boemska, a provider of low-code development tools and analytics workload management software. The small, privately held company is UK-based with an R&D centre in Serbia. The acquisition will be integrated into SAS Viya, its cloud-native platform, which includes containerised analytics and machine learning offerings. Terms of the deal have not been disclosed.
A SAS silver partner, Boemska has wins in Health, Finance, and Travel. Most of its reference clients are based in Europe in addition to a small number in the US and South Africa. Boemska has two primary software offerings – Enterprise Session Monitor (ESM) and AppFactory. Additionally, it delivers cloud migration, performance diagnostics, and application development services.
Boemska Capabilities
Boemska ESM provides visibility into performance and cost management of analytics workloads. The product enables self-service root cause analysis for developers, monitoring and batch schedule optimisation for administrators, and departmental cost allocation of cloud resources. ESM manages SAS, R, and Python workloads and is compatible with workload management platforms from the likes of IBM and BMC. Boemska shipped an updated version of ESM in 2020 to improve the UI and ensure support for SAS Viya. At the time, it announced that its development team had doubled in the preceding 12 months, suggesting a trajectory of growth.
AppFactory is a low-code development platform for data scientists and data engineers using SAS, which generates JavaScript for front-end developers along with data transport, authentication, and exception handling. SAS emphasises the portability of apps that can be created and run on mobile and IoT devices. Examples provided include machine learning and event alerts in healthcare wearables, video-based defect identification in Manufacturing, and drone-based asset monitoring in Utilities. Boemska states that its low-code offering seeks to bridge the “last mile of analytics” by putting insights into the hands of decision-makers.
SAS Focuses on Cloud-Native Analytics and AI
SAS launched Viya 4.0 in mid-2020, a major step in its vision to become a provider of cloud-native analytics and machine learning solutions. The platform includes offerings, such as Visual Analytics, Visual Statistics, Visual Machine Learning, and Visual Data Science packaged in containers and orchestrated by Kubernetes. Microsoft Azure has become its preferred cloud partner, assisting in developing SAS Cloud, hosted from data centres in the US, Brazil, Australia, and newly launched facilities in Germany and the UK. Viya managed services are also available from Azure regions. AWS and Google Cloud are expected to make the leap to Viya 4.0 from version 3.5 soon. As part of its cloud-native strategy, SAS now offers three tiers for software updates – bi-annual, monthly, or immediately after release.
Ecosystm Comment
The major overhaul of SAS Viya is part of the vendor’s USD 1B investment into AI over three years from 2019-2021. The platform includes a heavy emphasis on NLP, machine learning, and computer vision. The integration of Boemska’s low-code development offering into Viya will allow SAS clients to extract greater value from AI by quickly embedding it in mobile and enterprise applications. The converging trends of citizen developers and data literacy suggest SAS has selected the right path for the future.
Download Ecosystm Predicts: The Top 5 AI & Automation Trends for 2021
Download Ecosystm’s complimentary report detailing the top 5 AI trends in 2021 and what innovations they bring to the table that IT leaders should monitor. Create your free account to access all the Ecosystm Predictions for 2021, and many other reports, on the Ecosystm platform
