ESG 411: The ESG Data ChallengeHeading


By Liam Varn, Director

Click here for the complete white paper – ESG 411: The ESG Data Challenge

For those fresh to the concept, ESG is an opportunity to quantify the performance or risk of companies along the lines of Environmental, Social, and Governance factors. Investors are increasingly applying these non-financial factors to their analysis process and in turn placing pressure on those underlying companies to align their behavior accordingly. ESG metrics are not part of mandatory financial reporting, but most corporations disclose ESG data through sustainability reports or even as part of their annual financial reporting.

Social & Political Pressure Around ESG

ESG has proven a controversial topic within the financial services industry. In 2020, the Trump administration moved to ban ESG investing for tax-advantaged savings vehicles such as 401(k)s, although that news was largely overshadowed by the ongoing Covid pandemic. The topic was addressed again in 2021 when the Biden administration’s Department of Labor reversed course on discouraging ESG analysis.

But it seems that even as of 2019, ESG as a discipline had already reached critical mass. The world’s financial services firms launched slews of internal ESG initiatives. Most of these are part of larger strategies to capture the rapidly growing Millennial and Gen Z market share, both generations which largely reject the traditional business school mantra of corporations only existing to benefit shareholders. 

There is also a tremendous amount of social pressure on corporations today, perhaps especially on financial institutions. For banks and asset managers, there is a risk that by not implementing ESG programs they will be deemed socially out of touch. Furthermore, as part of the Paris Climate Agreement, banks in the EU are already facing pressure from various regulatory bodies to direct capital toward environmentally friendly companies. This manifests itself in various ways, from incorporating scenario analysis for the physical risks of climate change, to accounting for the costs associated with a transition to an economy with a lower carbon footprint. Now that the US has rejoined the Paris Agreement, the Federal Reserve is calling for financial regulators in the US to direct banks to quickly adopt similar new steps to manage climate-related risks.

ESG is Here to Stay…

… And the specific challenge we are focused on at Paradigm is that of data. Financial firms are accustomed to objective data, e.g., prices, rates, and tenor. No one argues about what a company’s financial performance was, and all the market data providers more or less reflect the same data values. Whereas calculating ESG performance (or ESG risk) is by its nature a subjective task, and that presents a number of new challenges for asset managers and banks attempting to source, aggregate, and rationalize the multitude of data options.

The primary way ESG data is calculated originates with the corporations themselves, who self-report. Corporate sustainability reports are consumed and digested by a number of ESG data providers, who typically place numeric score values or grades on companies. There are over 150 ESG vendor data sources, with new entrants constantly emerging. The old guard like Bloomberg, Morningstar, MSCI, S&P, and Fitch all have ESG data offerings or have acquired companies that do. There is also a substantial subset of investment data specifically around climate, the environment, and green bonds, as well as a cottage industry of tech firms scraping news sources and using online sentiment algorithms to evaluate companies’ social capital within an ESG framework.

Most asset managers and banks today subscribe to several ESG vendor data sets, and they often produce some of their own data in-house. In 2020 MSCI informally reported that of the asset managers they polled, most had at least three ESG vendor data sources in addition to any ESG data they calculate in-house. And at Paradigm we’ve seen that number increase dramatically across the financial services firms we support. Given the subjective nature of ESG evaluations, and the often disparate range of scores for the same data point on the same company from different data sources, it’s critical that firms form a methodology for rationalizing and weighing all the available data into a single firm-wide view.

Paradigm is helping financial services clients navigate various ESG journeys, from the design and build of new ESG portfolio construction tools, to creating new ESG performance analytics, establishing new methods and technologies to profile their customer base, and even ways to predict their customers’ preferences using AI. On the sell-side, banks are similarly evaluating their clients (and themselves) along ESG factors. For instance, a bank may want to see the environmental impact of companies they provide loans to, adjust their product offering in respect to their clients’ ESG preferences, or stress test various portfolios’ ESG performance. 

Every large capital markets firm has multiple ESG initiatives ongoing, and the most successful programs have a unified ESG data methodology. At Paradigm, we believe it’s critical that applications across the firm pull from the same golden source ESG data, rather than use different ESG scores for different applications or even having to pay for multiple subscriptions to the same data set. 

At this point it’s important to note that E, S, and G each have nearly endless potential components, and to view this exercise as just an effort of producing scores for each component would be an oversimplification. For instance, one investor may be comfortable with investing in coal mining companies and nuclear power utilities, but not in companies with oil fracking operations. Another investor might not care about the diversity of a company’s employees, but they refuse to own stocks of gun manufacturers. To provide that level of flexibility for different users it’s necessary for financial firms to view ESG data across multiple dimensions.

The ESG Data Process

So, the first step in the process is sourcing ESG data. Which data sources provide coverage for the factors a financial services firm is interested in? Which data sources best match the firm’s definitions? Which vendors seem the most reliable, and what are their subscription models and associated costs? And how much data is a firm willing to produce itself? No ESG data vendor covers every conceivable ESG factor for every company, and their methodologies are all different, so how does a bank or asset manager piece together the optimal assemblage of data sources to cover all their needs? 

The second step is aggregating that data. It’s problematic if different groups within the same firm are pulling data from different sources for different applications. For instance, at Paradigm we’ve seen cases where a client has built out one application for users to construct portfolios with consideration to ESG factors and another application to report ESG performance on existing portfolios; each application was sourcing data from different ESG vendors. Paradigm’s data management experts have stepped in to drive data aggregation and rationalization, centralizing and managing their ESG data in order to both control costs and foster internal alignment. 

The third step is rationalizing the universe of data a firm has aggregated. Once all of a firm’s ESG data is in one place, what happens when two or more sources inevitably reflect different values for the same metric? Does it make sense to average those values, or should one source take precedence over the others? Furthermore, what if the data sources reflect those values in different formats, e.g., one source provides a numeric score and the other provides a letter grade? It’s a tedious process, but ultimately a financial services firm needs to create a golden source consensus that reflects their firm-wide view of necessary ESG data.

Finally, once an organization has sourced, aggregated, and rationalized their ESG data, they can begin to build capabilities to better understand and serve their clients. It’s also very likely that these efforts will result in reduced data costs.

Acting on ESG | The Tools

It’s increasingly apparent that the challenges associated with ESG are especially novel and complex for the financial services industry. The good news is there is a spectrum of data management platforms and software solutions on the market, and Paradigm has partnered with many of them to help create specific utility in this space. For one thing, it’s convenient that the birth of ESG coincides with wide scale cloud adoption. Paradigm often implements Snowflake, and it is an especially useful platform for ESG data. It inherently solves the problem of centralizing a firm’s data, and it makes any data source available to any authorized user or application. Snowflake also natively offers subscriptions to several dozen ESG data providers through Snowflake Data Marketplace. (Amazon Web Services similarly offers ESG data subscriptions through its AWS Data Exchange.)

For firms that are in the process of moving existing data to the cloud, it might be useful to consider a solution such as Informatica MDM to understand, rationalize, and catalog ESG data. Having ESG data on the cloud, or at least centralized in one location, makes it available for applications across the firm and provides a future-proof foundation for any conceivable set of custom ESG applications. In terms of analytics, Tableau and Power BI are the traditional visualization tools, but new cloud-native technologies like ThoughtSpot are gaining traction and proving their value as business users become accustomed to data being at their fingertips.

Summary

Given that we seem to be well past the tipping point for long-term ESG adoption, it would benefit a financial firm of any size to take stock of their current ESG-related projects and align those into a larger business and technology strategy. The industry’s commitment to ESG is only growing, and ESG-related projects are mounting into fully fledged programs of work. Paradigm partners with financial services firms to tackle a wide range of data-driven challenges. We know that ESG adoption can be daunting, but with the right thought leadership and technical expertise we helped our clients through every step of the journey, from strategy and greenfield ideation to platform implementation and integration.

Click here for the complete white paper – ESG 411: The ESG Data Challenge

Recent Posts

Enabling Digital Intelligence Through ThoughtSpot

Written by: Azmath Pasha, Chief Digital Officer, and Kireet Kokala, Cloud Delivery Leader Click here for the complete white paper: Enabling Digital Intelligence Though ThoughtSpot ThoughtSpot, a modern cloud analytics company makes it easy for business teams to ask questions while providing power and flexibility for data experts. While ThoughtSpot’s platform has been around for almost a decade, it has recently enjoyed a larger audience thanks in part to data intelligence solutions that are being pushed by Snowflake Data Cloud, AWS, Azure, Google Cloud Platform, and several others.

Intelligent Data Governance for AI in Financial Services

As data becomes increasingly strategic in the financial sector, traditional data governance approaches must evolve to handle massive data volumes, complex regulatory landscapes, and dynamic risk factors. Intelligent data governance leverages artificial intelligence and machine learning not just to manage data but to actively enhance quality, compliance, and decision-making processes. This guide presents a framework for intelligent data governance tailored for financial services, outlining how AI and ML transform oversight, risk management, and regulatory adherence.

Quantifying the Value of Data in Financial Services

In the financial services sector, data is a critical asset that drives profitability, risk management, regulatory compliance, and competitive edge. However, measuring its value remains challenging for many CFOs across sectors of the financial services industry regardless of organizational size or country of operations. CFOs rely on accurate data for forecasting, budgeting, and strategic planning. Quality data leads to better decision-making, optimized capital allocation, and swift responses to market changes. It is also vital for risk management, regulatory compliance (e.g., BCBS 239, Basel III, AML/KYC), and avoiding fines and reputational damage. “Fit for Business Use” data also supports customer retention, personalized services, and improved revenue stability. Data-savvy CFOs leverage insights for long-term growth.

7 Step Guide to Intelligent Data for Smarter AI

In a world driven by digital innovation, artificial intelligence (AI) is increasingly becoming a cornerstone of business outcomes. However, AI’s ability to deliver meaningful, reliable insights hinges on the quality of the data it processes. Organizations that prioritize intelligent data management can unlock smarter AI capabilities, driving transformation and competitive advantage.

Untangling Data Quality & Data Mastering: A Guide to Making the Right Choice

> Click here for the full white paper. In today’s data-driven world, where AI and generative AI are rapidly transforming industries, businesses depend heavily on accurate, consistent, and trustworthy data to fuel these innovations. AI-driven initiatives cannot succeed without high-quality, mastered data that ensures reliability and trust in AI-generated insights and outcomes. However, the lines between data quality and data mastering are often blurred, leading to confusion about which solution is most suitable for a given challenge.

Empowering AI Initiatives with Governed Data

The global market for AI data management is projected to grow to $70B by 2026, driven by the increasing demand for AI solutions across industries. However, the success of AI initiatives depends largely on the quality and governance of data. Without high-quality, governed data, AI systems cannot function effectively, leading to unreliable outputs and potential ethical issues. This white paper explores the importance of data governance for AI initiatives, the challenges and opportunities in data management, and the strategic approaches and best practices for empowering AI with governed data. It also showcases the partnership between Paradigm Technology and Informatica, which provides organizations with the expertise and tools needed to harness the full potential of data for AI. By implementing robust data governance frameworks and leveraging advanced AI tools, organizations can ensure their AI projects are ethical, compliant, and effective, and achieve better outcomes and drive innovation.

The Value Black Hole of Application Rationalization | White Paper

Digital transformation and multi-cloud adoption are driving almost if not all organizations to rethink their application landscapes. In this Q&A session, the Paradigm team explores what application rationalization is, how to avoid the pitfalls, what success looks like, and how to get started.

Find & Subscribe to Cloud Data

Click here for the complete white paper: Find & Subscribe to Cloud Data Business Challenges & Snowflake Marketplace Value Snowflake, at its core, is a platform used by thousands of customers to mobilize their data: users bring all their data into one place and derive value from it. Customers can not only bring in their own first-party operational data but can augment it with other valuable data sources to enrich what they already own. Snowflake Marketplace was built to help companies discover and directly access data that originates outside their organization.

Lens into AI-Driven Self-Service

Azmath Pasha, Chief Digital Officer, Paradigm Technology Chris Gately, Chief Revenue Officer, Paradigm Technology
Michael Setticasi, VP of Strategic Partnerships, ThoughtSpot Click here for the complete white paper: Lens into AI-Driven Self-Service

California Consumer Privacy Act (CCPA): A Roadmap to Compliance

Want to know more? Click here to register for the adjoining webinar! Read the complete white paper here: California Consumer Privacy Act (CCPA): A Roadmap to Compliance Executive Summary The California Consumer Privacy Act (CCPA 2020), which went into effect earlier this year, is certainly not the first legislation in this area. Over the past few decades, numerous legislations have been enacted to protect the privacy and personal data of consumers. Most notably these include the Health Insurance Portability and Accountability Act (HIPPA 1996), Gramm-Leach-Bliley Act (GLBA 1999), Health Information Technology for Economic and Clinical Health Act (HITECH 2009), Family Educational Rights and Privacy Act (FERPA 1974), and Protection of Pupil Rights Amendment (PPRA 1978). While these are sectorial laws focused on specific industries, CCPA is focused on all California consumer data and includes a carve-out for GLBA and HIPPA.