On June 18, 2020, Databricks announced the support of Apache Spark 3.0.0 release as part of the new Databricks Runtime 7.0. Interestingly, this year marks Apache Spark’s 10th anniversary as an open-source project. The continued adoption for data processing and ML makes Spark an essential component of any mature data and analytics platform.

Machine learning – a tech buzz phrase that has been at the forefront of the tech industry for years. It is almost everywhere, from weather forecasts to the news feed on your social media platform of choice. It focuses on developing computer programs that can acquire data and “learn” by recognizing patterns and making decisions with them.

“The Times They Are A Changing”

“A good design adds value faster than it adds costs!” – Is my campaign design future ready? Are they adding value or just more cost? These have been key challenges faced by marketeers across the globe for a while now and tectonic shifts…

Most of us are familiar with Continuous Integration (CI) and Continuous Deployment (CD) which are core parts of MLOps/DevOps processes.  But Continuous Monitoring (CM) may be the most overlooked part of MLOps process, especially when you are dealing with machine learning models. In the first part of this series, we looked at some of the challenges in scaling and maintaining ML projects in a company.  In part 2, we are going to look at how Tredence is helping customers overcome these challenges.

If there is a word that has seen a spike in usage over the three months, then it must be “UNPRECEDENTED.” There is no better word to describe the situation that businesses and people are faced with today in the face of CoVID 19 pandemic. There are three clear phases in which this event has played out – 1. Pre-CoVID 2. During CoVID and 3. Post-CoVID

Wine, Cheese and Blue Jeans – all of them get better with age.

What about ideas? For most ideas, the opposite is true. Who remembers the revolutionary 5 ¼ floppy disk? At a certain point, ideas need to be debunked. Alternative and novel approaches are needed.

Document Reconciliation and Accounts Process automation both these terminologies go hand in hand these days. Organizations are increasingly looking to automate their reconciliation processes mainly to address the following issues:

Customer satisfaction has become the central point in the E-commerce industry to attract new customers and, most importantly, retain them in the long run. Companies are competing to deliver products as fast as they can in a fast-paced environment. Corporations like Walmart, Amazon, and Home Depot are launching initiatives in this direction like the same day, 1-day, and 2-day delivery promises.

You have just completed a machine learning pilot, tackling a challenging business problem which has stymied your executives for the last few years. As the plaudits roll in, you start thinking about how to move your project from the pilot stage to a full-blown application which will drive business value to your stakeholders…..

The COVID-19 pandemic is fast becoming one of the biggest threats to human lives and the global economy. With governments across the world taking preventive measures of quarantine, social distancing and travel bans, hospitality is one of the first industries to be adversely hit. The impact is not just limited…

The Coronavirus outbreak seems to be having an unprecedented effect globally. While brave health workers are confronting the fatal virus head on, business leaders from several service providers are playing an important role in the background. In addition to medicine and healthcare, basic food items…

Good quality data is extremely important as it directly impacts business insights and this could be in the form of structured data sources like Customer, Supplier, Product etc. or unstructured data sources like sensors and logs. Traditional rule-based methods to manage data quality is no longer efficient…

Let me start this post with a provocative statement: More machine learning models than ever, but are they making it into Production? Or more provocative even: once the ML models make it to production, are the IT Support teams equipped to run it, maintain it, manage it and above all safeguard the investments made on these breakaway enterprise assets?

The era of Artificial Intelligence (AI) has already begun, and various industries are investing heavily in creating self-evolving AI applications. The CPG industry (consumer packaged goods) is carefully taking note and slowly establishing new applications to improve efficiency and decrease expenses. Businesses on the frontline of AI application …

AI has become the pillar of growth for companies when it comes to maintaining relevance as well as an edge over the competition. What’s more, AI based models have become the new revenue drivers for companies looking to capitalize on data as a competitive advantage. The rise in algorithmically driven successes can be attributed primarily to enhancements…

Priya, a budding data scientist, was upset when she was bombarded with programming-related questions in her recent job interview. “I spent the last two years working on various modelling techniques, but now I am being asked questions about Python? I would like to build my career in data science and not in application development,” she said, with genuine doubts…

Have you ever wondered how the complexity in the supply chain ecosystem is influencing your freight spend? What are the factors affecting the overall freight management curve in the supply chain? How can an enterprise meet the 7Rs of Logistics whilst handling a huge amount of customer data…

The hype around Artificial Intelligence is far from fizzling out anytime soon. Digitalization and big data have completely penetrated the supply chain industry and are ubiquitous in nature. This article discusses one of the more interesting trends in the current supply chain analytics space – The Control Tower.

A reliable vendor management system must execute performance-oriented deliverables within a stipulated time frame without errors. High-tech makers of industrial machinery are, thus, in constant lookout for such ‘Make-To-Order’ process settings…

The topic related to ‘Product Management’ has received quite a flake in recent years. Several rounds of discussions have happened to create an analogy out of client’s stand point.
As I heard more of these conversations, there …

‘Augmented data management’ is a key trend where AI/ML is transforming how enterprises manage their data.
In the last article, we looked at some of the key pain points that exist as IT and business leaders …

Let us start with an oft repeated question,” What do you know about your customer’s preferences”?
The answer could be any of the standard responses which talk about their tastes in your merchandise based on past transactional records…

“We are drowning in information, but starved for knowledge”
This is a famous quote by John Naisbitt which shows the key difference between information and knowledge.

Enterprises are rushing to transform themselves, and embrace the promise of digital transformation; and while the means to achieve this end are disputed, there is unanimous agreement on the fact that reliable data is the starting point.

Digital Transformation / Industry 4.0 is on everyone’s mind. Investors are happy to hear from organizations that they are embarking upon a complete Digital Transformation journey. Investors love it, leaders advocate for it, directors have to make it a reality, managers have to design for it, but few understand what all it means in the grand scheme.

In the age of social media, companies are conscious about the reviews that are posted online. Any act of dissatisfaction can be meted out by way of tart sentiments on these platforms. And so enterprises strive hard to give 100% positive experience, by doing all that they can to address customer…

AGCS (Alexa, Cortana, Google, Siri), as I fondly call these services, certainly have taken over my life. I talk to them every day. I take their help in research. I tell them to remind me of important tasks. I even ask them turn on / off different appliances at home. And they never complain! Now who yells at me or more…

In my previous blog, we looked at how the Project Management Organization (PMO) at Tredence enables excellence across projects. In gist, traditional PMOs focus on ensuring projects are completed on schedule, and processes are followed the right way. At Tredence, the PMO group allows improved…

Go to any of the myriad analytics services providers that proliferate the industry today, walk up to any manager, and ask him if any of the analytics projects he works on is similar to the other. Chances are extremely remote that you will receive a response in the affirmative…

1997 was the year of consumable digital revolution – the year when cost of computation and storage decreased drastically resulting in conversion from paper-based to digital storage. The very next year the problem of Big Data emerged. As the digitalization of documents far surpassed the estimates…

The scale of big data, data deluge, 4Vs of data, and all that’s in between… We’ve all heard so many words adjectivized to “Data”. And the many reports and literature has taken the vocabulary and interpretation of data to a whole new level. As a result, the marketplace is split into …

“Times have changed.” We’ve heard this statement ever so often. Generations have used it to exclaim “things are so complicated (or simple) these days,” or expressing disdain – “oh, so they think they are a cool” generation. Whichever way you exclaim, change has been truly the “constant”….

The world of software development and IT services have operated through well-defined requirements, scope and outcomes. 25 years of experience in software development have enabled IT services company to significantly learn and achieve higher maturity. There are enough patterns and standards…

The cliché in the recent past has been about how industries are racing to unlock the value of big data and create big insights. And with this herd mentality comes all the jargons in an effort to differentiate. Ultimately, it is about solving problems. In the marketplace abstraction of problem…