Moving to a new site

Hi everyone!  I’ve updated my site.  Please check it out and follow me there in the future.  http://www.nataliekortum.com

Rise of Chief Marketing Technologist

Whether as a CMT (Cheif Marketing Technologist) or CAO (Chief Analytics Officer), I’m so pleased to see analytics reaching a strategic executive function. There are so many times in my career when I believed if someone who understood the data could represent at the executive function, companies would have a competitive advantage.  http://ow.ly/MdBa30mtgEw

MIT DFW Data Science & Machine Learning Seminar

We had such a great turnout at the MIT DFW Data Science & Machine Learning Seminar event last Tuesday.

 

Speaking at the MIT Club on Oct 30th

I’m honored to be representing Dextro Analytics at the MIT – Machine Learning and Data Science – on Oct 30th.

Please come out and join me with some other fantastic colleagues of mine.

http://dallasftworth.alumclub.mit.edu/s/1314/2015/club-class-main.aspx?sid=1314&gid=194&pgid=45135&cid=68968&ecid=68968&crid=0&calpgid=61&calcid=7729

Prewire results to the under-performers

“I’ve made mistakes in delivering results. I used to take the results into the big meetings and it would shame the under-performing division making that division shrink in the chair and then get defensive and question the results. I then learned, it was worthwhile to do the work before the meeting. Share with the under-performing division the results BEFORE the big meeting. Ask them to co-present. Let them ask for the funding to change their performance. The CEO then agrees to the funding and the meeting goes great. The work is still done, it’s just done before the meeting instead of after, and everyone feels more collaborative.” (paraphrased from presentation by Kate Woodcock, VP of Customer Advocacy from VMWare)
I so agree with her. That’s a hard learned lesson that seems so obvious in retrospect. The upfront work is worth it.

Statistics aren’t politically correct

There certainly are some limitations to human decision making, and when seeding with human decisions, the models don’t have the guile to hid the statistics of those decisions.  In this example, the AI pointed out that it is statistically significant that Amazon’s decision to hire is based heavily on gender – even going down to scoring women’s only colleges as undesirable.

In addition, it sounds like this model that Amazon built for recruitment wasn’t successfully able to provide qualified candidates for positions.  I’m surprised that this was rolled out across recruiters at all.  I know of a statistician who would testify in court in the 1970s – 2000s about whether such things were statistically significant in corporate decisions for discriminatory cases.  This algorithm produced is really no different in terms of how discrimination was measured, but it’s hard for me that this wasn’t caught before a recommendations engine was given to recruiters.  Obviously, this is not the story that Amazon would like leaked under any circumstances.

Lessons to learn here:

  • It’s important to be aware of that when building models to mimic current human decisions that human discrimination might be part of the model.
  • Validate that what your model is using to make recommendations fits within your plans for the future before rolling out to people to assist in recommendations.

https://www.businessinsider.com/amazon-built-ai-to-hire-people-discriminated-against-women-2018-10?utm_source=reddit.com

 

Discrimination Issues with Digital Targeting

It’s not too surprising to me that digital targeting is starting to be labelled discriminatory.   When applied just to marketing messages and pushing specific brands,targeting by gender, race, political affiliation has been accepted.  However,  as digital targeting has been used for other purposes rather than just marketing, it raises questions of egalitarian principles and in this case, legality.   It’s a good reminder for those of us in the field to consider the ramifications of what we do as we start using accepted marketing methods on other problems.

http://www.bbc.co.uk/news/technology-45569227

What do you mean by attribution?

There are so many types of Attribution and the terminology can be seemingly interchangeable. I’ve watched three people discuss attribution – each meaning a different type – for a full five minutes before they realized that they weren’t discussing the same thing.  Imagine how challenging this can be if one company is attempting to implement an attribution project, but not everybody at the company is trying to implement the same thing. I’ve been there! I was once brought in to complete the “attribution” project where multiple key stakeholders on the project all thought it meant something different.  Clear definition setting was critical to getting that project to success.

So what are the different definitions of attribution?

  • Digital only attribution (most common)
  • Online to Store
  • Multiple screens
  • Offline (often TV but can be for other offline channels as well) to Online
  • Unified Measurement
  • Campaign experimentation tests
  • Causal lift
  • Marketing Mix Modeling
  • Generic data connections that can support some of these methods

In future posts, I’ll dive into each of these for greater definition and link through this post.  Realize that software vendors often offer multiple combinations of these attributions which can increase the confusion in the market.   I have found that creating these definitions – even if one tool or client is considering multiple types — helps to give everyone a shared, clear understanding and lets you focus on the potential goals of each.