Content Marketing

3 Ways to Infuse Content Marketing Experimentation Into Your Program

Didi Gluck, vp, editorial director, Manifest

There’s a persistent belief in marketing that the idea is the hard part, and that everything after it is just execution. Get the concept right and the rest will follow. But as a content and digital agency that’s worked with hundreds of clients, we’ve seen time and again that the top causes of delays and inflated budgets generally have nothing to do with the creative. They’re about things like the approval chain, misalignment, and asset management. Operational failures … every one of them.

According to a recent survey that ran in AdWeek, 98% of campaigns launch late and 70% exceed their production budgets. Yet most marketing organizations invest enormous energy developing their creative capabilities and almost none developing their operational ones. If this sounds like your organization, it’s likely costing you more than you realize.

The new competitive advantage in marketing isn’t just a distinct creative campaign. It needs to be paired with the operational infrastructure that gives a great idea a fighting chance. 

Here’s what that looks like in practice, from Manifest’s project managers who thrive in the operational trenches every day.

Alignment is an ongoing discipline

Misalignment rarely happens at kickoff. It usually happens three weeks later, when someone makes a small call without realizing it changes something else and by then, the damage can be hard to undo.

“Most project failures are caused by misalignment, which compounds over time,” says Marissa Thompson, an account operations director at Manifest. A subject-matter expert brought in for one narrow decision, for instance, unintentionally steering the whole workstream off course weeks later. 

The key is to confirm direction at every major inflection point, not just the beginning, asking whether the work still matches the brief, whether priorities have shifted, and whether anyone has an unvoiced concern. This process is baked into how we operate with every client.

Go back to your brief

Contrary to popular opinion, a brief doesn’t always have to be a formal document, it can live in a kickoff call, a project plan, or sometimes, a strategic, shared slide deck. “The format of the brief can be flexible,” Thompson says. “But the objective shouldn’t be.”

What must always be concrete is a mutually agreed-upon path forward. At Manifest, great work starts with a clear picture: what we’re making, why it matters, who we’re talking to, how we’ll know it worked, and the time and resources we’ll have to get there. Without these non-negotiables, even small deviations can send a project off course in ways that aren’t obvious until real harm has been done.

Create conditions for good work

Related to having a clear objective is having a well-defined way of working so you can bring your deliverables to life. Every marketer has been on a project where the work was good but the execution was chaotic. Things got lost. People didn’t know what they were supposed to do or when. That’s not the path to success. Getting the who, when, and where established at the start of every project creates the conditions for your team to do good work, says Emma Hecht, a project manager at Manifest. That means establishing who’s doing the work, how long they need, and where the resources live, so the team can stop guessing and start producing.

Edit your approval chain

Mapping the approval chain early provides protection from people chiming in at the wrong moments and causing unnecessary revision cycles, says Abisola Alade, a project manager at Manifest. And once a stakeholder has made a decision, it should be written down in a place everyone can find it. Nick Prayner, a project manager at Manifest, calls this decision logging. In a long project, that record is the difference between moving forward confidently and spending a meeting relitigating something that was settled three weeks ago.

Define done

“‘Done’ can be an expensive word if everyone on a project is picturing a different finish line,” says Eric Kanerva, a senior project manager at Manifest. That finish line needs to be the same for everyone on the project. Does done mean the assets are delivered? That the campaign is live? That the results are in? Defining done for each deliverable at the start of a project, not the end, eliminates a category of disagreement that reliably surfaces at the worst possible moment, when everyone’s tired and ready to move on.

Take temperature checks

Marketing is a high-pressure, deadline-driven, subjective business. When people don’t feel safe raising problems, they don’t raise them and errors that can cost time and money can happen. Regular live check-ins, along with the occasional unscheduled Slack message, turn potential crises into small talk—so they don’t end up needing crisis control.

As Told at Content Marketing World 2023

This year’s Content Marketing World was held in my backyard (Washington, D.C., that is). And while one of the perks was getting to sleep in my own bed for all three nights of the conference, the biggest perk was getting to learn more about topics I’m passionate about, like experimenting! 

Anyone who attended the event — or read the agenda — knows that it was chock-full of talk about artificial intelligence. So I won’t gatekeep some of the cool ways people in the industry are dabbling with our friend ChatGPT. But I also want to cover other big (and looming) topics that my fellow data analysts are dreading, such as the approaching cookieless world.

Before diving into ways you can experiment as soon as tomorrow, let’s first talk about the two types of experiments as described by Phyllis Davidson, vice president and principal analyst at Forrester, in her session, “Where Science Meets Marketing: Experimentation and Risk Taking to Achieve Breakthrough Results”: micro experiments and experiments leveraging the scientific method. Micro experiments are exactly as they sound — simple and not 100 percent scientific, but they let you try small things to see change (and hopefully positive movement). The latter have a bit more structure, but the beginning point is the same: a guess. 

There are seven steps (all of which we use at Manifest as we test and learn for our clients):

1. Ask a question.

2. Research.

3. Formulate a hypothesis.

4. Make a plan.

5. Experiment.
6. Collect and record results. 

7. Make a conclusion.

So, how can you actually kick off an experiment of your own? I’m glad you asked! Here are three ways to jump-start experimentation. 

Experiment 1: Play with generative AI in your marketing activities, such as SEO, persona building, competitive analysis and creative assets.

Cities with graphics overlaid

As I mentioned, all the buzz at CMW was about AI. Right now, a lot of people are using AI to generate ideas … or don’t use it at all. Where’s the fun in that? Two sessions I attended — Davidson’s and Andy Crestodina’s session on “The Simple But Strategic Approach to SEO” — highlighted some really cool ideas for using generative AI in unexpected ways. Crestodina, the co-founder of Orbit Media Studios, showed how to train and refine ChatGPT prompts to help with a variety of research and content goals. Each of the three thought starters below gives a great jumping-off point for experimentation.

A graph of AI usage

Source: Andy Crestodina’s presentation

1. Creative (localization and atomization): 
You can leverage generative AI for localization by prompting your tool to rework creative assets to align with different cities or geographic locations and even complete translation, an example Davidson shared. Generative AI has also been used (by IBM) to build 200 initial creative assets and more than 1,000 derivatives, yielding 26 times higher engagement than its paid social benchmark

2. Persona building: 
Generative AI can give you a great start on building a user profile to craft content around by entering a prompt such as, “Build me a persona of a commercial satellite operator who works for a global telecommunications company. List the roles, goals, challenges, pain points and decision criteria for selecting a spaceship launch services company.”

Competitive analysis: Now that you have a persona, use AI to help determine whether you or your competitors have better website copy to match that user profile. Ask a question such as, “Here is the copy of another webpage. Which page is more likely to be helpful and informative to the persona? Create a matrix comparing the two. Show your thinking.” 


3. Search-optimized copy: 
After a few prompt refinements, Crestodina asked ChatGPT, “Suggest edits to this page that would rank higher by better indicating its relevance for the key phrases in the data set.” (Note: This was accomplished using the paid version of ChatGPT and uploading a data set.)

Here’s an example output:

  • Before: How to Make Traffic-Driving Social Media Videos in 10 Steps
  • After: How to Craft Engaging Social Media Video Content: A 10-Step Guide


What I learned: ChatGPT and other generative AI tools are super useful but need a lot of human intervention. Play around with them to get inspiration, but lean on your human brain to make sense of its output and make it truly impactful. 

Experiment 2: Find the right way to get zero- or first-party data from your audience. 

Various graphics

Almost everyone knows I love cookies (Crumbl gets me nearly every week). And digital strategist Uzair Hasan gave us a fun start to his session, “Loyalty in a Cookieless Future: The Privacy Landscape + Better Customer Experiences,” with some cookie talk. Then we got into the daunting soon-to-be reality of losing a lot of valuable third-party data. So, what do marketers do without this data? Get our hands on zero-party data (data your customers voluntarily give you) and first-party data (data collected from the interaction). 

This has to be an exchange — a good, fun, engaging user experience given by you, the marketer, to get data from your customer. Hasan gave a few tips during his session:

  • Before you start, rethink what you want to collect and what’s important. Don’t make it a high-effort task for your customer.
  • Consider experimentation out of the gate. What data can you collect that will help with other tests?
  • Every industry is different, so find the best content type to incentivize your audience to participate. A BuzzFeed-style quiz that prompts a user for an email address at the end may work for one brand, but gated content or even a coupon may work better for another.

Let’s think about this one in an example with Crumbl. The brand could test two ways to get information about its customers: Get 5 percent off your first purchase if you give your email address, or get a free cookie on your birthday by giving us your email address. Simple, right? But let’s think about Hasan’s first point. We want the form’s level of effort to be light, but we also need to think about marketing and segmentation. Why don’t we also ask for their favorite cookie? Now, we can create personalized creative to target chocolate lovers with new, similarly flavored cookies on Instagram. 

That was a simple application, but there are many others. Depending on your brand and its authority, gated content is very effective. We have seen strong results with this tactic for at least one Manifest client. Our teams are continuing to test and brainstorm on first-party data collection to get ahead of “cookiepocalypse.”

What I learned: Everyone really is dreading the cookieless world, but there are ways to start capturing first-party data right now to keep your targeting effective.

Experiment 3: Try different creative formats to see which stick. 

Various graphics

I got to listen to a session by a former colleague, Andrew Hanelly, the chief strategy officer of Revmade. He led “Behind-the-Scenes with The Well: How Content Marketing World’s 3x Best Strategy Winner Is Using Content to Drive Engagement and Trust.” Hanelly presented a case study on The Well and all the content formats his team tested to reach and resonate with readers. Like Manifest, Hanelly continues to be audience-obsessed, and he shared his team’s thought process behind learning about its target to make effective content. The team found that the right way to talk to readers was to be “less clinical” and make content fun (yes, fun in healthcare). It has used photo essays, videos, expert features and more to help people manage their health.

Like many marketers today, Hanelly and Revmade were faced with the question, “Do we get on TikTok?” To answer it, they started with the most important question: Is my audience there? The answer was yes. (Hanelly reminded us that people are now “Googling” on TikTok, especially for health-related topics.) Hanelly and his colleagues have tested various in-channel formats and trends, including “Get Ready With Me” and even this hilarious (and educational) video on why mosquitoes love you. It was great to hear how impactful Revmade’s efforts were, especially as I see many of the same best practices happening here at Manifest in rolling out TikTok ads for our client Undeniably Dairy.

What I learned: Your content idea may be crazy enough to work, even if you’re dealing with more regulated clients (like in healthcare). Many content marketers have seen success from their out-there experiments, so don’t be afraid to try.

OK. You’ve made your guess and are ready to test. Let’s talk briefly about measuring your results and building a success rubric. Before you execute your test, please know what metrics you’re using to define success. Depending on the test, it could be something like conversions, email sign-ups (like our Crumbl example) or engagement (like the generative AI example from IBM). Aside from numbers, you also need to keep these things in mind (and Davidson from Forrester reminded us of this!):

  • Ability to execute: Do you have the right tech right now?
  • Priority projects: Does this align with your business’ priorities?
  • High scalability: How do you scale if results are positive?|

Depending on your answers, you may want to rethink your test.

So, how can you actually get started as soon as tomorrow?

Be OK with failing forward.

If you deploy a test that yields negative results, you still learned something. Removing that fear and accepting the outcome of your test will allow your program to continue to evolve. Davidson’s IBM case study highlighted three tips from its vice president of performance marketing and analytics that I’ll leave you with

  • Build a culture of experimentation.
  • Focus on the user experience.
  • You just have to get started.

READY TO GET TO THE POINT?

CHICAGO, IL

NEW YORK, NY

WASHINGTON, DC

PHOENIX, AZ

SAINT JOSEPH, MI