How To Run Social Media Experiments

Melissa Fach

Jan 22, 20206 min read
Social Media Experiments

There is no absolute how-to guide for social media marketing because every business is different, every audience is diverse, each audience's experience is different, and platform algorithms often make organic reach difficult. 

Every marketing plan has different goals — conversions, engagement, brand awareness, etc. — and every goal needs a different strategy aimed at a particular audience. Every share needs a different message, graphic/video, and landing page to meet the needs of your target audience. Social media marketing can be challenging and requires a lot of planning, time, and effort. 

You can plan well and use your time efficiently, and still not get the results you need or want. Experimentation is often necessary to find strategies that will work and meet your goals. So we asked our community and guest Mike Allton during Semrushchat the following questions:

There a lot of great answers, tips, and suggestions below. Check them out and let us know your answers below.

Is testing a MUST on social media? Why?

“Yes. Here is why: Too many so-called experts will talk about best practices. But the real experts will give the caveat that social media is not a one size fits all approach. There are a lot of considerations and moving parts. Test to see what works.” — Gene Petrov

“Testing on social media should be part of your strategy and everyday tactics. Why? What is working today may not work tomorrow. Our audience expectations change by the day & it is best practice to have continuous optimization, and the way to that is testing.” —  Bernie Fussenegger

“Testing is a must on any platform of marketing. Your audience, trends, intent, tech, etc. are constantly changing and/or updating. Testing helps you stay on top of what is happening while knowing which elements do or don't work for you.” —  Stevie Howard

“Not trying to be contrary here... but. No. Testing is not always a must. — if your social media is more about relationship building or human engagement, testing isn't always a must. — if your social media is more transactional, yes.” —  JP Sherman

“100% — testing is a must! What works in one vertical could have almost no effect on another. Without testing, you lack the data needed to make informed decisions.” —  Brian Kato

“If I had my way every time, yes, yes, it would. But that's not how agency-life works sometimes. Running a live campaign and judging the results in and of itself is a form of experimenting, too.” —  Diana Richardson

What are some things you should consider testing on social?

“Platform (i.e., Twitter). Tactics (i.e., Tweet Chats). Medium (Text/Images/Video). Style (i.e., Funny or Professional). Paid Promotion. Timing & Frequency.” —  Mike Allton

“1) Graphics presentation 2) Colour patterns 3) Post text type 4) Post timing 5) Brand position.” — Amit Kothiyal

“There are so many ways to test on social media: Different images, audience targeting for paid social, posting times, new platforms/tactics, shorter or longer copy, sending traffic to different landing pages and so much more. I testing and innovation!” —  Elena Salazar

“Content/copy, placements (right side vs. in-message), traffic vs. conversion campaigns, click types, paying for impr. vs. clicks. There's a lot of levers to experiment.” —  Maddie Clark

“Considerations for social media testing: Duration of engagement, short term or longer due to amplifications. Sentiment towards content (comments can be negative)! Branded hashtag reception.” —  Chris Dack

“Just a few things worth testing are: Posting time to maximize engagement, post frequency, CTA vs. evergreen frequency, images to improve engagement, retargeting funnels, engagement on particular platforms, copy, and phrasing.” —  Brian Kato

Have you ever tested something on social an it went wrong? What did you learn?

“Did a contest on FB for healthcare staffing. To get a new audience, we used an ad instead of organic posting (FB was their best social platform). It bombed, and we got 1 entry. Learned that organic posting can still perform better than ads.” —  Stevie Howard

“I think it has to be during my initial years of learning paid Marketing. Not using the right target audience cost me the engagement and also burnt money in the wrong place. Learned how to optimize it better from there on.” —  Megha Shrimali

“One of my favorites was an ecomm company that sold 1 product on their website. The CTR was horrible, and the CPC was close to what they expected the CPA to be. Stopped running ads to their site and straight to their Amazon store, and both improved almost instantly.” —  Nathan Turner

“I'll be brutally honest; I managed a campaign (organic and paid) that was a complete flop. The targeting sucked, budgets were set too low considering the competition, and copy didn't resonate with the audience. Lesson learned... never do that again! Plan better.” —  Brian Kato 

“I'd consider a social media test as a failure if it doesn't provide an answer to a question. When that happens, it's more a process failure than a social media failure.” —  JP Sherman

“Sometimes focusing on expanding your audience is the wrong move. Connecting with existing fans/audiences will keep them happy/engaged and bring in other like-minded individuals. Don’t expand too rapidly and lose the engagement you’ve already developed.” —  Mark Gustafson

What are the basic steps for running a social media experiment?

“First, understand that social media tests are both easy and impossible at the same time. It’s relatively easy to set up and execute a test, but technically they’re not controlled enough to be scientific, so beware.” —  Mike Allton

“Sometimes focusing on expanding your audience is the wrong move. Connecting with existing fans/audiences will keep them happy/engaged and bring in other like-minded individuals. Don’t expand too rapidly and lose the engagement you’ve already developed.” —  Mark Gustafson

“1: Set Goals 2: Prioritize Goals 3: Design your Experiment 4: Test Ideas 5: Analyze and Learn 6: Repeat.” —  Saad AK

“Evaluate goals. Establish a hypothesis. Choose KPIs for measurement. Create content. Schedule content. Let it gather data. Look at results (from KPIs) Implement what works. Learn from what doesn't work.” — Click Control Marketing

“1. Find a question you want answered. 2. Change one aspect of the post (whatever) and wait. 3. See whether it worked and answered your question. 4. Yes? Well done! 5. No? Change a different aspect.” —  Sarah Marks

“First steps should be identifying goals, what you want to see, and determining the variables that will be tested between the different posts, i.e., picture vs. no picture. You should also figure out how you'll measure its success, such as likes, comments, or leads.” —  BaerPM

What kind of data or factors should inspire ideas for social experiments?

“Trending topics, influencers, past experiments, and recent success are all factors which should inspire your ideas for your next social experiments!” —  Ben Austin

“Data that inspires us to test new ideas include: Spikes in engagement on certain types of posts. Our competitors and audience using a certain hashtag. A significant drop in reach for certain content/platforms. A day/time that outperforms others.” — Click Control Marketing

“Lead gen and revenue attribution, ultimately. Fun, trendy social content is cute, but if it’s not boosting the bottom line, it is a waste of time.” —  Alexis Katherine

“As a marketer, I often find that I'm too afraid to just try things. We tend to be hyperfocused on theory and data pre-testing. Really. We're so insecure and boring. Young/social/party/media/music type people can inspire and push you. So get involved with them.” —  Remco Tensen

“Factors that I look at are around the audience or customers. How are we best communicating and reaching the audience, and how are they engaging with our content. Usually, it starts with what is working and what isn’t and how can we improve engagement or conversion rates.” —  Bernie Fussenegger

“Test inspiration -> High performing concepts in your vertical. High performing concepts outside your vertical. High performing content on your blog.Highly trafficked content on competitor sites. Look at engagement metrics, BUT if you own the channel, look at multi-channel funnels in Google Analytics!” —  Mark Gustafson

Also see  Social Media Strategies Every Brand Should Follow.

Do you have any strategies for social media experiments?

Please share them in the comments below. We also want to thank everyone that participated in the chat. Join us each Wednesday for  Semrushchat at 11 am ET/4 pm BST.

Author Photo
Melissa FachUS Personality of the Year 2017 Winner and die-hard Star Wars fan. Herder of cats. Non-cook. Find me on Twitter @SEOaware.