Features Prices
News 0
Latest News See All

Temporarily unavailable. Please come back later.

See All
Webinars 0
Upcoming Webinars See All
Upcoming Webinars

Sorry, we could not find any upcoming webinars.

See recorded webinars
Blog 0
Recent Posts See All

Temporarily unavailable. Please come back later.

See All
Liza Perstneva

How Data Science Can Impact SEO #semrushchat

Liza Perstneva
How Data Science Can Impact SEO #semrushchat

Optimizing a website for search traffic is not a simple task. It usually takes a long time to see results from search engine optimization campaigns. Also, Google’s algorithm is very unpredictable. As a result, sometimes SEO involves a lot of guesswork.

Nevertheless, the more information you possess, the better results you’ll see from your SEO strategies. By using data science, you can get valuable insights into your website’s performance and answers to some of your SEO questions. This information will help you make the right decisions and improve your optimization campaigns.

This time Qi Zhao, our data scientist, joined our other SEMrush Chat participants to discuss how data science can impact SEO. In this post you will find some tips on how using the right data can help you achieve SEO success.

Let’s dive into the topic!

First of all, you need to decide where you will get your data from. We asked our guests to name analytics tools they use to make their SEO more predictable and quantifiable.

Excel. Even though not everyone likes Excel, it’s still one of the easiest and fastest ways to manipulate a large amount of information.

BigQuery. This big data analytics platform is used for processing large datasets. The service runs on the Google Cloud Storage infrastructure.

Tableau. This company produces interactive data visualization software, which allows you to transform data into appealing, interactive visualizations.

Google Analytics. This is probably one of the most popular tools for measuring SEO success. Dallas McLaughlin described five effective Google Analytics strategies for measuring search engine optimization success in his article posted on Kissmetrics.

Google Search Console. Search Console is a free service that helps users monitor and maintain their website’s presence in Google search results. It explains the fundamentals of search and helps you understand how Google sees your site.

These two services provide necessary data on what is working and what is not in your SEO campaign, as Reva Minkoff ‏@revaminkoff points out.

Google Keyword Planner. This new service, which replaced Google’s previous Keyword Tool, has a whole set of features that help users identify a keyword’s increasing or decreasing popularity, filter out low-volume searches, and easily create multiple keyword combinations.

Keywordtool.io. Keyword Tool is a good alternative to Google Keyword Planner. The free version of this tool will generate up to 750 long-tail keyword suggestions for each search term.

Screaming Frog. Screaming Frog is used by SEO agencies and independent SEO consultants around the world. Its SEO Spider Tool will crawl a website that you want to check and examine its URLs for common SEO issues.

Social media analytics. Rachel Howe made a great point by adding social media analytics to this list. With the significant rise of social media, companies all over the world are beginning to take advantage of the opportunities that social networks provide. Analyzing data gathered from various social media websites can help businesses make the right decisions.

We were glad to know that many of our chat participants use SEMrush! Check out the other helpful analytics tools that our guests mentioned in the following recap.


By using these tools, you can leverage SEO best practices and improve your website’s performance in organic search.


One of the key goals of any marketing campaign is to align SEO best practices with other marketing channels in order to better leverage all marketing activities. Let’s figure out how to use data science to accomplish this task.

Our special guest recommends identifying your dependent and independent variables, also known as outcome and predictor variables. Dependent variables hinge on other factors – independent variables. Asking the right questions will lead you to the right answer. In the context of business, a variable is usually an event, a value proposition or some other thing that a company can measure. Understanding how to use the interplay between these two types of variables to measure the effectiveness of different marketing strategies can help your company maximize its marketing impact.

Sharpe Digital suggested using data to access your website’s usability. You should check your site’s navigation and improve it, if necessary. By creating a smooth user experience, you’ll ensure that your visitors can easily browse through your site’s pages and that they’ll want to stay on it.

Knowing your goals and your audience will influence your decisions and help you create more effective marketing strategies in the future. Your marketing campaigns should be based on your audience’s needs, according to Obed M. ‏@MrClics: “Make better decisions and align your campaigns with the needs of your audience.”

ThinkSEM added that, today, it’s really difficult to achieve success online without knowing how to use data analytics: “Frankly, if you don't know how to use data/analytics, you're dead in the water.”

By using trend graphs, you can identify some of your website’s pain points.

Clients interact with your brand in multiple ways. Bill Slawski mentioned several important metrics you should keep track of: social interactions, mentions, reviews and sentiments. Use these metrics to understand the relationship between your customers and your company.

Let’s see what we have so far.


Interpreting your data correctly is key. By using data science appropriately, you can make improvements to your website in order to satisfy your audience’s needs and wants.


Server log analysis is an excellent way to improve your technical and on-site SEO. Going through your log files can help you better understand search engine crawlers behavior for your website. A server log file contains a record of each visit to your website visit and can reveal information that is crucial for thorough SEO analysis.

Many people turn to log analysis only in response to problems, like bugs or errors, or because they’ve been hacked. Nevertheless, it should be done on a regular basis.

Our chat participants mentioned several issues that SEO specialists should definitely pay attention to when they perform log analysis. It helps you identify your website’s architecture (internal link structure); duplicate, low-quality, or thin content; and your site’s performance.

Analyzing your log files can point out URLs that are not often crawled by search engine bots. You may even find that Google is not crawling or indexing one of your website’s crucial pages. Your logs will show you which URLs and directories are getting the most and least attention from the search engine.

It’s also possible that bots are following or indexing pages that you don’t want them to follow or index. Also, your website will lose potential traffic if some of its important pages are not indexed.

Hernan Vazquez also suggested checking your sites load time. Internet users are becoming more and more impatient. A short page loading time is a vital part of your website’s user experience. People will leave your website if it takes too long to load. According to Kissmetrics, 47 percent of visitors expect a webpage to load in two seconds or less.

Andy Drinkwater points out that not all people set specific goals before performing server log analysis.

He also thinks that some SEO specialists don’t know how to look for leaks or missed opportunities where crawl budget is being wasted.

You can find a few other answers from our experts in the following recap.


Server log analysis is an accurate way to find out how search engines crawl your website. Look out for the problems that our guests mentioned when performing log analysis in order to eliminate crawling issues that might be weakening your SEO efforts.


To reach your target market, it’s important to not only gather data, but also to gather the right data. Companies should pay attention to the accuracy of their analytics in order to make sure that their data insights can help them achieve their desired results.

Our chat participants shared their insights on how SEO specialists can improve the accuracy of their big data analysis.

Qi Zhao thinks that one of the biggest challenges for SEO specialists and digital marketers today is that they fail to frame their data in a way that addresses the question they are seeking to answer. Because they have to deal with vast amounts of data, they must learn how to analyze it in order to leverage their strategies. Our special guest recommended that SEO specialists and marketers synchronize their data with their questions.

Many of our guests warned against focusing on just one source. “Never trust just one source. The more sources, the better the results,” says Andy Drinkwater ‏@iqseo. If you can’t understand your data and adjust your marketing strategy accordingly, it won’t be beneficial for you. It’s important to find the right tools to help you interpret big data. “Use multiple tools to validate your data sources and get access to AdWords data,” as Arnout Hellemans ‏@hellemans recommends.

In addition to using the right tools, you should pay attention to the right analytics. Focus on real analytics, as Omi Sido advised. Your metrics and customer actions should be directly tied to KPIs that reflect conversions and customer loyalty. Focus on actionable metrics, rather than vanity ones.

It’s important to not only know your SEO campaign’s numbers, but to be able to tell the story behind those numbers. Data alone can’t always help you take action. Good data is most valuable when it can be comprehended by decision makers. David Kutcher recommends focusing less on numbers and more on stories and the behaviors behind them.

Any individual, no matter how efficient, professional and capable they may be, can make a mistake. Agent Palmer reminded us that a good way to overcome data inaccuracy is to have more than one person analyze your data.

Our guests recommend paying attention to real analytics, focusing less on numbers and more on the stories behind those numbers, choosing the right tools and relying on several sources instead of just one.

Let’s sum up!


What have you done to improve the accuracy of your big data analysis? We would love to hear about your experiences!

Data analytics provides companies with a wealth of information that can be considered when it comes time to make critical marketing decisions. But how can marketers determine which data are the most crucial. At the end of our chat, we asked our guests what data every marketer should analyze to ensure their marketing activities deliver better results and help them achieve their business goals.

First of all, it’s important to clearly understand your business goals. There is absolutely no point in analyzing the wrong metrics.

Our special guest reminded us of the importance of customer segmentation. It allows you to focus on specific groups of people to target. Better segmentation leads to better targeting, higher conversions and higher profits.

Customer retention is important for any business. It’s important to determine how good your customer service is and how quickly you can grow your business.

Qi Zhao also mentioned churn prediction, the process of identifying customers who are likely to cancel their subscription to your service. By predicting customer churn early and responding to it quickly, you can keep more of your existing customers.

Some of our chat participants pointed out that the primary goal of any business is a higher profit. Your conversion rate is crucial, because it’s the metric by which you can measure your business’ profitability. You can use it to predict your future success or understand what’s working and what isn’t. Nevertheless, analyzing your conversion rate alone won’t show you the whole picture of your website’s performance.

Dawn Anderson ‏@dawnieando shared her experience and said that she is now focusing more on conversion, retention and customer lifetime value (CLTV): “After years of chasing traffic, I've decided to focus a lot more on conversion, retention, CLTV.”

Understanding CLTV involves calculating how much net profit a customer will generate over the full span of their relationship with your company. CLTV provides valuable insights into your business and helps you optimize your marketing budget.

Chris Desadoy suggested keeping track of your first-time visitors conversions and the conversion rates of your returning or loyal clients. The way a new visitor will interact with your website will differ from way a returning visitor will interact with it.

Finally, the web traffic sources metric measures which traffic sources are driving visitors to your site: direct, referral, organic, and paid. By analyzing each traffic source, you can find out more detailed information about your web traffic. If you understand how users are finding your website, you will be able to effectively optimize your marketing budget, maximize its impact, and draw more customers.

Let’s summarize our answers!


Data science provides more accurate answers than any non-data-related science. It changes the way we make decisions and help us discover the latest trends. It’s all about answers and decision-making. But having more data is only better if you know what to do with it.

Thanks to all our guests for their valuable tips and great insights into data science and SEO!

Liza Perstneva is a Social Media Manager at SEMrush and a #SEMrushchat host. Follow Liza on Twitter.

Have a Suggestion?