Quickly Scrape SERP Results for SEO

Go to Google.com

Press CTRL+D to bookmark the page

Add it to your bookmarks bar if possible

Copy the code below:

javascript:var a = document.getElementsByTagName('a'), arr = '';for(var i=0; i<a.length; i++) if (a[i].ping && !a[i].href.includes('google'))arr +=('<p>' + a[i].href + '</p>');var newWindow = window.open();newWindow.document.write(arr);newWindow.document.close();


Right click on the bookmark and click “Edit”

Where it says “URL” paste in the code

Rename the bookmark “URL Extractor”

Save the bookmark

That’s it!

Test the URL Extractor – do a Google Search and then click on the Bookmark you’ve just created

You should now have a new tab with all of the URLs listed in it

Change your Google Search settings to show 100 results – you can just copy and paste the tab full of extracted URLS into Google Sheets

Once in Google Sheets, you can easily extract the Meta Titles, Descriptions and keywords

You just need to find and replace the URL in these formulas:

=importxml("https://blackbeltwhitehat.com","//title")
=importxml("https://blackbeltwhitehat.com/","//meta[@name='description']/@content")
=importxml("https://blackbeltwhitehat.com/","//meta[@name='keywords']/@content")

=IMPORTXML("https://blackbeltwhitehat.com/","//h1")

Google Analytics 4 – Quick Notes & Introduction 

GA4

Image Source (google.com)

An Analytics account is your gateway to Analytics. An account can include multiple properties and property types, but a property can belong to only one Analytics account.

A property lives within an account. Properties are the containers for your reports based on the data you collect from your apps and sites. It’s the level at which Analytics processes data and where Analytics can connect with other Google products, like Google Ads.

A data stream lives within a property and is the source of data from your app or website. A property can have one or many data streams.

Info taken from the GA 4 Course here

The guiding principle of account structure

When structuring your Analytics account, remember this guiding principle: Each property should represent a specific user base.

Use separate properties to collect data from each user base you’re interested in understanding better — for example, a specific brand or region.

The new version of Google Analytics – Google Analytics 4 – has less pre-made reports and users are prompted to customise their own dashboards and use the search function.

You can literally ask questions, using the search bar. Which is fun.

Instead of pageviews and sessions, GA 4 is built around events.

Pre-configured reports are limited in GA 4. It’s a good idea to have Universal Analytics in addition to GA4

  • You can’t yet link GA 4 to Search Console
  • You can Can store raw data in BigQuery

when you install GA4 on your site, the reports don’t import data from GA universal – start from scratch – no historical data is passed over to GA4 when you install it on your site.

  • GA4 is Built Around Events.

Events:

You can track pageloads, elements clicked, product details, and loads more

Parameters:

Parameters are info that are sent to GA4 with the events. 

Eg. Pageview is sent to GA4 with URL of the page, page title and the referral details

Automatic Events:

First Visit – first time someone visits site (this even populates the new user report too)

Page View – same as normal pageviews

Session Start – new session after 30 mins of inactivity

User Engagement – starts whens someone on your site for at least 10 secs

Enhancement Measurement

GA4  automatically tracks:

Scrolls – 90% of a page

Outbound Clicks –

Site Search – search queries

Video Engagement – for embedded YouTube videos

File Downloads

ga4 enhanced measurement

To edit the Enhancement Measurement reports go to “Data Streams” in the Admin area:

Google analytics 4 admin

Click on data stream and check to see that “Enhanced Measurement” is switched to the on position. If you click on the cog icon, you can then switch different measurements on and off.

They’ll be set to “on” by default.

There are advanced settings for pageviews and site search – just click “Show advanced settings”. 

Google provides a list of recommended events for all websites and apps, and then by industry.

Retail & eCommerce

Jobs, Education, Local Deals & Real Estate

Travel 

Games

Custom Events

Custom events allows you to name your events.

Google’s naming convention is probably best to copy – [action]_[object/item]

For example, if you create an event to track when people rate your website, call it:

Rate_item 

Instead of

Product-rate

Add parameters such as product, item_id and rating – so you know which product is rated and what rating the user gave it.

You’ll need to register the parameters as custom dimensions or metrics

To make a new event – in the left hand nav/side bar – click – 

Events – Create Event – Name the event

Enter the parameters to tell Google when to trigger the new event

E.g. page_location – contains – thank-you

Click “create” in top right corner.

You can create brand new events in Tag Manager – rather than basing them on existing events

Data Settings>Data Retention

By default GA4 only stores data for 2 months – in the Admin area, you can change this to 14 months.

Go to Admin>Data Settings>Data Retention and change it to 14 months on the drop down menu.




Brief Run Down of GA4 Reports (in the left hand side-menu)

REPORTS

Acquisition Reports – Where are visitors coming from? Looks at channels e.g. organic, and New Users Vs Returning Visitors

  • Click the “+” above the table, to add an additional dimension

    1. Click the + above the table on one of the reports:

2. Add an additional dimension to the table, e.g. Page/Screen > Landing Page

Engagement Reports – What are visitors doing on your site?

To see pageviews and users per page:

  • Reports>Engagement>Pages and Screens

Monetization – New term for eCommerce Reporting in GA 4

See what items people are buying and how much money their spending

Retention – Looks at new users/visitors and returning visitors. See what percentage of different cohorts come back to the site etc

Demographics – Where are people based and what type of people are coming to your site?

Tech – what computers, tablets and phones are people using?

EVENTS

Conversions – conversions can be customised. But typically include “Begin_checkout” and “purchase”

All Events – basically less important events – compared to conversions. Include clicks, scrolls etc.

EXPLORE

Analysis – There is a Template Gallery (top right of screen) 

You can look into funnels, acquisition etc and get cool reports

CONFIGURE 

Audiences – you can build different audiences by location, device etc and analyse them


Notes from the GA4 Course from Google

Google uses identity spaces to track users.

How to use data streams

Remember, a property is the container for your reports based on the data you collect from your apps and sites. 

A data stream lives within a property and is a source of data from your app or website.

Once you’ve identified a user base you’re trying to measure, create a property for that user base. 

Then create a data stream for each of the ways these users interact with your business. For example, if you’re an app developer, you could create one data stream for your iOS app, one for your Android app, and one for your app’s marketing website.

Conversions are events that are assigned a value – such as a purchase, a lead or a download.

To mark events as conversions

In the left-hand side-menu, go to the bottom option “configure” – then “go to admin”

Click “events”

You can now turn on events like 100% scroll, to conversions.

Modelled Conversions

Browsers that don’t allow conversions to be measured with third-party cookies have conversions modeled based on a website’s traffic. Browsers that limit the time window for first-party cookies have conversions (beyond the window) modeled.

Some countries require consent to use cookies for advertising activities. When advertisers use consent mode, conversions are modeled for unconsented users.

Google

Identity Spaces

When trying to understand user journeys, Analytics can use several different user identifiers, such as the IDs you assign users logged into your website, Google signals, and device ID. These groups of identifiers are called identity spaces.

Reports & Explorations

Free From Exploration

The free form exploration allows you to visualize your data with flexibility and ease.

To conduct an ad hoc analysis, just drag and drop the variables you’re interested in onto a canvas to see instant visualizations of your data. Don’t see the variable you’re looking for? Select the plus icon to view the full list of dimensions and metrics you can use.

This tool presents your data in a cross-tab layout, where you can arrange the rows and columns as you like and add the metrics you’re most interested in. You can also apply different visualization styles, including bar charts, pie charts, line charts, scatter plots, and maps.

If you spot a significant data point, right-click on that data point to easily create an audience or segment from it and use it in other explorations. If you use the line chart visualization, you’ll see an automatic feature enabled called anomaly detection. This feature uses machine learning to identify outliers in your data according to your parameters.

Funnel Exploration

Funnel exploration lets you visualize the steps your users take toward a key task or conversion. This tool helps you identify sequences of key events and understand how your users navigate these steps. You’ll be able to see where users enter your funnels, as well as where they drop off.

You can use this information to improve your site or app and reduce inefficient or abandoned customer journeys. You can also easily create audiences of users based on where they enter or exit the funnels you define.

With this tool, you can define up to 10 steps in your funnels, up from five steps in UA properties’ Custom Funnels. Plus, you can now analyze both closed funnels (where users must enter at the beginning of the funnel) and open funnels (where users can enter the funnel at any point).

Path Exploration

Path exploration lets you understand how people progress from one stage in the customer journey to the next

Like funnel exploration, path exploration uncovers the steps users take through your site or app. But while funnels only analyze a single, predefined path, path exploration is free-flowing and can follow any number of undefined paths, even ones you weren’t aware of or didn’t intend. For example, it could uncover looping behavior, which may indicate users becoming stuck.

Plus, you can define paths using either a starting point or an ending point. This helps you understand how users got to a certain step on their journey and shows you what they did after.

Segment Overlap

Segment overlap lets you compare up to three user segments to quickly see how those segments overlap and relate to each other. This can help you isolate specific audiences based on complex conditions. You can then create new segments based on your findings, which you can apply to other exploration techniques and Google Analytics reports.

Copy taken from the Google Course here.

google analytics 4 user exploration

Explorations are private by default. If you’re the creator, only you can view and edit them unless you choose to share.

Understand the Analytics property structure

You can use GA4 properties exclusively for web data, exclusively for app data, or for both app and web data together. No matter what your setup is, it’s important to understand how to structure your new Analytics property.

Introducing data streams

Data streams are a feature of GA4 properties that allow you to connect a single Analytics property to the various places where your users interact with your business. For example, a company that has both a website and an app would need a separate data stream for each platform to combine their reporting and insights into a single Analytics property.

Once you have set up your GA4 property and data stream(s), you can add different events.

For an eCommerce store, Google recommends setting up:

Google Analytics 4 filters are applied at the property level, and affect data from all data streams in that property. All reports for a property use the same filtered data.

Analytics collects and stores user interactions with your website or your app as events. Events provide insight into what’s happening on your website or app, such as page views, button clicks, user actions, or system events.

Conversions

It’s easy to create conversions, from events.

Got to EVENTS in the side-bar/menu on the left of GA4, then “All events”.

You can then mark existing events as conversions:

Data Studio – Quick Tips (Advanced)

Speed Up Data Studio Reports (Significantly) – Extract Data

To speed up your reports – you can “Extract Data” and cache it.

It can help to have 2 copies of the report up – so you can see which metrics and dimensions you need to select when adding the data to extract and cache (also a good idea to test the extract data method on a copy of the report in case you faff anything up)

Go to “Add Data” in the top menu-bar

  • Click on “Extract Data”
  • Choose the data you need – eg Google Analytics
  • Add the dimensions and metrics you need for the report
  • On the Right hand side – click to turn “Auto Update” on
  • Select “daily”
  • Click “Save and Extract”

Sometimes you have to faff around a bit with the dimensions – Google Analytics doesn’t seem to like caching a dimension, but still goes super-quick if you cache the metrics only.

Edit in Bulk

If you want to edit all of the charts or tables on the page, in “Edit” mode, right click – go to “Select” and then choose “Tables on page” or whatever type of chart, scorecard or table you’ve selected.

This works instead of CTRL clicking or SHIFT clicking – but you can only change charts or visualisations of the same type at the same time. You can change the style, add a comparison date range etc.

Brand Colour Theme in Data Studio

Click on “Them and Layout” at the top of the screen and then, near the bottom right click “Extract Theme from Image” – you can then upload your logo and choose a theme with your brand colours.

If your shite at presentation like me, this is helpful.

Copy & Paste Styles

In Data Studio – If you want to copy a style from a chart or table, right click it, then choose “copy”

Click another chart/table and the right click – Paste Special – Paste Style Only

Add Chart Filters to an Entire Report

If you want to add a filter to all the data in a report, then it can be a pain going through the charts individually.

Right click on a blank part of the page –

  • Click “Current Page Settings”
  • On the right hand side – click “Create a Filter”
  • Choose or create a filter to apply to all the page

To add a filter to multiple pages

  • Right click on a blank part of the page
  • click “Report Settings”
  • click “Add a filter” in the right side-menu

Add Elements to All Pages of a Report in Data Studio

If you want to add a header and date range selector, for example, to all the pages in the report – add the elements to a page, then right click on the element – and choose “Make report-level”

Quickly Align Elements in Data Studio

Click and drag to select all the elements

Right click – choose “align” – “middle” to get everything inline horizontally

To get an equal space between all the elements, so they’re spaced evenly:

– click and drag to select the elements

– right click – select “Distribute”

– “horizontally” to space evenly across the page, or “vertically” to distribute evenly in a vertical manner.

You can also tidy up individual tables to align the columns vertically – right click and select “”Fit to data”

See our Data Studio Fields & Filters blog post – https://businessdaduk.com/2021/12/15/data-studio-fields-filters-notes/

Data Studio – Data Blending

Bit of a ball ache to work out

There are a few ways to blend data, here’s my fave:

  • Go to “Resources” in the main menu at the top
  • Click “manage blended data” option
  • Click “Add a Data View”
  • Choose a Data Source e.g. Search Console
  • Then “Add a Table” and include another data Source for blending – e.g. GA
    or click “blend data” on an existing table or chart – and select another data source
  • Choose a common “key” to both data sources e.g. “Date”
  • Choose the metrics you want from each Data Source – I wanted to get daily revenue into my search console reports:

Using the blended data above, I can now add Revenue from Google Analytics to my search console reports. I have to remember however, that the revenue is simply attributed to each day and not any queries

**Update to the screenshot –

add a table filter to get organic only revenue from GA.

To be able to filter Revenue to organic only – you need to add a “Dimension” to the table on the right – click the “+” next to “Add dimension” in the GA data and then “Default Channel Grouping” – you can then create a filter in the report:

Blending Search Console Data in Data Studio

Another common reason to blend data – is to get average position data from Search Console “Site Impression reports, added to “URL Impression” data:

URL impression vs site impression

Incidentally –

the main difference between Data Studio Search Console URL Impression Vs Site Impression data – is that Site Impression contains the Average Position metric and URL Impression contains the Landing Page metric. So when you’re blending the data from both sources, make sure you have “Landing Page” as a metric and “Average Position”.

Data Studio Fields & Filters – Notes

Once you’ve created a field – add it to your chart as a Dimension

Mixed Case URLs

Having a mix of URL cases in the letters can faff with your data as D.S. might think each capitalisation variation is a new URL:

  • Click on the Data Tab to the right – then “Create new field” or “Add a Field”
  • Name the field “Lower Source” type in “LOWER(“
  • Then add “Source” from “Available Fields” to the left
  • Click “Save” and add “Lower Source” to the table as a Dimension

Concatenate Data

  • Create or “Add a Field”
  • In the Formula box type “CONCAT” and then select the fields you want to use
  • Close the formula with the final “)” and save it

Internal Site Searches – Extract Search Query

Make the data look nicer and get the search term on its own in the table.

  • Select to a “Add a Field”
  • Use REGEXP_EXTRACT formula to pull out the search terms and get rid of “/search?q”
  • Use the REGEX shown below:

Search Queries – Pull Out Questions – What, Why, When?

  • Create / Add a New Field
  • Add REGEX as shown below and save
  • Add New Field as a Dimension to the table
  • Create a table/data Filter so that you include only table rows that equate to “True” in the new dimension/column

CASE Formulas in Data Studio

CASE formulas are basically “If this, then do that” formulas

When X happens, Then do Y

You can use the CASE Formula to classify and group channels together

For example:

WHEN query matches “who”, then display text “Who?” in the table

  • In the Formula – you need a “catch all” default for when nothing is true in the criteria
  • If the search doesn’t contain “who, what, why” etc. then:
    ELSE “others”

    So if the search term, doesn’t match any of the REGEX criteria – classify it as “others”
– Save the CASE statement
  • Add the new field – to the table or report

Date Ranges & Filter Controls

Taken me ages to work this out – I’ve only just twigged:

You can add Comparisons, Search Boxes, Drop Down Menus and all sorts to your Data Studio Reports

For controls and filters to work – you need the chart or table to have “Default Date Range” set to “Auto”

See my post about REGEX for SEO here.

Ta

If you want a pre-made Data Studio template, you can send me some money and hope for the best.

Online Marketing for New Businesses

Started a business?

Got a website?

Okay, now you need to look at building your brand and getting traffic and engagement on your website and social media accounts.

Website Checklist

  • Trust signals – include membership badges, university logos prominently
  • Humanize the site – include images and videos of people who work for the business
  • Social Proof – include reviews and testimonials. TrustPilot and video testimonials work well
  • Site Speed – make sure the site is quick and works perfectly on mobile devices
  • EAT – Expertise Authority & Trust – show your credentials on the about us page
  • Contact Form – Make it as easy as possible to be contacted
  • Trust & Transparency – Include full contact info if possible – address, tel number, email
  • Have you got Google Analytics & Search Console installed?

You will also need to think about the colour scheme and imagery.

Think about what mood you want to portray

https://www.bedtracks.com/blog/2017/6/15/how-to-coordinate-music-with-the-colour-in-your-video

  • Strong Call To Action

You will probably want a “Call to Action” or “CTA” button, such as “Buy Now”, “Learn More” or “Contact Us”

This CTA button is generally placed “above the fold” on most pages, so that people don’t have to scroll down or look for a way to get in touch or buy from you.

“Join Free for a Month” – is the CTA on Netflix’s homepage (at the time of writing)

For more expensive, high end or though-out purchases such as – buying a car or contacting a therapist, sometimes it’s better to have the CTA below the fold. The best thing to do is test it, with Google Optimize.

For more information about “Conversion Rate Opimization” (CRO), see this article:

https://blog.hubspot.com/marketing/conversion-rate-optimization-guide

For a full SEO (Search Engine Optimization) checklist for your website – to help get visibility on Google – see this article – https://backlinko.com/seo-checklist

Google My Business

Register your website and your office with Google My Business

You can go through the steps here:

https://www.google.com/intl/en_uk/business/

Google will send out a postcard to your office (or home) address

The postcard has a code – so you can confirm you are at that address

Local Directories

Register your business with high quality, local directories such as

  • Bing Places
  • Yelp
  • Yell
  • Free Index
  • Open Di

Try and get on any local government directories too.

Social Media & Captioned Videos

If relevant, register your business on:

  • Linkedin
  • Facebook
  • Instagram
  • TikTok


    Arguably the best way to get noticed on social media at the moment, is to create videos with captions – so they can be watched on mute.

Linkedin is said to have the greatest organic reach at the moment too – meaning you can get your video, image or text-post in front of more people, without paying for ads.

Social media sites like people posting videos too – because they drive a high rate of engagement and keep people on the site for longer.

  • Do NOT post to YouTube and then post a link on social media

Instead – upload your video direct to the platform.

Social media sites will tend to kill your reach if you post a link – they don’t want people to click and leave their website

YouTube is also showing on more and more Search Results Pages on Google.

Consider creating a YouTube channel with lots of informative, helpful and entertaining content. You can then edit the videos and post to specific social media platforms.

Jab, Jab, Jab – Right Hook

General principle of content and social media marketing by Gary V.

Identify your target market

Identify their issues and pain points

Post helpful content related to their pain points and problems

Do NOT constantly promote your business – slip in the odd “Right Hook”, every 3 or 4 posts

People do not want to be sold to constantly, they want helpful, insightful and funny content.

For example.

If you target market is small business owners, take a look on Quora and Reddit and see what people are talking about. If a common theme is Facebook advertising for example, make some helpful videos and blog posts about Facebook marketing.

SEO, PPC and More

The above is just a foundation.

If you have the time and resources, you will ideally produce lots of insightful blog content, earn lots of inbound links and work your way to the top of Google.

You will also want to consider “PPC” – Pay Per Click ads on Google, Facebook and Linkedin.

One beginner mistake to avoid with ads – is sending people to your homepage.

Have a specific “landing page” for each advertising campaign.

oh – make sure you have a good looking logo too. You can use Canva or hire someone on PeoplePerHour.com

A good place to start with SEO is to check your website using an On-Page SEO Checklist.

Videos are great for social media, and YouTube is also starting to show more and more often in the Google results. I would personally have a good go at gaining an online presence using videos and social media – particularly Linkedin at the moment.

Build a Brand

Here’s a good article that some hero wrote about building your brand as a small business

  • Nail down your USP
  • Identify other propositions “why use me/us and not the competitor?”
  • Write down your brand story
  • Use high quality photography & videography (avoid stock pictures)

Consider making customer support a key element of your brand – this can help with online reviews too. Pre-purchase, purchase and post-purchase consumer stages are all opportunities to impress and help.

Emotional Intelligence for Beginners

Emotional intelligence is the ability to perceive and control emotions, without impulsively acting upon them.

I also think of “emotional intelligence” as the ability to detach from the ego and your immediate, impulsive responses and choose a logical, kind or practical way to act:

The Terminator – choosing a reply. Height of E.Q.

Opinions & Emotional Intelligence

  • When something or someone contradicts a pre-conceived belief – your body kicks out a stress response with cortisol and adrenaline

  • When you force your opinion on someone, your body gives you a ‘dopamine reward’

If you take nothing else away from this post, please read those two bullet points above again!

Be aware of the stress response next time you get into a debate

For example, if you have any elderly parents or grandparents (just as an example from my own experience), who have always been told that being homosexual is “wrong”, they’ll usually complain or just be unable to watch the gay couples in Strictly Come Dancing.

If you question why they have a problem, they’ll rarely come up with a logical answer. They’ve been taught that being gay is wrong, so they’re body is producing stress hormones – which makes them feel pissed off for no logical reason.

If you don’t like someone or something, and you can’t explain why, chances are you’re being a dick!

This stress response can be heightened if your opinion is tied to your identity, or your group identity.

For example, if someone is a devout Tory, they’ll use “motivated reasoning” and any possible confirmation bias possible to defend Boris.

More info here – https://www.psychologytoday.com/gb/blog/how-risky-is-it-really/201007/why-changing-somebody-s-mind-or-yours-is-hard-do

This physiological reaction can also be roused when a global belief is threatened – for example, that the world is safe or ethical.

Tell people for example, that Nazi scientists were responsible for putting the first man on the moon and you may get some funny looks or reactions.

Inconvenient truths or questions can be another one. Tell people that lead water pipes are still around in the UK or that there’s a decent amount of evidence that fluoride in water is bad for the brain and nervous system – and there’s a decent chance people will get angry or ridicule you.

Recent study on fluoride here – https://bmcpublichealth.biomedcentral.com/articles/10.1186/s12889-020-09765-4

You sometimes see a similar reaction when someone lower down in a hierarchy, be it an official one or a unwritten one, makes a suggest to someone higher up- its often met with a kind of frustrated dismissal.

Confirmation Bias

More of a logical fallacy – but it also crosses over into emotional intelligence.
People will for example, decide to behave in a certain way, and then later justify it by ignoring any information that contradicts theirbehaviour, whilst cherry picking any information that supports it.

For example – although I appreciate there’s now definitely a valid argument to ignore lockdown rules, people who choose to ignore lockdown in 2020, justified it because Sweden didn’t have one.

People who wanted to adhere to lockdown on the other hand – would point to the terrible situation that happened in Italy, and India.

Who is right – is up for debate I guess.

got kind of weird when my left wing mates started sharing Daily Mail articles though.

Confabulation

We’re all in different movies!

Confabulation is the creation of false memories, without intending to deceive or lie. Subconsciously, people’s egos or minds will create a false account of an event, that makes them look more favourable.

Being aware that you’ll do this on a subconscious level – can make you more conscious of bull sh!tting and making stuff up. Sometimes it’s like people are in different realities – if the event was on TV – they’d be completely different movies or TV shows!

You see a similar skewing of reality in real-time too. Arrogant people will skew reality to make out others are stupid or are at fault.

What Your Criticise Represents Your Own Insecurities

Similar to the stress response created when a pre-existing belief is threatened, if your own lifestyle choice is contradicted by someone, that can also create a stress response.

For example, I always get ear ache around Christmas for sticking to a strict diet (I’ve got IBD).

Sticking to a strict diet, makes other people feel bad about eating unhealthy food, and to compensate they’ll often mock or ridicule me.

In a similar fashion, I’ve been called obsessed with myself and all sorts, by people who don’t exercise, because I used to go to the gym in work every lunch time. (sorry, this section is turning into a bit of a personal vent/rant, ironically).

Being aware of this phenomenon, can help you to acknowledge your stress response to a threat, without acting upon it

Meditation is said to be one of the best way to build emotional intelligence. If you can learn to observe and detach from your thoughts, then you can choose not to act on them.

There are some good books that can help to, such as the Chimp Paradox or Dan Harris’ book – 10% Happier. If I remember rightly, he originally wanted to call the book – “The Voice in my head is an Ass Hole”.

The Wisest Man Knows how Little he knows

The Dunning Kruger effect – relates to ill informed or incompetent people, thinking they’re great at something and being over confident. Like people who’ve never done MMA thinking they’d be great at it.

don’t be that guy:

Get Content Ideas from Competitor Websites (SEMRush)

Requires:

  • SEMRush
  • A computer
  • The internet

If competitor has articles and blog posts inside a subfolder e.g. “buyers-guides” or “/blog” – make a note of the sub-folder name

  • Add Competitor’s homepage URL in “Search Bar” on SEMRush Homepage
  • Click “Organic Research”
  • Click on the “Positions” tab
  • Click on “Advanced Filter” and add the subfolder name e.g. “blog” as a URL filter
  • Export Results into Excel
  • Create a Pivot Table
  • Use the settings below – you’ll need to change position to “average” instead of “sum of”:
  • Tick the check-box for “URL” at the top
  • Drag search volume, traffic and position into “Values” box at the bottom right
  • Click the little arrow on the right of “Sum of Position” – go to “Value Field Settings” and choose “average”
  • Analyse which articles get the most traffic (approximately) and have most potential

Obvs. the URLs of my competitor have been blacked-out in the image above

If the competitor has all their articles at the root domain level e.g.

https://barbend.com/best-weightlifting-belts/

Just use SEMRush – Organic Research – Positions tab and download and pivot the pages data – no need for advanced filter

  • Once you’ve found the blog posts with the most traffic, you can analyse the “Exact URL” in SEMRush
  • This analysis, should show you the keywords on the page that generate most of the search traffic
  • I personally like to go after KWs with a Keyword Difficulty score of less than 20 for my personal blog and under 30 for my employer’s blog

You can also use Reddit & Quora for Content Ideas

Unsolicited #SEO tip: You can get great ideas for specific content ahead of features like PAAs being generated by using Google site operators with specific sites. For instance, I can use the command:

site:reddit[dot]com/r/amateur_boxing “how do i”

To search just the amateur boxing subreddit for questions starting with “how do I?” You can apply this on any niche or on other sites like Quora to get up to the minute questions people are asking.

https://www.linkedin.com/posts/markseo_seo-activity-6902220002146275329-MNVS/

How to Create a Topic Cluster for SEO

Using Ahrefs with Wikipedia

  • Find the most relevant Wikipedia page, for example:

https://en.wikipedia.org/wiki/Association_football

  • Add the Wikipedia URL and click “submit”
  • Click “Copy to Clipboard”
  • Paste all the keywords/topics into a Google Sheet and remove any that aren’t relevant
  • In Ahrefs (or a similar tool like SEMRush’s KW Manager) – go to KW explorer
  • Paste in the keywords/topics
  • In Ahrefs – click “matching terms” then “Questions”

Using SEMRush with UGC

  • Copy the homepage URL of a UGC* website such as Pinterest or Quora
  • Put the URL in the main “search bar” in SEMRush
  • Go to “Organic Research” using the sidebar
  • Click “Positions”
  • Add a Keyword to the “Filter by Keyword” search box
  • Click a relevant Keyword in the table of results
  • Under “Questions” click “View all….”
  • Go back and click other relevant keywords
  • Click the “Questions” tab again – make a note or download all the relevant questions
  • Organise KWs and questions into main pillar posts and “cluster content”

See Hubspot’s article about Pillar Pages and Cluster Content – here

*UGC – User Generated Content