Block referrer spam

If you use Google Analytics to track the performance of your website (and you definitely should!), you may have noticed something strange going on in your traffic reports of late. Does this look familiar to you?

Referral spam

If you've seen URLs like buttons-for-your-website.com and 100dollars-seo.com in the 'Referrals' section of your Analytics account, then you - like countless others - are a victim of referral spam. This is when spammers send phony visits to your site so that their name will appear in your Analytics reports.

Hold on - why are people doing this?

For the spammers behind buttons-for-your-website.com and the like, fraudulently appearing in somebody else's Analytics report is like a very unorthodox kind of advertising.

Allow us to explain. When your website gets referrals from a site you don't recognise, your first course of action will probably be to check out that site and find out why you're receiving traffic from them - for all you know, somebody has written a blog post about you or reviewed one of your products. So you type buttons-for-your-website.com into your browser's address bar and press enter...

...and that's how they get you. As soon as you visit your new referrer's website, their shady marketing tactic has worked and they've won. Bear in mind that these spammers have most likely been targeting many thousands of websites; your one inquisitive visit may not seem like much, but multiply it by a hundred thousand and you may begin to see what these people stand to gain by inserting themselves into other people's Analytics data.

The end goal of all this varies depending on which spammer you've been hit by; some want you to sign up for their SEO service or install their button on your blog, whilst others simply get money for every hit their website receives.

Is this a problem?

At first, you may not see much reason to do anything about these referral spammers, but the more they do it, the more your Analytics data will become skewed and inaccurate. For example, Analytics might tell you that you received 3,000 visits last month - a new record for your site - but, upon closer inspection, you'll realise that roughly a third of those visits came from spammers instead of real people.

In short, referral spam makes Google Analytics much harder to use properly, and if you want to get a truthful impression of how well your site is performing, we strongly recommend that you take action.

So how do I block referrer spam?

We're glad you asked. Broadly speaking, there are two types of referral spam: bot referrals and ghost referrals. In this blog post, we'll tell you how to tackle 'em both.

Part 1 - Terminating Your Bots

Some spammers use bots to invade our Analytics accounts, setting up programmes that automatically visit people's websites over and over again. Since Google Analytics can't differentiate between a legitimate session and an automated one, these visits will be counted alongside all of your real customers, and after a while they'll really start to pile up.

Here's how to block bot referrals and put an end to your own personal robot uprising:
  • Log into your Google Analytics account and click on the Admin tab at the top of the page.

  • In the right-hand column, select your preferred View and click Filters. Then, on the next page, click + NEW FILTER.

  • Select Create new Filter and give your filter a sensible name, like this:
Death to spam
  • Under Filter Type, click Custom. Then, click Exclude and, from the drop-down menu, select Campaign Source.

  • In the box marked Filter Pattern, type the name of the website(s) whose referrals you wish to block. If you are blocking multiple referrers, separate each website name with a | rather than a space. You should end up with something like this:
buttons-for-your-website.com|100dollars-seo.com|www.event-tracking.com
  • Click Save to apply your filter and lock the specified websites out of your Analytics reports. Note that you may need to add more websites to the Filter Pattern field further down the line - if so, just add a | to the end of your original list and add the new sites as above.

Part 2 - Exorcising Your Ghosts

Ghost referrals are tricky. These spammers never actually land on your website (not even via an automated bot, like the spammers covered in Part 1); instead, they send information straight to Analytics saying that they've been on your pages.

Fortunately, there is a way to stop them. Here's our step-by-step guide to busting ghost referrals and restoring peace to your Google Analytics reports:

  • On your Google Analytics reporting screen, set the date range to show the past year's worth of data.

  • On the left-hand side of the screen, click Audience > Technology > Network. Then, just underneath the main line graph, you'll have the option to set a Primary Dimension - set this to Hostname instead of Service Provider.

  • You will now be shown a list of hostnames that have used your website's tracking ID in the past year. Your main site URL will (hopefully) be the most prominent, but you'll probably see a bunch of others that aren't so familiar:
Hostnames
  • Make a note of all valid hostnames on this list. This will include your domain name, but it may include other sources too - if you have pages on the domain/server in question, it's probably a legitimate source of Analytics data. In the list above, www.henstuff.co.uk (main website) and freedapromotions.us2.list-manage.com (mailing service) are valid hostnames; the others are spam referrers.
IMPORTANT! You may find that google.com and other seemingly reputable names like mozilla.org and firefox.com appear as hostnames in your Google Analytics report. However, since you probably don't have any pages on the Google servers themselves, this traffic is almost certainly spam. Some spammers fake a 'google.com' hostname to appear legitimate and escape the attention of site owners like you. Don't be fooled - ignore these hostnames!
  • Once you've made a list of all valid hostnames, click the Admin tab at the top of the screen. Then, go the right-hand column, select your preferred View, and click Filters.

  • Click the + NEW FILTER button; then, on the next page, select Create new Filter and give your filter a sensible name, like this:
Ghostbusters reference
  • Under Filter Type, select Custom; then, set the filter to Include > Hostname.

  • In the Filter Pattern box, type each of the valid hostnames you noted down earlier. Again, use the | vertical bar to separate hostnames instead of spaces. Your filter pattern should look like this:
www.henstuff.co.uk|freedapromotions.us2.list-manage.com
  • Click Save to finalise the new filter and block all traffic that isn't using a legitimate hostname.
One final tip: after you've applied the filters described above, it's a good idea to create a new View in Google Analytics (without any filters). This will allow you to compare your filtered, spam-free traffic with Google's raw data and spot any genuine traffic sources you've accidentally blocked.

Need more help managing your Analytics account? Get in touch with Designer Websites now.

Is SEO Dead?

We've seen a lot of articles in the last few months with titles like this:

"Yes, SEO Really is Dead!"

"Stop Doing SEO - It Doesn't Work Anymore"

"SEO is over. Here's the new way to get your site seen!"

Invariably, these pieces will talk about the supposed demise of search engine optimisation as a worthwhile practice. They use the following arguments to convince readers that SEO is, indeed, a thing of the past:

  • Link-building doesn't work anymore. Seeking out links from external websites used to be a huge part of SEO, but inbound links are no longer an automatic guarantee of high rankings - these days, quality is far more important than quantity, and it can be very difficult to manufacture a really good link to your own site. Also, Google are getting much better at spotting unnatural and/or manipulative links and punishing the sites on the receiving end; this has put an end to linkbuilding as an effective means of boosting rankings, or so some bloggers would have you believe.

  • Keywords are more complicated than ever before. Once upon a time, you could achieve high rankings for a search term like 'cheap sofas' by simply mentioning 'cheap sofas' a hundred times in your site copy. Nowadays, the system is a lot more complex - search engines are aware of things like synonyms, closely related topics, and a whole variety of other ranking factors that don't have anything to do with keyword density. Also, Google and their competitors have learned to spot keyword-stuffed content from a mile away, and the penalties for this can be just as severe as the slap you'll get for dodgy link-building.

  • Sites should be optimised for users, not search engine bots. The problem with a lot of old SEO practices (particularly keyword stuffing) was their tendency to make things unpleasant for the user. You can write a 500 word essay that uses the phrase 'best mobile phones' in every other sentence if you so desire, but even if it ranks highly, it's not going to make especially riveting reading; in fact, all of that keyword stuffing might well make it harder for your customers to find the information they need. Nowadays, a good user experience is valued above high rankings, and since aggressive SEOing can quite easily get in the way of a strong UE, those practices no longer have a place on most websites.

Now, these are some good points - keyword stuffing and link farming do more harm than good, and we would certainly advise any webmaster to stay well away from these practices if they value their site traffic. But SEO isn't just the black hat stuff; those three letters may have picked up some negative connotations over the years, but search engine optimisation is still alive and well, and if you want your website to have any kind of presence on Google, Yahoo! and Bing, you absolutely must take it into consideration.

First of all, you need to stop viewing SEO as a shady effort to fraudulently boost a site's rankings. SEO is actually a very important part of website design, and it starts with the code itself - our developers have spent the last decade building sites in a way that's easy for Google and other search engines to digest. We also work hard to create lightning-fast pages, user-friendly functionality, and so much more; all of this is as much a part of SEO as strategic keyword placement.

But we won't bore you with an in-depth dissection of good quality code. Instead, allow us to address the points above, and demonstrate why SEO remains very much alive:

  • Links are still important. Building a lot of low-quality links to your site is unlikely to do much for your rankings nowadays, but remember what we said about quality and quantity? That's an important thing to bear in mind - Google themselves have stated that inbound links are still a major part of their algorithm, it's just that they're now more interested in the value of your links than in how many you've amassed. Of course, since artificial links can land a site in very hot water, it's better to focus your SEO efforts on creating a site that encourages people to link unsolicited - make it easy to link, and make sure you provide something that's worth linking to. This is what really impresses search engines at the moment.

  • Keywords still have their place. Modern SEO demands a rather less ham-fisted approach to keyword placement, but that doesn't mean you should forget about keywords altogether. When creating your website, think about the search terms you would like each page to show up for, and then tailor your copy and any other content to those keywords. Make sure you're providing potential users with the clear information and the useful resources that they are likely to be looking for, and this will make each page's purpose clear to search engines as well.

  • User optimisation and SEO are, in many ways, the same thing. User optimisation makes your site more appealing to humans. Search engine optimisation makes your site more appealing to search engines. These two practices are very closely related, especially as search engines get smarter and more capable of thinking like humans. The articles we've read always tell you to forget about SEO and concentrate on the user experience, but this is misleading - they are two equally important undertakings that will yield sizeable rewards if done properly in tandem.

To answer that million dollar question, then: no, SEO isn't dead, it's just different to what it was a few years ago. Mind you, this shouldn't surprise anyone (least of all the type of people who are liable to write 'SEO is Dead!' aritcles) - SEO has been an ever-changing entity since day one, but none of its transformations have ever negated its usefulness as a practice. In fact, as web designers, optimising for search engines is one of our most important jobs!

 

We have just launched a fantastic new ecommerce website called Gadget Inspector and this has been one very distracting site to build! As nerds you can probably appreciate that we love gadgets and gizmos, so we've probably spent as much time admiring the gadgets and toys on this site as we have building it. We have an office full of rc helicopters and iPhone toys.. well, we simply had to test these gadgets!

I know these guys are only just building their online catalogue but I think they'll be the next big gadget site on the Internet.

Many companies believe that a choice must be made between usability and website SEO, with many people believing that one element has to be sacrificed for the sake of the other. Needless to say the goals of website SEO and usability are polarised, but that doesn’t mean they have to be mutually exclusive. With keen eye for functionality an experienced website developer will bring to the table, it is simple to produce a website that satisfies customers and search engines alike.


In days gone by pages produced for the purpose of website SEO were filled with text that contained a high density of keywords which often made the copy a little disjointed. Website SEO has changed drastically over the years, and now, with the assistance of a professional SEO copywriter it is possible to merge keywords with punchy text that attracts rather than deters your customer base.


So what elements should you consider when balancing usability with website SEO?

 

  • Title tags and headings – this is one of the most important factors to get right to strike the perfect balance between SEO and usability. The title tag plays an integral part in website SEO, but it is also the first thing a user is going to see, so it has to be readable and explain accurately what the page will do. A good title tag should focus on only one to two keywords, and still make sense to readers. Every page of your website should have a different title tag.

 

  • Usability testing – this plays an integral part in determining the user experience and how simple it is to navigate your site. Any findings which illustrate the poor usability of your site should be addressed immediately, even above website SEO considerations. If the usability of your site falls below the mark, the amount of traffic SEO helps you to attract will be for irrelevant, as poor usability will quickly lead visitors to look elsewhere.

 

  • Keyword use – keywords should be used in the right places in the meta data as well as throughout the body copy of your page. However, don’t be tempted to indulge in keyword spamming as this not only effects usability, it is also likely to be detrimentally to website SEO as the search engines will regard the page as ‘spam’, which will hinder your rankings for the targeted keywords. Anything around 3% is the sort of keyword density you should be looking to achieve.


This is only a brief insight into the intricate balancing act between website SEO and usability, with many other factors also playing a part. For further information about usability and website SEO, please call the experienced website developers here at Designer Websites on 0845 272 6813

We have recently finished a redesign for the TimberTech website. We have worked with TimberTech for a number of years and they recently asked us to design a totally new look for their composite decking website, which we of course were happy to do.

When we completed the design concepts for the new website TimberTech were absolutely delighted with our proposed layout/design. Based on these new concepts we developed a new, more modern, more responsive website, which also contains some clever tracking functionality and a very good level of search engine optimisation.

Take a look at TimberTech - Composite Decking Website and see what you think.