Below is live coverage of the Making Data From Google Webmaster Central & Bing Webmaster Tools Actionable panel from the SMX West 2012 conference. This coverage is provided by Avi Wilensky of Promedia Corp.
Disclaimer: The coverage is brought to you in real time, using a custom live blogging tool. Feel free to ask questions or leave comments for inclusion into the live coverage. During the live event, live notes will auto-scroll with newest entries at top. After the session is complete the archive version will have the oldest entries at the top. We ask you to please excuse any typos, as these are live notes.
Finished
Auto-Refresh: Off
Avi Wilensky:
3:32:31 pm
Technical SEO Track
Making Data From Google Webmaster Central & Bing Webmaster Tools Actionable (#smx #24C)
The search engines make more and more data available all of the time, but how can you determine priority and impact to use that information to influence your overall marketing and technical development roadmap? Learn what the data really mean and how can you use it to your advantage.
Moderator: Vanessa Fox, Contributing Editor, Search Engine Land (@vanessafox)
Q&A Moderator: Jeff Ferguson, CEO, Fang Digital Marketing (@fangdigital)
Speakers:
Duane Forrester, Sr. Product Manager, Bing (@DuaneForrester)
Vanessa Fox, Contributing Editor, Search Engine Land (@vanessafox)
Neil Walker, CTO, Just Search Ltd (@theukseo)
Avi Wilensky:
3:32:57 pm
Talk about where the data comes from and what it means.
Avi Wilensky:
3:34:41 pm
Categorization of XML sitemaps. Based on type of page, by topic.
Avi Wilensky:
3:35:52 pm
Google keeps track of how much a particular sitemap is indexed. Very useful tip.
Avi Wilensky:
3:36:56 pm
Helps identify problems with particular types of pages.
Avi Wilensky:
3:37:35 pm
Also track history of them over time.
Avi Wilensky:
3:38:46 pm
Download the crawl errors and content analysis. Can track spikes and that will alert you.
Avi Wilensky:
3:39:28 pm
Maile: What's the best way to categorize them? Vanessa: Best by template type. Or by topic area.
Avi Wilensky:
3:40:06 pm
Deduping of sitemap urls is done at end. Make sure they are comprehensive and canonicals are proper.
Avi Wilensky:
3:40:32 pm
Autogenerated XML sitemaps typically will submit the non-canonical versions.
Avi Wilensky:
3:41:03 pm
Bing: Recommend also an RSS feed. Keep XML sitemaps fresh and clean and always up to date.
Avi Wilensky:
3:41:35 pm
In analytics, you are not going to see CTR, position, impressions. In GWT you do.
Avi Wilensky:
3:44:47 pm
Look at impressions from a trending perspective.
Avi Wilensky:
3:45:27 pm
Google has updated what they are providing. Can download charts.
Avi Wilensky:
3:46:18 pm
For queries, we don't want to look at each one - we want to look at categories. Can see how well doing over topic area over time.
Avi Wilensky:
3:47:22 pm
Use regex to grab the terms.
Avi Wilensky:
3:48:10 pm
It's a way to make sense of the data, but need to think of it as a trend.
Avi Wilensky:
3:49:09 pm
There is an API but not everything is available. Can download CSVs. New Python script to get the top search queries. Drawback is that date range is last month.
Avi Wilensky:
3:49:56 pm
The API has not been updated in a while. Can only get sitemap data from ones you personally submitted vs. the web interface where you can see others' sitemaps.
Avi Wilensky:
3:50:53 pm
Neil Walker is up next from getupdated.com
Avi Wilensky:
3:51:12 pm
Will talk about his agency use the data to encourage sales.
Avi Wilensky:
3:52:00 pm
Wanted to download all data from all clients and put in big XLS spreadsheet.
Avi Wilensky:
3:52:48 pm
Took an average position, CTR to give guide for how much positions are worth investing in.
Avi Wilensky:
3:53:26 pm
But things change. New blended results, previews, new things in results.
Avi Wilensky:
3:54:22 pm
Compared the data from 2 years ago to now, and shows a dramatically lower CTR for same clients with new position. These SERP pages have an impact.
Avi Wilensky:
3:54:31 pm
So is SEO Dying? No, just evolving.
Avi Wilensky:
3:54:47 pm
Making sure feeds are OK, optimizing for local, reviews, plus, etc.
Avi Wilensky:
3:55:41 pm
Looked at mobile CTR vs. desktop. Top 5 results on mobile are doing better than on desktop.
Avi Wilensky:
3:57:24 pm
Forecasting SEO: How can I predict? For them, it was to show client when to start to expect a return.
Avi Wilensky:
4:01:38 pm
Follow Neil @theukseo
Avi Wilensky:
4:02:31 pm
Vanessa: Again stresses the usefulness of categorization.
Avi Wilensky:
4:03:45 pm
Tip from Vanessa: Personally wouldn't worry about the priority attribute in XML sitemaps
Avi Wilensky:
4:04:09 pm
Duane Forrester from Bing is up.
Avi Wilensky:
4:04:37 pm
Will talk about the newest features announced early yesterday.
Avi Wilensky:
4:05:33 pm
Launched a new keyword research tool. Powered by organic, not paid. Get rich and detailed long tail information.
Avi Wilensky:
4:05:55 pm
Exact match filtering, export data. Updates every 2 weeks. Oldest the data will be.
Avi Wilensky:
4:06:04 pm
Can be as fresh as today. Can look back 6 months.
Avi Wilensky:
4:07:42 pm
The idea of data being actionable.
Avi Wilensky:
4:08:07 pm
There are actions the webmaster needs to do. Need to say it's OK to communicate with you. Malware warnings, etc.
Avi Wilensky:
4:08:32 pm
Also crawl errors, indexing issues, etc.
Avi Wilensky:
4:09:52 pm
Track action: Inside reporting, will show keyword driving traffic. Bring in average CPC data. Helps make decision if to by the phrase.
Avi Wilensky:
4:10:50 pm
Average impression position is critical. As the number gets closer to 1, means Bing trusts you more.
Avi Wilensky:
4:13:21 pm
Bing Webmaster data is now available via API. Hopes it will plug into GA fine. Everything in the tool is in the API with the exception of keyword research tool and messaging. Audience applauds.
Avi Wilensky:
4:13:47 pm
The API is fun, its exciting, its like Xmas every day!
Avi Wilensky:
4:14:25 pm
Index explorer tool shows what's in the index. Upload it, and then export it and will be able to see in the XLS.
Avi Wilensky:
4:14:38 pm
If it's in the index, it will be in index explorer.
Avi Wilensky:
4:15:04 pm
Can query the index directly for a URL to see if its indexed.
Avi Wilensky:
4:15:24 pm
Can insert the content in index, however, some out there might spam us!
Avi Wilensky:
4:16:43 pm
Can submit the URL in the index, but the CTR will determine if it will be able to sustain itself. Limited amount of these submissions permitted per month. 50 per domain.
Avi Wilensky:
4:17:51 pm
Bing wants clean sitemaps! Again! 1%. If 2 out of 100 URLs are not good, we dont trust it.
Avi Wilensky:
4:18:11 pm
RSS is always clean, so its a win win to submit it.
Avi Wilensky:
4:18:59 pm
Control the crawler. Tell Bingbot when to be there, and how hard to crawl. Helps control bandwidth. First reference point for Bingbot.
Avi Wilensky:
4:20:11 pm
Use your webmaster accounts! Helps make decisions, get funding for projects, prioritize.
Avi Wilensky:
4:21:34 pm
If there is a malware warning, may not be on your site. May be from a third party site that you are linking to or partners.
Avi Wilensky:
4:22:11 pm
You can take an object out of the page to test, and resubmit and check if its clean. Will speed up process on their end.
Avi Wilensky:
4:22:23 pm
Thank you Duanne.
Avi Wilensky:
4:26:24 pm
DF: Bing passes link value through 302's.
Avi Wilensky:
4:27:56 pm
Microsoft no longer offers analytics, Vanessa jokes.
Avi Wilensky:
4:29:20 pm
Recommends agencies put all clients under one login.
Avi Wilensky:
4:32:17 pm
Data from within the tools is much more reliable than doing the standard link: etc.
Avi Wilensky:
4:34:09 pm
Maile asks Duanne: What is the logic behind the 1% threshold.
Avi Wilensky:
4:35:34 pm
Duanne: It's a big resource for us, and we want to know that is trustworthy. There are rarely clean sitemaps. What we don't tell people is that there is leeway, work towards it.
Avi Wilensky:
4:36:22 pm
Maile asks a follow up: An error would be a 404 - for Google we don't want to encourage webmasters give the wrong status code. Duane- do not create soft-404's or I will kick your ass!
Avi Wilensky:
4:38:01 pm
Duane: If see 302's for along time, action indications more permanent home.
Avi Wilensky:
4:38:42 pm
307's: Noone knows how they are treated. VF: Most used for geo-serving. Not handled well from personal experience.
Avi Wilensky:
4:40:33 pm
Bing: Last modified valuable, Google: not so much.