Showing posts with label Grader. Show all posts
Showing posts with label Grader. Show all posts

Tuesday, April 28, 2009

Twitter Revisited: Shark Jumping, Apps and Metrics Podcast

On Sunday, Mike Qaissaunee and I recorded a 36 minute and 40 second podcast onTwitter applications, shark jumping and metrics.

Listen to it directly in your web browser by clicking here.

If you have iTunes installed you can subscribe to our podcasts by clicking here.

Here's the intro and list of questions asked during the podcast:

Intro: Twitter has become a household word for many of us - just like Google , YouTube , MySpace and Facebook (among others) have in the past. Chris Brogan (in this video) even calls Twitter his "central nervous system". We first podcast on Twitter almost two years ago. In this podcast we take an updated look at Twitter.

Two years is a long time ago it seems. Probably one of the biggest things in my arsenal is my iPhone today. Two years ago the iPhone did not exist. What's changed in two years with Twitter?

What are some of your favorite apps?

What's up with all this Twitter following - how should we be handling?

I've been hearing the term "jump the shark" recently when some discuss Twitter. What does that mean?


I notice a lot of business people using Twitter, maybe it has jumped the shark. What are they doing? How are business people using it?

So, lots of people seem to be giving Twitter a try but how do we know who has actually drank the kool-aid and has become a daily Twitter user?

Before we talk about numbers, The Influential Marketing Blog has put together something called the 5 stages of Twitter Acceptance.

We talk a lot about impact when it comes to grants - can you explain what that means?

So, what's the interest in things like Twitter?

What are some Twitter measurement tools?

We've come across a couple of tools that attempt to measureTwitter - a web-based application called Twitter Grader and another called Twinfluence .

Twitter Grader is interesting but there is not a lot of detail. Can you discuss Twinfluence?

Didn't Twinfluence at one time try to measure efficiency?

So, Twinfluence attempts to measure more things. How does it compare to Twitter Grader?

What about spam?

So, what did this guy do?

How do metrics applications handle these spammers?

What can be done to prevent Twitter manipulation?

Are there any other Twitter based applications we should be looking at?

We should see applications like these improve?

So, has Twitter jumped the shark yet?

Here's how you can get the answers:

To read show notes and listen to Mike Q and my 36 minute and 40 second podcast titled Twitter Revisited: Shark Jumping, Apps and Metrics, click here .

Sunday, March 15, 2009

Twitter-Metrics

Twitter has become a household word for many of us - just like Google , YouTube , MySpace and Facebook (among others) have in the past. Lately I've noticed lots of people following my Twitter feed and I've been careful to follow back unless the feed looks like it's been robot-generated, is pornographic, etc. The result is - I follow lots of people and they follow me back..... keep it real and keep it clean and I will follow. Post something inappropriate and no more follow for you!

Part of our NSF Center work is to determine impact - if we create something, produce something or post/share something we look for answers to questions like:

- How many people looked at it?
- How many people used it?
- If they used it how did they use it?
etc....

For example, let's say Mike Q posts a series of classroom ready presentations on wireless security on the web. We'll look for answers to questions like how the curriculum materials are being used, modified, and adapted to individual classrooms, and how the teaching and learning methods are impacting faculty and students. This level of measurement usually comes from observations, interviews, and focus groups all looking at the changes in the actions and activities of instructors, students, and ultimately workforce and industry. The term we commonly use when referring to these kinds of measurements is metrics .

I'm particularly interested in Twitter because it has the potential to have tremendous impact without some of the tedious one-on-one type of measurement a lot of us are doing now. I've come across a couple of tools that attempt to do some Twitter measuring - a web-based application called Twitter Grader and another called Twinfluence . Let's take a look at both.

Twitter Grader

Twitter Grader ranks Twitters on a percentage scale - looking at the screen shot below (Click it to enlarge) you can see I'm currently ranked at 99.7%.


This ranking, according to Simon Salt, is based on the number of followers you have, the power of this network of followers, the pace of your updates, the completeness of your profile and “a few other factors.

Twinfluence
Twinfluence goes a little deeper than Twitter Grader , and according to their website, attempts to measure the following:

First and Second Order Networks: From the perspective of graph theory, a Twitterer's followers would be considered their first-order network, and their "followers count" the same as their "degree". "Degree" is a simple form of centrality measurement that equates to "prestige" or "popularitiy"; different types of centrality can measure connectivity, authority, and control in a network.

Reach: Reach is the number of followers a Twitterer has (first-order followers), plus all of their followers (second-order followers). This is by necessity a crude maximum estimate, since there will definitely be duplicates and overlaps that could only be eliminated by up to thousands of API calls. Reach is a measurement of potential audience and listeners, a best estimate of the number of people that a given Twitterer could quickly get a message to.

Velocity: Velocity merely averages the number of first- and second-order followers attracted per day since the Twitterer first established their account. The larger the number is, the faster that Twitterer has accumulated their influence. Of course, this number could jump significantly with the addition of a few high-profile followers. Velocity is scored from "very slow" to "very fast" relative to other twitterers at your network size.

Social Capital: Indicates the average first-order network of a Twitterer's followers. It's essentially a measure of how influential are a twitterer's followers. A high value indicates that most of that Twitterer's followers have a lot of followers themselves. Social Capital is scored from "very low" to "very high" relative to other twitterers at your network size.

Centralization: This is a measure of how much a Twitterer's influence (reach) is invested in a small number of followers. Centralization scores range from 0% (completely decentralized) to
a theoretical 100% (completely dependent on one Twitterer). In social network analysis, a high centralization indicates dependency of the network on just a few nodes to maintain the connectivity of the entire network. Twitterers with low centrality networks would not have their reach greatly reduced if a few high-profile people stopped following them. Centralization is scored from "very fragile" to "very resilient" relative to other twitterers at your network size, implying that a network with only a few high-profile followers is very sensitive to collapsing if those followers leave. Conversely, a network with low centralization is not very dependent upon any few followers for its collective reach.

At one time Twinfluence was attempting to measure efficiency. After discussions with some other social media experts, they decided that the idea of twitter efficiency is an interesting one, but there really isn't any way to effectively measure behavior in the context of how a twitterer actually keeps on top of their tweetstream.

So.... using Twinfluence , what kind of impact do my tweets have using their metrics? Here's another clickable screen shot (note - Twininfluence appears to lag in updates so it is not seeing the same number of follows as Twitter Grader):

Twinfluence ranks me around 98% (similar to Twitter Grader ) with 2,315 followers and 6,556,780 second order followers. I'm not sure how significant the numbers are but...... if I can post something and have it potentially reach even one-tenth of a percent (6,500) of those 6.5 million second order users I'm really liking that possible/potential impact!

I'm hoping applications like Twitter Grader and Twinfluence continue to improve and provide additional and more detailed metrics. This is good stuff.