Sunday, November 11, 2012

Candidate Romney Won the Battle but Lost the War for Presidential Election News Patterns

News Patterns has been tracking and patterning the news of the 2012 US presidential election for several years. Millions of articles were collected and subjected to our pattern discovery algorithms. A very powerful aspect of our news patterning is that patterns in the news often anticipate or closely correlate to actual voter behaviors. This past Tuesday, all the patterning came down to the actual voting. Here is what we saw and would have recommended to both Romney and Obama campaigns:

1) The 2012 News Radar correctly displayed that the election was about Obama versus Romney, showing both of these news topics as central and anchors in News Radar.


2) Romney campaign succeeded in making the logical topics of Economy and Jobs as central election topics. Nevertheless, the Obama campaign trumped this campaign battle success with its own news topics.

3) The Obama campaign was successful in creating the emotional "war on women" as a central campaign topic.

4) Super storm Sandy gave millions of voters an opportunity to see Obama as the leader in times of need and citizen support.  Governor Chris Christie made this a super topic by reinforcing bipartisan imagery with Obama just before the election.

5) Obama campaign gathered additional support with Education and Fix Washington topics.  Romney campaign contested the Fix Washington topic.

6) Romney used Spending as one of his campaign topics, yet Obama team muted this topic with associations of "do nothing Congress."

7) It was a great surprise to News Patterns analysis team that Romney campaign did not make better use of Fuel Cost and Food Cost topics, both of which were essentially irrelevant on election day.

8) The Health Care-Tax topic, created by the Supreme Court was also not used by the Romney campaign.

9) It is also surprising that Team Romney did not use Security/Arab Spring topics to their advantage.

If there was a meta pattern that points to the Obama success in the 2012 election is was this: the hard facts of Economy and Jobs as targeted by team Romney were trumped by US electorate wanting emotional comfort, including the idea that their choice from 2008 was a good man and leader.  To the undecided, still on the fence in the previous week, the imagery of Obama the leader in time of crisis over Hurricane Sandy swayed them in the direction of Obama.  There was no time for a Romney recovery.  The Romney campaign never built up a reservoir of emotional attraction to Romney the man and leader, nor an emotional distaste for Obama the man and leader.





Monday, July 16, 2012

Past, Present and Anticipated Future of Ultrabooks in Competitive Tablet Ecosystem

According to a Wikipedia reference, Ultrabooks are higher-end types of subnotebooks defined by Intel. As such, these devices are natural competitors for tablet devices, in particular the Apple iPad and various Android and Windows devices. Ultrabook devices have been tracked in the Tablet Ecosystem News Radar since the start of 2012. One of the objectives of news pattern tracking is to determine if a new technology (in this case Ultrabooks) challenges existing competitors and therefore disrupts a marketplace. There is no doubt that Intel and Ultrabook device manufacturers are setting a goal to disrupt the marketplace and to take device market share away from Apple iPads and other tablet devices.   If this disruption occurs, our News Radars will highlight the market interactions and call out relevant articles that chronicle the market changes.

Another objective of News Patterns members is to better anticipate the future.  With a superior real time situational awareness of market/political events, News Patterns members often leverage patterns in the news to discover market trends that can be pushed into the future.  Some of these trends might correlate with actual market measures like sales, shipments, polling or election results. 

The Six Month Past
On January 2, 2012, iPad news patterns exhibited a high degree of competitive relevancy, with the iPad topic plotted very near the center of the Tablet News Radar.  At this same time, the Ultrabook topic was plotted near the periphery of the Tablet News Radar, an indication of low news pattern relevancy.



The Present or One Week Past
Now roll the tapes forward to one week ago, July 9, 2012.  From the following image one can see that Apple iPad continued to be highly relevant in the Tablet News Radar while Ultrabooks continued to be of low relevancy.


I chose the date of July 9, 2012 because it was on this day that Robert Powell of the Wall Street Journal Marketwatch published this article about News Patterns: Mining the news for patterns investors can tap - News Patterns’ data can help investors see relevant trends.  As part of this article, the low relevancy of Ultrabooks in the Tablet News Radar was highlighted. In our algorithm development, we often find strong correlations between news pattern relevancy and actual market/election performance. Better yet, our patterns often anticipate market/election trends, just as Powell described in his article.

Three days after the Powell Marketwatch article, check out this article that correlates/anticipates our patterns with actual market performance: Ultrabooks flop in Q2, PC market implodes as Apple wins in the U.S. (Boy Genius Report) 2012-07-12 08:46   
Market research firm Gartner paints a grim picture of the PC market in the second quarter this year as shipments dropped more than 5% in the United States and stayed flat globally. HP remained the world's top PC vendor worldwide as shipments of HP desktops and laptops slid 12.1% to 13.04 million, and chief U.S. rival Dell dropped 11.5% to ship 9.35 million units. Asian vendors Lenovo, Acer and ASUS each showed growth during the...

The Powell article in conjunction with Boy Genius article created timely data points about News Radar insights, correlating and anticipating radar positions with actual market performances.  (Note, this example is not an absolute about similar market correlations.  No past news patterns can guarantee future market/election correlations.)


The Three Month Future
In spite of the Ultrabook's 2012 history of low Tablet News Radar relevancy, we as News Patterns have made this Pattern Prediction on July 12, 2012:

Pattern Prediction: Intel and Ultrabook topics will double their tablet ecosystem relevancy by end of October 2012 by building strong connections to MMS topic (movies, media, video, streaming.)

Intel has a strategic interest in the tablet/"Ultrabook" ecosystem.  It will play to win.  This pattern prediction is now a human estimate based on the technical and market power of Intel. In the not too distant future, perhaps even this pattern prediction can be algorithmically driven. If this pattern displays itself, the Ultrabook topic will move toward center of the Tablet News Radar, disrupting the pattern position of iPad, Android and Windows tablet devices. Time and radar movements will tell if this pattern comes true. The power is that we can watch for these patterns day by day in a superior situational awareness interface.  I will report over the next several months about the accuracy of this Pattern Prediction.









Wednesday, June 20, 2012

Clash of Tablet Titans Plays Out In Video Game Like Interface of News Patterns

Our News Patterns algorithms take in huge volumes of news and social media to create animated visualizations of competitive situations in business, finance, politics and societal security.  Over time, the most relevant companies, ideas, products, and candidates win and hold a center position in our News Radars.  Patterns in our radar visualizations induce our member/users to interact with our visualizations and to click-through the patterns to discover the actual relevant news articles.


Presently, our patterns are watching the clash of major technology companies in the tablet ecosystem.  The Apple iPad has been the clear news pattern leader, which has directly correlated with Apple's sales and market dominance.  Yet, other technology companies want a piece of the Apple iPad action.   Check out our recent "video game" interface of 10,000 weekly news and blog signals about the tablet ecosystem.  Public Tablet News Radar Link



So far this week...
  • Microsoft introduces its Surface tablet, inducing a disruptive movement toward tablet radar center and iPad. "P"  Microsoft is displayed as Windows above. 
  • Google responds with buzz about its planned Nexus tablet. "S1"
  • Disruptive movement of Windows (as in Microsoft Surface tablet) has a positive effect on Intel and Ultrabook. "S2"
Note, not all introductions are disruptive.  Most fail to gain any competitive relevancy.

Over the next several weeks, competitive patterns will play out, determining whether Microsoft/Windows will sustain its challenge to Apple/iPad, and whether Google Nexus/Android will continue to be the number two competitor to Apple iPad.
     



Sunday, May 27, 2012

The World's First Video Game Interface for News & Social Media Alerts

Always an engineer at heart, I have always been inspired by the addition of useful visual imagery as part of decision support and analysis.  In fact I started my career with Structural Dynamics Research Corporation (SDRC) as a co-op student using advanced dynamic visualization of vibrating structures as part of engineering designs.  SDRC was a leader in what we now call CAD or computer assisted design. Today, in the era of BIG DATA, it is an imperative to integrate visualizations into decisions that cannot be accomplished with text readouts alone.  News Patterns (aka Netro City Design) was founded on this vision of visualizations and decision support.

As our developments in visualizations grew, it became obvious that the CAD metaphor for news insights was insufficient.  For example, CAD solutions do not necessarily take into account the real-time and dynamic nature of changing situations found in competitive news patterns.  A metaphor more dynamic and interactive was required.  And that metaphor was the Video Game.



The logical foundation of detecting news based competitive patterns with a video game interface starts with these simple ideas:
  • Faster- Our brains perceive patterns at 10,000,000 bits/second versus we read at only 200 bits/sec.
  • Superior Insights- Movements can highlight important alerts and emerging trends.
  • Intriguing- Videos, animations  and interactions earn attention that static displays cannot.  (Especially next generation members.)
  • Winning- News Pattern network members read news to be better competitors.  Video game interface reinforces the idea of competitive advantage.
Members of News Patterns read news to win in their business, political, financial or societal security jobs.  There are always competitive forces that hinder their successes. Nevertheless, with the greater visibility of competitive patterns based on real-time news, our members can see more and react more quickly by interacting with our News Radar interfaces as they would play a video game.

 

Wednesday, May 2, 2012

A Collective Wisdom Lives in the Seeming Chaos of News

I had the opportunity to discuss the trends that one can discover with our News Patterns algorithms and visualizations.  I was talking with a group of sophisticated managers from the financial services industry.  It was not long before I realized that they were very skeptical that any useful patterns could be derived from the data we call news.  (News in this blog can include traditional news, message boards, blogs, RSS feeds, Google Alerts, videos, social media and Twitter.)  They were convinced that news was mostly biased and dominated by ignorant contributors, or Garbage In = Garbage Out.

Swarm Trends

In answering their skepticism, I started by referred to a 2004 book by James Surowiecki called The Wisdom of Crowds - Why the Many Are Smarter than the Few and How Collective Wisdom Shapes Business, Economics, Societies and Nations.  At the time of publication, James Surowiecki was a staff writer at the New Yorker, with other publications including the New York Times, the Wall Street Journal, Artforum, Wired and Slate.  I started my explanations with two references from the "Wisdom of Crowds."
  • In 1884, at the International Exhibition in London, a British scientist named Francis Galton collected all the individual entries for a weight judging contest of a slaughtered and dressed ox.  Eight hundred contestants of various abilities entered the contest.  "Galton undoubtedly thought that the average guess of the group would be way off the mark.  After all, mix a very few smart people with some mediocre people and a lot of dumb people, and it seems likely you'd end up with a dumb answer.  But Galton was wrong. The crowd had guessed that the ox, after it had been slaughtered and dressed would weigh 1,197 pounds."  The actual weight was 1,198 pounds, or an error or 0.08%!
  • John Craven was a naval officer who was tasked to locate the U.S. submarine Scorpion that sank in the Atlantic Ocean in 1968.  Craven assembled a team of various experts who were to independently offer sinking and location scenarios without consulting with each other.  Craven compiled the individual scenarios and with some calculations, determined the "collective" location of the submarine.  This location was unique from any individual guess.  The "collective" location was 220 yards from the actual location.
The point that Surowiecki was making is that there is a collective wisdom among groups of humans, even though nobody can point to a central coordination of this wisdom.   Here is an example of the  collective wisdom of news creators from my experience at News Patterns that supports the ideas of James Surowiecki:
  • In 2009, Nokia had continued its dominance of the cell phone and smart phones markets, often kissing a 40% share of handset sales.  Yet starting in the Fall of 2009, two new competitors entered the smart-phone market.  The first was Apple with its iPhone.  The second was not really a distinct competitor but a new competing operating system from Google called Android.  We at News Patterns collected and patterned hundreds of thousands of articles with special algorithms over many months.  The collective wisdom of thousands of news creators soon discovered that iPhone and Android displaced Nokia, causing Nokia to fall from a central market relevancy to a peripheral relevancy position by November of 2009.  A competitive fall from news pattern relevancy often correlates with an actual decline in market or campaign relevancy. In November of 2009, a significant divergence of stock price versus news pattern relevancy occurred.  This drop in competitive news pattern relevancy was not noticed by the stock market.  In April of 2010, Nokia announced that it was falling far short of market expectations with its smart-phones due to competition from iPhone and Android.  In a short period of time in April, Nokia's stock price dropped 52%, a move that started to realign Nokia's stock price with the competitive news pattern relevancy (or irrelevancy) of Nokia among its competitors.  The collective wisdom of thousands of news creators, as part of a mass of 200,000 plus articles over 5 months was a front-runner to the new competitive pressures on Nokia.
Of course there are no absolutes in the value of discovered news patterns.  Sometimes a news reporting community is too small.  Sometimes, it is possible to "fool all of the people some of the time."  Yet with modern collection and computation processes, it is possible for news to be a source of a greater collective wisdom, not seen by any participaing member of the collective.

See more details about the collective wisdom of news creators in this paper: Anticipating Financial Market Moves Using Long Term Patterns in the News .

Monday, April 23, 2012

Facebook's Potential Search Power Will Not Surpass Google's

On April 22, 2012, Diane Mermigas wrote this article in Business Insider: Facebook's Potential Search Power Could Surpass Google's.  The gist of the article is that the rich human interaction within Facebook is a superior method of creating invaluable context about Facebook members and their friends, thereby enabling a superior matching of advertising content and search results with individual Facebook members.  This could very well be true - to a point.  And that point is the line where sharing and updates crosses over to become spam for the notified Facebook members.  It is my observation that younger Facebook users and some demographic groups have higher tolerances for sharing based on extended periods of time for Facebook application usage.

But my analysis here pertains to professionals in business, finance, politics and societal security.  While all of these types of people may have Facebook identities, it is highly improbable that they are substantially sharing, liking, or friending within the external communities where they compete and earn their livings.  Sure, there are exceptions like Realtors and insurance agents where selling is dependent on personal relationships.  Yet few in competitive environments are willing to reveal context about themselves that could expose personal weaknesses.  Few were also willing to offer any reason for a potential customer or voter to choose a competitor. 
Community and Context

Over ten years ago, we envisioned a news intelligence system that was augmented by collaborative insights.  We called this collaborative insight our "swarm index," named after the swarm intelligence found in colonies of bees.  Our swarm index enabled commenting, sharing, and changing of news article urgencies.  We also implemented powerful versions of "liking" that included measures of group threats or opportunities, far before Facebook.  In spite of all these community capabilities, it did not take us long to realize the true needs and behaviors of professionals in private networks to whom we targeted our news intelligence networks:
  • Our network members dedicated minimal time to collaboration or sharing.  They were just too busy to add more work to their daily schedules.
  • Our network members were concerned that if they were perceived to be uber collaborators, then they might correspondingly be perceived to have too much time on their hands.
  • People were concerned to offer collaboration content that might appear trite or untimely to their organization peers - and even worse to offer opinions that were contrary to shared organization beliefs.
All of these issues were solvable.  Our solutions rested on the foundations of low member collaboration expectations and smarter context algorithms - the general approach of Google. 

Looking ahead, it is understandable that Google is seeking more dedicated collaborative or community inputs that will help improve the context of its searching and advertising.  And it is expected that Facebook will continue to leverage its community contributed content and context.  Nevertheless, not all Internet users are potential Facebook content editors.  Many professionals (as in the 150,000,000 Linkedin members) will continue to rely in the intelligence of Google, and not risk the downsides of self contributed Facebook content.

Thursday, April 19, 2012

World Financial Meltdown Threat Patterns #1: An Unhealthy Calm

Just after the US financial crisis in the latter part of 2008, I was having dinner with a friend who had lost major parts of his retirement savings. He was not your expert investor. Rather he was a smart professional who trusted the advice of his financial advisor. It was obvious that his advisor did not see the coming storm in mortgage backed securities and the deleterious effect that this storm would have on the entire financial market. My friend was trusting what supposed experts were seeing.  At that dinner, I asked myself the question: "Why not enable ordinary people to see more of what is important around themselves - especially significant risks?"

Like 2008, significant risks are brewing in world financial markets.  The following News Radar is a pattern discovery and tracking system based on tens of  thousands of daily worldwide news and blog articles.  In particular, the patterns that it seeks are patterns that portend potential threats or opportunities in world financial markets.  Over the past five or more years, we have discovered that seemingly chaotic and overwhelming flows of news contain a collective intelligence from thousands of news content creators.  These news makers, both professional and novice, tend to write about what is important or interesting to themselves.  When we add all their ideas together, an overarching intelligence, or swarm intelligence, can appear.

This World Financial Meltdown Watch Radar was plotted on April 18, 2012, and it contains over 160,000 news and blog articles from the previous four weeks.  One can see an active version of this radar at http://www.newspatterns.com/show_radar.php?name=financial2.  (Note that radar changes day by day with new news signals, and your browser will need to be compatible with HTML 5 to see this animation.)

Financial Meltdown Radar 2

The simple explanation of this radar is that the most relevant ecosystem topics are drawn to the center of the radar space.  In this case, the radar center is occupied by Spain and Government Debt (center left) and Recession-Recovery (center right.)  Today, this radar is reflecting the market anxiety about the recent Spanish government debt offering as well as the uncertainty whether the world is heading toward recovery or recession.

There are many other interesting patterns to dissect, yet I would like to get back to my "Unhealthy Calm" threat pattern.  It is my hypothesis that world financial markets cannot get back to viability until governments start to significantly curtail pension and entitlement benefits for their citizens.  Governments cannot continue to live beyond their means.  Higher taxes are not the solution.  Super robust economic growth is also unrealistic.

If governments do start down the path of entitlement and pension reductions (also known as austerity) then I expect that there will be significant unrest in effected populations.  Think of Greece, Spain and Madison, Wisconsin.  The above News Radar will reflect this pattern with a coupling of the Austerity topic with Unrest, which will further display as a movement of both topics toward the center of the radar.

The fact that there is so little implementation of austerity by world governments, tells me that world leaders are "kicking the can down the road", and not really addressing the heart of what ails world financial markets.  Ironically, massive societal unrest will be a healthy indicator that world governments are addressing their debt problems.

This calm of needed solutions is a significant threat that more need to see and track.  The longer that Austerity and Unrest remain as peripheral topics in the financial radar, the more world financial risks will grow.
 

Sunday, April 8, 2012

Looking at Context in the Context of News Patterns

We here at News Patterns often think about context as we develop our patterning algorithms and interfaces. According to the Merriam Webster definition...

Context: the interrelated conditions in which something exists or occurs; environment or setting.

We extend the definition of context to include relevant relationships that enable one to see things differently as a result of those visible or conscious relationships. This graphic illustrates the point about the power of context:

Context Example

  
As one might suspect, both gray squares are actually the same color and lightness. Nevertheless, the gray square surrounded by black squares (left) appears to be darker than the gray square surrounded by white squares (right).  This visual perception shift is a result of the way our brains perceive patterns in light and dark fields.  We interpret the gray squares differently because of the the different contexts where they appear.

This same shifts in perception occurs when we are exposed to news signals based on these examples of news context from traditional news sources:
  • The credibility of the news article source (history of relevant coverage and factual accuracy)
  • The historical sentiment of the source (as in friend, foe or credible objective)
  • The relevancy of the news as it pertains to current needed information
  • The frequency of new story repetitions among different news sources

With our news patterning algorithms and animations, we extend the boundaries of context with these attributes:
  • Thousands of potential relevant sources
  • Extended periods of time (days, weeks, months and years)
  • Topics that should be tracked as part of important interests
  • News that correlates with archetypical patterns of competition
  •  New topics that are deserving of active tracking
  • Visual animations of context and trends
  • Tracking layers set to anticipate actual market, political or societal events
  • Trusted group memberships that share news and relevancies of news articles

Since all this extra context would produce an overload of text if it were all in written form, News Patterns uses image and animation layers to add context to relevent news for our network members.  Context in image form is interpreted by humans at amazing speeds.  The end result is greater insight (as in more useful context) in a shorter period of time.

I will add more on this topic in a future post.  See also my most recent  post: Animation Innovations for News Patterns Radar Interfaces )


Sunday, April 1, 2012

Animation Innovations for News Patterns Radar Interfaces

In early February of this year, we added new animation layers to our News Radar interfaces. These animations were written in HTML5 so that they could be displayed across the widest range of Internet devices. We had three primary objectives:
* Connect the narrative of "swarm intelligence" with our radar visualizations
* Use movement to guide users to the most potentially relevant news and patterns
* Continue our progression to a video game like interface

The following image is a snap-shot of one of our animated News Radars.  Because this is a static blog page, movements are not active. Nevertheless, an active version of this News Radar can be seen at this location: Example Animated News Radar: Tablet Ecosystem
News Radar Example


Since each News Radar can represent thousands of news articles, the addition of moving objects captures the feeling that the radar is composed of many of these articles. The nature of the movements draws attention to highly relevant competitive topics and important connections among topics. As the volume and intensity of object movements increase, so too does the probability that these topics and connections deserve more attention.

And once desired attention is focused on these movements, News Pattern members/clients can "play" the interface with instantaneous drill-downs to the actual news and social media that might be most relevant for reading. This ability to play the news interface enables an extremely fast process for gaining high level overviews of a competitive environment while focusing on the most relevant news.