Showing posts with label Business semantics. Show all posts
Showing posts with label Business semantics. Show all posts

Friday, October 23, 2009

How Semantic Technology and Text Extraction can help in listening to "Voice of Customer!"

Businesses succeed by getting, keeping, and growing customers. Customers are the only reason you build factories, hire employees, schedule meetings, lay fibre-optic lines, stock inventory, write software  or engage in any kind of business activity. "Without customers, you don't have a business. You have a hobby." These are not my words but they are explained very nicely by Don Peppers and Martha Rogers in their famous book - Return on Customer. The book is basically about developing a business metric around your customers that can drive better management and higher stock price.

We know that it is becoming increasingly hard to keep this customer as they are no longer hungry for what a business has to offer. They have more choices than ever as far as developed and emerging economies are concerned! At the same time, Social media tools have made it possible for hundreds of millions of people on this planet to express their opinion. And everybody has an opinion about something! If that "something" is not a person or social/political/economic  issue than chances are that it is likely to be a product or a service! It is becoming very important for businesses to understand what their customers are thinking and saying about their products and services. They know that they will lose this customer as customers' shift loyalties very quickly if they are not heard. Businesses call it "Voice of Customer" and have been trying various ways in last few decades like polls, surveys, incentives and some other ways to understand that. There have been many issues with most of the earlier approaches as it is not an exact science and new regulation and privacy issues are making it harder. Marketing and support personnel have been trying hard to keep tabs on real-time conversations regarding their products, services and brands in blogs, Web forums, wikis, microblogging services including Twitter and Facebook. The advancement in text analytics is bringing  a complete new approach to hear VOC.

In a nutshell, "text analytics" is about processing unstructured information in text and transforming it into relevant information. It is a highly sophisticated technology which uses concepts like clustering, categorization, advanced pattern recognition, machine learning, AI,  language identification, semantics, linguistics and relationship extraction . The text processing can extract entities, concepts, events and sentiments from the text and marry it with structured data in databases and data warehouses to get useful business insights. Pharma and intelligence community have been the earliest adapters of this technology as they have compelling need and ROI is very high. In of my earlier blogs, I have also explained how Open Calais, using text analytics, is helping Semantic Technology.

Attensity Group, one of the remaining leaders, after Clearforest and Inxight were acquireed by Reuters and Business Objects respectively, text analytics space, has announced a very interesting product called Attensity Cloud. They built this product by combining their patented text analytic technology with Radian6 platform. Radian6 provides a platform to develop a dashboard, metrics, filtering and segmentation for social media data. According to Attensity Group, the Cloud plaform also uses sematic web technology along with text analytics technology. The Attentisty Cloud can tell things like:
  • Which conversations are relevant and active
  • Which products are most talked about e.g hamburger vs. salads in case of Mcdonald
  • Sentiments behind each product
  • Intentions to buy product
  • Top issues, cries for help
  • product suggestions
  • Eearly warning of issues
  • Actionable facts
Morever, you can integrate this platform with CRM and e-service to get value across all channels. I think that it is a very good move as it is a very smart idea to tie text analytics technology with semantic technology and applying it to solve a business problem. It can allow organizations to monitor, analyze and respond to social media in more effective and faster way.

Since, the platform is introduced very recently so there are no real customers. It will take a while to understand the power and usefulness of this plaform and how it is working out for Attensity's customers. Nonetheless, the concept is good because it will probably help in customer retention if businesses can integrate, configure and deploy Attensity Cloud successfully along with CRM systems. Because, In the end, any customer needs just few basic things:
  • They want you to know who they are
  • They want you to know what they need
  • They want a reliable way to communicate with you
  • They want you understand their definition of value
  • They want you to know what they want next
  • They want you to support them if they trust you and buy from you
  • And they don't want you to ask the same questions
I believe, despite doing all of these things, it is still a challenge to retain a customer if you don't innovate. Do you know the number of customers Apple stole from its competitors, who thought they were doing everything right to hear VOC, by introducing iphone? But thats a different discussion for a future blog!

Wednesday, October 21, 2009

Do we need to define a "Category" for Semantic Technology in the IT Stack?

I started thinking about 'having a category for semantic technology' more after having a conversation with a friend of mine who is a Vice President of Product development for a software product company. His exact words were : "I believe in Semantic Technology and it is very promising. We will also see lots of innovation in next few years. But it is hard to sell product and services in this space" He really meant it more in context of an enterprise than the WWW. He is probably right somewhere despite his limited exposure to Semantic Technology world.

 Even though there are many semantic technology-based implementations that are happening in the IT industry but it is still a tiny fraction of what is going on with Databases, ERP, CRM, BI, Portals, ECM, SAAS, SOA, Collaboration, Applications Servers, Security, legacy application modernization and so many others disciplines. Semantic Technology is not among top ten priority for any CIO for 2009 or even 2010! Actually, it is not even perceived as a category.  When will it become a priority? Do we need to create a category for semantic technology for the enterprise? Maybe! Selling any product and services in this space can be hard sell if semantic technology industry doesn't do a good job in coming up with a nice and understandable category like ERP, BI, CRM etc.. which is already defined clearly in the minds of business and IT in any company. At least, they don't argue about what it really means. At the same time, we have seen the fate of "knowledge management" category which till this date means different things to different people. Selling it as "Semantic Technology" has the same risk as selling SOA (service oriented arhchitecture) which is always a hard sell by IT to business. It has to sound like a solution to the business who doesn't want to buy another piece of technology. The Semantic Technology community now has to wear their marketing hats.

I really admire at least four instances where defining a category played a huge role in success of one or more companies in that space and subsequently many innovative products and solutions were introduced in the marketplace.

  • SAP hijacking MRP and rebranding it as ERP (Enterprise Resource Planning). Later on other disciplines like sales and distribution, warehousing, financial etc. became a part of ERP.
  • Siebel, through acquistion, coalesces SFA (Sales Force automation), CCA (Contact Center Application) and marketing automation tools into CRM category.
  • BI was coined by Gartner and they re-named catgeories like DSS (Decision Support System) or EIS (Executive Information System)
  • The industry went through the confusion of defining a  category for many years for web content mangement, imaging, document management, records management, digital asset management, collaboration etc.. Finally, everybody has settled on ECM (Enterprise Content Management) which is broad and relevant enough. The ECM industry has been on a great growth trajectory since then.
Also,  these four categories are already multi-billion dollar industry now. Having a broader concept and having more players as part of it always helps when anyone is sizing up a category. In matter of months, from small player who is struggling to make few millions on its own, you suddenly look like a part of a growth industry which is already making hundreds of millions. It also makes a CIOs as well as VC community very comfortable.

Defining a right category which sticks and resonates with both business and IT is one of the most important steps for growth and to foster innovation. We really need better positioning for semantic technology! Having a right category doesn't guarantee success but it is the first step towards long-term success. It will definetely accelerate adaption! From timing perspective, the Semantic Technology Industry has to do it now. As Sir Tim Berners Lee says, "We have all the tools to make it happen" - he probably meant web in this context but we know that all the technologies are equally relevant and game changing in the enterprise context also.

Things can quickly change in theIT  industry if you take the examples of SAAS (software as a service model). It was nowhere among the priorties for CIOs 3-4 years back and has already made it into the top 10 list for many of them. There are already more than six hundred vendors who are offering SAAS. Virtualization and Cloud computing also comes to mind in this context as they have also made it into top priorties in a very short span of time. These examples should be enough inspiration for companies who are planning to build products or offer services as Semantic Technology discipline is based on eually good foundation of solid research and development as any of these disciplines mentioned above. Again, right categorization is the key here.

We really need an "Umbrella Term" for Semantic Technology so that companies in this space like Franz (database), Metatomix (platform), TopQudrant(tool), offering ontology services and many others can live peacefully under it. It will also make life so easy for sales, marketing, channels and future enterpreneurs  in the vendor community.

"Business Semantics Management" has been used earlier in a similar but smaller context. Though, personally I think that it has a very broad meaning and can be one of the candidates. It does resonate with business but this name can have its own limitations also. It can be perceived more as just in context of ontology and vocabulary whereas Semantic Tchnology can give you business insights also. It can multiply your ROI on your investments on BI, data management,integration, ECM, search etc..  There can be many meaningful and relevant names for this category which will require more dialogue in the industry.  Once we agree on a category name then it needs to be marketed and socialized relentlessly.
 
We really need a body in the semantic technology like what AIIM is to ECM industry or TDWI is to Business Intelligence to help in this.  W3C is doing great work but its focus is more web, research and standards. We need an organization who can work closely with corporatations, vendor communiy and maybe research to facilitate conversation and ideas.It will be lot of work for this organization if they have to follow the model of AIIM who has done great job in ECM market in education, industry advocacy, marketing, consulting, professional development, peer networking, benchmarking, market intelligence, developing local chapters, best practices, help in developing policies and procedures etc..

Thursday, October 15, 2009

Semantic Technology, Financial Reporting and the Toxic Assets!

Financial markets, traditionally the earliest adapter of any new technology relative to other industries, has been a laggard as far as Semantic Technology is concerned. It seems that the turmoil in the capital markets in last two years has managed to dampen enthusiasm for new technologies in capital markets and banking industry. All of it is about to change! The two obvious reasons are: we are coming out of recession and  new regulations regarding financial reporting in XBRL. I believe that the third reason is the inherent limitation of XBRL as far as Semantics is concerned!


As we know, XBRL, solves two significant problems for companies who prepare financial statements along with analysts, investors, regulators, financial publishers and data aggregators:
  • The first problem is that preparing a financial statement for printing, for a Web site, and for filing today means that a company could typically enter information three times
  • The second problem is that today (if the report is not in XBRL), extracting specified detailed information from a financial statement - for e.g we still can't ask questions like "Give me depreciation expense from 2003 a financial report."
The basic idea behind XBRL is to provide grammer and syntax behind financial reporting so that it can be extracted, analyzed and queried. Although XBRL has been around for 10 years now, the adoption and acceptance has only begun to significantly accelerate during 2007 with the support of  SEC. Since the year 2009, the filing has become mandatory for largest five hundred US corporations and other companies will follow in a phased manner from 2010 onwards. Market is already flooded with XBRL products , services and tools. Most of these products and tools help in one or more of following things : creation, viewing, analysis, taxonomy creation, custom document creation and various other automation features. XBRL can be stored in RDBMS as well as XML databases like Marklogic.


So what is the problem? Why do we need Semantic Technology in this context? While XBRL allows for more accurate consumption and interpretation of financial information, there is still a need to connect to the authentic source of the document and to recombine the XBRL content with other data sources. The fundamental issue here is that XBRL document working with other dat source doesn't understand anything about the semantics of data. There is just no meaning associated with the nesting of tags. The limitation of XBRL becomes more obvious when you have to use/analyze/query XBRL reports along with other sources of data which is not XBRL compliant.

If you read this  article in Wall Street Jornal on Toxic assets then it will make you think more clearly about importance of "semantics" in reporting in the world of derivatives.. The key points are:

  1. Ever since humans started trading, lending and investing beyond the confines of the family and the tribe, we have depended on legally authenticated written statements to get the facts about things of value
  2. Derivatives are the root of the credit crunch. Why? Unlike all other property paper, derivatives are not required by law to be recorded, continually tracked and tied to the assets they represent. Nobody knows precisely how many there are, where they are, and who is finally accountable for them.
  3. Every financial deal must be firmly tethered to the real performance of the asset from which it originated.
  4. All documents and the assets and transactions they represent or are derived from must be recorded in publicly accessible registries
  5. Governments can encourage assets to be leveraged, transformed, combined, recombined and repackaged into any number of tranches, provided the process intends to improve the value of the original asset
  6. Financial institutions will have to serve society and fully report what they own and what they owe -- just like the rest of us -- so that we get the facts necessary to find our way out of the current maze
  7. Governments can no longer tolerate the use of opaque and confusing language in drafting financial instruments. Clarity and precision are indispensable for the creation of credit and capital through paper.
XBRL, by itself can't fulfill all of these requirements as we need to corelate/link/resolve various reports to the source data - a very important thing in the world of derivatives reporting. You need Semantic Technology for that! We need to represent XBRL in RDF or OWL representation. I will recommend my readers to read another rebuilding public trust - a nice article on the same topic. The author is also talking about services which can allow the financial data in XBRL to be combined with data from other industry and government sectors — basically, transforming the way we explore information.

There are various techniques to convert an XBRL document to RDF. I will not go into those details in this blog. One example -  GoodMorningResearch.com machine automates XBRL tagging of Excel data in RDF format with one-click Save As XBRL functionality.

I believe that  long-term (probably very long-term) vision of XBRL reports should be to publish it as RDF triples and make it a part of Linkedata cloud. This will help in achieving all linkages, transparency and verification as far as financial reporting is concened. I would like sceptics to know that by April 2009, more than 600 XBRL reports, approx. 1,3 million RDF triplets,  were already part of Linked data cloud.  But at the same time, you need lot more governance, regulations and process behind this effort to get real value. Also, there has to be some kind of incentives for financial organizations to do this.

Thursday, September 24, 2009

How Semantic Technology helps Data Strategy? The discipline of Business Semantics!

Data Strategy has again become a "hot topic" in the enterprise. The two things which are of utmost importance in this area or require painstaking work are:

1) Data Standardizaton - Agreeing what to call things, which things are equivalent
2) Data Governance - Who "owns" the data, who is the steward, who gets to change things, who is responsible for quality

If you really think about it then more time is spent on analyzing the quality of data and doing reconciliation then anything else. Bottomline is that there has to be a common language between business and IT. Business semantics or developing  a dictionary based solution is the key here. You can call this business dictionary as a knowledge base or a an ontology based solution.

In my view, an “Enterprise Ontology” in the Semantic world is equivalent to an Enterprise Data Model in the Relational world. Developing an ontology is similar to creating a data model. However, one important difference is that ontologies allow you to seamlessly move from logical design to physical implementation. Also if you have established a business dictionary using the Web Ontology Language (OWL), you have encoded it in machine-processable as well as human-readable form.

Relational databases (and the applications that use them) behave as if every row in a table is unique. So when a customer database contains "Microsoft” and “Microsoft Inc.,” the system behaves as if they are two different customers. In the world of ontologies, we should be able to simply declare the equivalence of the two instances and be done with it.

Business Semantic is a fresh market and there are very few case studies out there. This market will only grow in the long run as using semantic technology approach for ensuring data lineage and data quality is the best possible approach from flexibility and maintability perspective. There is a start up in Belgium called Collibra which is actively working on it using purely semantic approach.  

Reblog this post [with Zemanta]