The Outlook For Revenue Assurance

Four years ago I chaired the fourth annual Vision in Business conference on "Revenue Assurance and Cost Management in Telecoms". Obviously I did not do too bad a job, because on Thursday I was once again in London to chair ViB's eighth annual conference. If the trend continues, I should next be back in the chair at the 2012 event. Perhaps Olympic years are good for me ;) The conference was excellent as it always is, bringing out the great and the good from Europe, the Middle East and Africa. I noticed that the habit of speakers introducing revenue assurance as a "new" practice seemed to have died off completely. There were too many familiar faces around the conference venue, too much experience in the sessions and on the speaker's platform for people to pretend that revenue assurance is the latest craze. Instead, much of the talk was about how to keep moving forward once the most obvious and immediate goals had been realized. This was refreshing. No business activity ever succeeded by trying to repeat former victories, or less still by just reminding people about them. The revenue assurance sector is not immune from the pressures of the wider telecommunications marketplace. Periods of investment and growth must eventually be followed by periods of consolidation, cash generation and cost cutting. Even if revenue assurance is an activity that telcos turn to later in their growth cycle, that does not mean revenue assurance will keep growing and growing long after the rest of the business has reached a plateau. The pattern for telecommunications in general is being followed by revenue assurance, though revenue assurance lags a few years behind other telecommunications industry sectors. This lag may have confused some people who expect revenue assurance to just keep growing as easily and as quickly as it does when it delivers those first quick wins.

In the developed world, revenue assurance penetration is nearing saturation, growth is slowing, and cost cutting is becoming more important. Focus on growth potential is shifting to the developing world, which largely means reproducing what worked in the developed world, but more efficiently and in a way tailored to regional needs. The implications for revenue assurance cut across all aspects of its work and culture, forcing revenue assurance suppliers, individual practitioners, and telco RA departments to think about the future. With this in mind, I thought the eighth annual ViB conference, and my second time chairing it, was a good opportunity to analyze current trends and make some predictions of how the revenue assurance sector will change in coming years. For those of you who want to read more, you can obtain the slides for my opening remarks at this year's conference from the downloads page. Even if you disagree with the predictions, I suggest you take a look and decide what you think the outlook for revenue assurance is. Whether you have worked in the field for many years or are new to it, it is important to have a roadplan for how you intend to change in response to the changing marketplace around you. Why is it important? Well, as Deming once put it:

"It is not necessary to change. Survival is not mandatory."

GRAPA Membership Numbers (Part 2)

In the last blog, I discussed how the Global Revenue Assurance Professionals Association (GRAPA) needed to expand its membership if its stated goals are to become credible. Today, I want to analyze the current approach of GRAPA to building its content and its volunteer base.

GRAPA communications place a clear emphasis on unpaid volunteers contributing content to their peers for free. In this regard, GRAPA is more like a bulletin board than a professional association. Professional associations do not educate their members by allowing anybody, free of charge, to tell everybody else what they personally think is right or wrong. Imagine a situation where doctors or lawyers went to an online exchange and asked questions like "my patient needs open-heart surgery, does anyone have any tips?" or "could someone send me through their notes of how they conducted the prosecution of a suspected murderer?". Asking questions like that would imply the 'professional' asking them was not competent to do their job. And imagine if they then followed the advice they received! I sincerely hope my doctors are properly educated, and do not rely upon freebie tips to get them through the working day...

Whilst GRAPA boasts of over 1000 members, the meaning or status of membership is currently very questionable. It is not normal for anybody to be allowed to join a professional association simply because they have an email address at a telco or a company that may sell a relevant product. That is like obtaining a 'degree' from one of those institutions where you send them some money and they send back the certificate. So far GRAPA does not even ask for the money. Currently, anybody could join GRAPA for free, no matter how incompetent they are, and then try to use their membership as a badge of quality. The problem with that is that if anybody can join, then there is no discrimination based on merit. If somebody did get a job or a promotion because they fooled someone into thinking GRAPA membership meant something, and they turned out to be incompetent, that would tarnish the reputation of everyone else in the association. That is why professional bodies that work to promote the interests of their members are exclusive. Not everyone can join, and not everyone who joins is allowed to remain a member. People join by passing examinations and getting references that show they have the necessary working experience. People remain by satisfying ongoing commitments to maintain their education. People who fail to meet those expectations, who are shown to be incompetent or who act unethically are ejected from the association according to its disciplinary procedures. GRAPA's members, however, have been through no qualification process, have shown no references, and are not subject to any discipline. In a case where one of GRAPA's committee members sought to obtain free air travel and accommodation from vendors in order to attend a GRAPA event, the response was prompt but weak. GRAPA issued a policy statement that clarified GRAPA is a volunteer organization and not responsible for how its members behave. Real professional associations bar individuals who behave unethically. They do not hide behind an excuse that allows any member to behave any way they like and still remain a member. Until GRAPA has a genuine disciplinary function, and the willingness to discipline its members, then any rotten apples can spoil the reputations of all.

One of the goals of GRAPA is to set standards. This brings us to another problem area for GRAPA, as it tries to be all things to all people. In most professions, the setting of standards is performed by a body distinct from the body that represents professionals. The reason for that is simple. Standards are usually set to protect customers, and have to focus on the customer's interests. A professional body represents suppliers, and will focus on the supplier's interests. To do both at the same time leads to a conflict of interest. Standards are needed because they define the product that the customer should receive. This is necessary because customers do not have the expertise to understand the subject area themselves, and hence to determine the competence of the professional or the adequacy of their work. You can employ an accountant or a lawyer without needing to understand accounting standards or legal prescriptions because the standards have already been set by other professionals. The professional body then just has to restrict professional status to those people who can be trusted to comply with the standards. If standard-setting and professional representation is combined, as is the case in GRAPA, the temptation will be to set standards too low, so all suppliers can be said to satisfy those standards. But if all suppliers satisfy the standards, then the standards have no value. Similarly, a professional body needs to eject members that fail to meet the standards in their work, in order to safeguard the reputation and income of professionals who do meet the standards. If, however, the standards are set so low that everyone meets them, are not enforced through a disciplinary mechanism, then they have no value. Standards that are not enforced are just optional guidelines. If standards are just guidance, the companies that employ GRAPA members cannot assume that the standards will be followed in practice. In that case, then there is no benefit to the customer in employing GRAPA members over other people who claim professional status but who are not members of GRAPA. That in turns mean that there is no value in paying membership fees or for qualifications from GRAPA, because it will not lead to increased income for the professional.

It is fair to argue that any professional body needs to start somewhere. That somewhere, for GRAPA at least, is to open the doors to volunteers and hope that they work amongst themselves to agree on the basis of a profession. Let me hence finish by discussing the true extent of volunteer activism in GRAPA. Of the 1000 or so members, how many actively participate? In my first criticism of GRAPA, I argued that GRAPA was in danger of splitting the revenue assurance community into two by including telco employees but excluding all other revenue assurance practitioners. This was not a moral argument; the problem with a policy of exclusion is that, if you are looking for lots of enthusiastic volunteers, then imposing an arbitrary rule on who can be included only serves to limit the number of people who can make a positive contribution. I cited the 1% rule where for every 100 interested but passive onlookers, there will be just 1 volunteer willing to actively contribute. You can refine the 1% rule into the 100:10:1 rule by recognizing that for every 100 interested, 10 may make a small contribution, 1 will make a large contribution. If the 1% rule is correct, then GRAPA's 1000 members will include just 10 people who make an active and significant contribution. GRAPA does a good job of making its active membership appear as large as possible, by appointing people to all sort of executive and committee positions. However, giving someone a title does not mean they actually do anything of value. Because GRAPA is little more than a website owned by a small company in a small village in Illinois, the best source for objective statistics on GRAPA activism would be from GRAPA's own internet forums. Here is a summary of the activity on GRAPA's internet forums using data extracted on 21st March 2008.

  • There are 1107 registered users for the web forums, and the forums include 493 posts.
  • Of the registered users, 339 (30.6%) have so far logged on to the site in 2008, and only 86 (7.8%) have logged on in the first three weeks of March. 375 users (33.9%) last logged on between September and December 2007. There are 393 users (35.5%) who have not logged on for 6 months or longer.
  • 808 (73%) of the people who signed on to register with GRAPA have never logged in again.
  • 89 users (8%) have made one or more forum posts, 1018 (92%) have never posted to the forums.
  • 30 users (2.7%) have made 5 or more posts. 12 users (1.1%) have made 10 or more posts.
  • The most posts by a single user is 56, which represents 11.4% of all posts.
  • The top 10 users have submitted 244 posts, 49.5% of the total.
  • The admin group, which is Rob Mattison, his family and workers, have posted 74 times. President Mattison has made 25 posts to the forum.
  • Committee chairs have made 48 posts between them. Of the 13 committee chairs, 9 have not made a single post. The top contributor of the committee chairs has made 31 posts, which is nearly twice the contribution of all other chairs put together. Only 3 of the chairs have logged on to the forums in 2008. 5 chairs have only logged on once, to submit their initial registration. Several members of GRAPA's executive committee have their names and photos prominently displayed on GRAPA's website but have failed to visit the forums for a long time, and were only active for very short periods after their appointment.
  • There are 6 moderators. 4 moderators have never posted. 1 moderator has posted 5 times and the other moderator is the top contributor overall with 56 posts.
  • The 220 commercial members include 44 people who have made a post, and they have submitted a total of 158 posts. 126 commercial members have logged in since the start of 2008.
  • Over three quarters of registrations are from regular telco employees who hold no position within GRAPA, and are misleadingly categorized as "new members", no matter when they joined. Of this group, only 28 have ever posted. They have submitted 86 posts in total. Only 194 of this group have logged on since the start of the year.

What conclusions can we draw? First, somebody better tell President Mattison he is a long way short of 1000 active members. His newsletters may have introduced "GRAPA's 1000th member" but the only way you get 1000 members is by including people who visited the site, registered, and never came back. If you restrict the membership count to people who came back a second time, GRAPA has less than 300 members. Apathy is no surprise though, given that plenty of the people listed as committee members and forum moderators seem to be completely inactive as well. Second, the most active group overall are the people President Rob tried to exclude at the beginning: employees of vendors and consultancies. They are much more likely to have submitted a post or to have logged on recently. Third, the 1% rule seems to be holding true. Nearly half of all posts come from the top 1% of users. Less than 10% of registered users have made any kind of active contribution; by "contribution" I am still including all those people who have posted questions but not answers. Finally, the registration list is growing, but very few people stay active for any length of time. Of the 86 users who visited the site in the first 3 weeks of March 2008, 49 of them had first registered in March 2008. More than half of the visits were from people registering for the first time. More and more registrations may give the erroneous impression of a growing membership. Many people who register soon lose interest and never return. Like prepaid mobile customer numbers, there needs to be a cut-off rule when registrations are considered inactive and can no longer be counted as members. For example, of the 117 new registrations in January, only 9 have returned to the site since the start of February. If people do not come back, they should not be described as "members". GRAPA needs to be more honest and transparent about its claims to represent a profession when the number of active participants is so small.

Numbers and data - they are what revenue assurance is all about. Look past the headlines, and take a look at the numbers and data about GRAPA's membership. The claims made about GRAPA being a growing professional association composed of active volunteers just do not add up.

GRAPA Membership Numbers (Part 1)

I have not written about the Global Revenue Assurance Professionals Association (GRAPA), Rob Mattison's sales vehicle, for a while. The reason for that is straightforward: they have not done anything interesting or annoying in quite a while. It seems to me they are moving into cash generation mode, selling training to disparate individuals who do not know of anywhere else to turn. There is nothing surprising about that. Making money was obviously the whole point, although Rob Mattison must be disappointed that so far GRAPA has delivered no return to him other than to promote his pre-existing training courses to a wider audience. Mattison no doubt still intends to introduce fees for membership, run paid conferences and make money from vendor advertising and sponsorship, but is pushing back the timelines because he does not think the market will support it yet. However, he does seem to be ramping up activity at GRAPA. Yet another Mattison family member, plus several others, have been added to the GRAPA payroll. This suggests that 2008 will be a make-or-break year in terms of GRAPA's financial viability. Either GRAPA generates sufficient revenues to keep that large staff fully employed, or it (discretely) scales back. This raises a question: how many members does GRAPA need to be a viable professional organization?

As of today, GRAPA's website boasts of 1078 members, and there are 1107 registered users of its forum. Not bad, but not great either. The original policy was that GRAPA was free to telco employees for a limited period, but did not permit people from vendors and consultancies to join. Then they changed the policy to allow people from vendors and consultancies to join, for a price. Then they changed it to allow people from vendors and consultancies to join for free. Meantime, it seems the "limited" free membership period has no end in site. One thousand people may sound like a lot, but to put the interest in telecoms revenue assurance into perspective, the readership of this website since GRAPA was first formed is several times that number.

Now that Mattison Jr. has joined GRAPA as membership czar, the route to expansion is pretty obvious. GRAPA's current membership is spread across 445 companies. That means GRAPA has less than 3 members per company. I can see that some of the companies are one-man bands, but obviously there are very many which employ anything between 10 to 100 people who should be interested in GRAPA. For whatever reason, word of mouth recommendation has not persuaded other members to join. In fact, it looks like new registrations are driven by random web hits rather than recommendation. That is the only way to explain why the ratio of members to companies has remained so consistent. If word of mouth was driving membership growth, you would expect the number of members to grow far more quickly than the number of companies, as people would recommend GRAPA to their work colleagues first. It is quite damning that existing GRAPA members do not feel like recommending the organization to the people sat working alongside them. Perhaps existing members do recommend GRAPA, but they are not persuasive enough about the benefits to encourage their colleagues to join, even though it is free. This is a serious problem for an organization that claims to represents professionals. If only one person in a twenty-strong revenue assurance team believes that membership is worthwhile, it hardly suggests they have improved their career prospects as a result of joining. Any good marketeer knows that recommendations from friends are the best way to drive growth and sales. It has become a mantra in many telcos. I can see from the web statistics for my own site how small pockets of interest grow by word of mouth. If I post a story that grabs the attention of some people in one company, I often see a very rapid explosion in the number of hits from that part of the world. Not all forms of communication are electronic, and my expectation is that Mattison Jr. will reorient the marketing away from playing with a website and towards fostoring face-to-face recommendations between work colleagues.

Even if Mattison Jr. is successful, GRAPA still has a long way to go before it can be financially viable, never mind deserve the rather pompous "professional" tag it has given itself. if 1000 members generated US$100 in income each, then that might just cover the income of Mattisons senior and junior, never mind the others. If we assume, as is only reasonable, that for every 10 free members there will be only 1 person willing to pay for things, then that person would have to pay GRAPA $1000 per annum just to keep Mattisons senior and junior in food and lodging. That is before making allowances for all those flights around the world to spread the Gospel according to Mattison ;) I suppose there is a good chance that many of the flight costs for Papa Mattison are being covered by conference companies, which suggests he is playing down his previous ambition that GRAPA would run its own conferences in competition with them! I must admit that I cannot tell exactly who is on the GRAPA payroll: the finances of this not-for-profit company incorporated in Illinois, USA, are far from transparent. At various stages there have been at least six people described as working on the GRAPA staff, not counting students hoping to get some work experience. Anyhow, if you assume maybe four or five paid staff, factor in the costs of running an office, maintaining a website, advertising (press releases do not come free) and all the rest you end up needing a turnover of US$500,000 at least. That would suggest GRAPA's membership needs to grow by a factor of 5 this year, and for every member to contribute on average no less than US$100 in fees or additional sales. Mattison Jr. has a lot of work to do.

All of this begs the question as to how much real interest there is in revenue assurance as a profession. Many people will take up offers if they sound like they will get richer at a small cost. My email inbox is full of them. They are called spam. However, that does not stop seemingly intelligent people paying over their money for "degrees" that do not require any study or the sitting of any examination, or wiring cash to Nigerian bank accounts because they have been selected in a mysterious "lottery". To put professions into perspective, I did some searching around. It only took me a few minutes to come up with some numbers for a variety of professions:


  • 91,000 practicing attorneys in New York City 2006, New York State Board

  • 42,538 physicians in Romania 2004, Britannica Online

  • 33,000 studying for a master’s degree in engineering in India 2002-3, All India Council for Technical Education

  • 2,277 architects in South Africa 2008, South African Institute of Architects

  • 2,147 Accountants in Papua New Guinea 2007, Certified Practising Accountants of Papua New Guinea

Hmmm. GRAPA needs to add another 1,000 members before it becomes as popular globally as the accounting profession is in Papua New Guinea. Obtaining critical mass for a genuine revenue assurance profession is going to be a problem. In a genuine profession, you pay your fees and you make more money as a result because other people think having the qualification and being in the association has a value. The alternative is that you get one of those huckster qualifications where you pay your money and get a worthless piece of paper with your name on it. Consider also that accountants in Papua New Guinea pay annual fees of K550 (US$182). I do not know anything about the Certified Practising Accountants of Papua New Guinea, but my guess is that those annual fees are spent on maintaining professional standards, ensuring the quality of practitioners, upholding professional discipline, and educating members. GRAPA needs to do the same job if it wants to claim to be a genuine professional association, but so far neither its fees nor its membership is adequate to do that. Making the organization global, and including all practitioners inside and outside telcos does at least ensure it has maximum reach, but I still think there is an open question as to whether there are several thousand revenue assurance practitioners in the world who would be willing to accept the discipline and cost commensurate with professional status. If they can arguably get paid well and enjoy career progression without it, then the prospects are poor.

One way to solve the problem of up-front costs when setting up an organization is to rely upon volunteer enthusiasm. That seems to have been GRAPA's mantra thus far. In the next post I will dig into the detail of GRAPA's membership numbers, and answer the question: just how active is GRAPA's membership?

A Listing for Linden Labs?

Is it me, or has the world gone mad? The US, and hence the rest of the world, is in the midst of stock market chaos. This chaos has been prompted by the stunning realization that lending money to people with no money and limited prospects for earning money may not be a great way to make money, but may well turn out to be a marvellous way to lose money. "Sub-prime" is such an inglorious example of modern diction. Presumably it is only a matter of time before rotten meat is recategorized as "sub-prime foodstuffs" and the comments of lying politicians are described as the "sub-prime truth". As a consequence of mortgage failures, wholesale banking is being dragged down as well, as banks stop lending to each other for fear that loans may never be repaid. All of this is pushing the price of commodities like gold ever higher, as investors scramble for a safe haven. The idea behind that is that gold is tangible, "real" if you like, in a way that equities or debt could never be. In the midst of this financial mayhem, what news do we hear? Linden Labs, the company behind virtual world Second Life, may be closer to a public stock market listing. Hard to believe, but true nonetheless.

Philip Rosedale, CEO and founder of Linden Labs is to step down and take the role of Chairman, prompting the business to search for a replacement as the business shifts from start-up mode to operational mode (a.k.a. reigning in costs and trying to make more money). Some have commented this is part of a process that will lead to an IPO. Current Linden Labs Chairman Mitch Kapor, who was the founder and fomer CEO of spreadsheet pioneers Lotus, admits that an IPO is "an option under consideration". Presumably it is only an option because a commercial sale might suit just as well, and be a lot more realistic in a world where markets are going down, not up. However, any kind of sale does make you wonder about the relentless optimism for some kinds of investors. Second Life is not real. It represents what happens when people spend their time making a make-believe world. It has an economy and a currency that can be converted into real-world cash, but the Second Life economy has, in investment-speak, absolutely no fundamentals. Money in Second Life can be taken away or devalued in an instant. People may invest their real-world dollars in virtual real estate or establishing virtual businesses in Second Life, but none of it has any substance. This faith in virtual and intangible worlds that represent a combination of code and human interaction runs contrary to a time where most people are increasingly retrenching in the ever more real and tangible. The mortgage crisis plays on that most primitive of human needs: the need for shelter. No amount of virtual property can substitute for the loss of a real house. In times like these the virtual economists would be wise to keep their real-world ambitions in check.

Automating Resolution

Lots of vendors sell lots of software, hardware, databases etc to automate the detection of revenue leakage. A lot fewer products are focused on automating their resolution. But if you never fix the leaks, then the value of finding them is zero.

The trend in recent years is for the sellers of detection tools to throw in some kind of software to manage resolution workflows as a freebie. That is great if you want to get all your tools from one supplier, but not so good if you use a variety of best of breed solutions. Adding resolution doubtless increases the value earned from the tools, and probably helps with both the initial sales pitch and building of customer loyalty afterwards. One of the biggest downsides of integrating resolution into detection tools, is it encourages the revenue assurance team to behave as if the only way to detect leaks is to use automated tools. A little bit of imagination, the right selection of data, and some skills for querying and analyzing that data may be all that is needed to find a leak. Over-dependence on vendors can encourage a team to feel that revenue assurance always begins with an expensive procurement exercise.

One of the reasons not to automate resolution is that it only is cost effective to automate what you intend to do over and over again. Automating the repetitive fixing of very particular faults implies that the root causes of those faults will never be addressed. You could say in such circumstances that the revenue assurance team is institutionalizing leakages. Unfortunately, the business case for fixing a root cause may be harder to make than the business case for addressing the symptoms and leaving the root cause in place. For resolution to be automated effectively, it has to be flexible enough to provide workflows that deal with all kind of faults. Those workflows have to be adapted quickly for every kind of leak, because you do not want to put a lot of time and effort into them. The more time and effort it takes, the harder it is to keep motivation on solving root causes, rather than just symptoms. In the end, revenue assurance has to be about solving all problems faster, not about finding ways to make them last.

TMNG Pitches RA For Everyone

The Management Network Group (TMNG), the US firm who bought UK revenue assurance specialists Cartesian at the end of 2006, must have caught the revenue assurance fever. TMNG are having some success Cartesian's products to a wider market, having recently announced a second US pilot for Cartesian's Ascertain software. However, they are not content just to sell RA products to more telcos, and have decided they will try to sell RA to any and all

"large companies with multifaceted customer relationships involving many pricing options across many product portfolios".

Well good for them, though they could have just said "complex business" and left it at that ;) Anyhow, take a look at TMNG's super pitch to turn revenue assurance into a supra product. I doubt this article is going to turn the world on to revenue assurance all by itself, but if it helps spreads the word, I say good luck to 'em.

Video Probe

Using network probes for revenue and service assurance has always been a straightforward proposition. Stick a probe on the network, see what is happening, compare that to what should be happening, and if something is wrong go fix it. The downside is cost. For the price of one probe, you only see what is going on at one point in the network. Nevertheless, probes can make sense if you want an independent check on a sample basis, or if you can locate them cleverly to assure most of your traffic, or if you want to offer premium service, and reassurance, to high-end customers. That suggests it is only a matter of time before probes for newer services, like video, become as common as they are for voice. See here for the news that US firm IneoQuest's video probes now support European QAM standards. In fact, probes may be destined to be more popular for premium services like video than they are for voice. For a start, video may generate higher revenues and hence better justify the investment in probes. In addition, customer satisfaction, and the price the customer is willing to pay, will be more closely tied to quality with video than it is with voice. A customer that may have been prepared to pay for a crackling phone call is less likely to tolerate a blurry video session. This may force providers to use video probes to stay competitive by assuring services and revenues at the same time.

Subex vs. WeDo: Who Is Bigger?

When Sonaecom, parent group of WeDo published their FY2007 results, it made me wonder who really is the biggest revenue assurance vendor in the marketplace. This is no easy question to determine the answer to. To make the task simpler, I reduced the shortlist to just the two vendors who make the biggest claims. In one corner, we have WeDo. WeDo describes themselves as "the world's revenue assurance leader". In the other corner, we have Subex. I am sure many will remember how SubexAzure (as was) once emblazoned their logo over a full-size racing car to make the point that they were number 1. Since then, the marketing claims for Subex have changed less than their name. According to their press kit, Subex "ranks as the world’s number 1 provider of fraud management and revenue assurance solutions". Okay, so WeDo is the world's leader, and Subex is the world's number 1. But who sells most? Straight away, you will have noticed that Subex listed fraud and revenue assurance, but that is only the start of my problems when comparing the two. Subex, by acquiring Syndesis, now earns very significant revenues from activation in addition to its RA and fraud products. To understand WeDo's results, I need to look at Sonaecom's group results, but results for WeDo are aggregated into totals that include Sonaecom's other Software and Systems Information (SSI) businesses. So who really does make the most money from revenue assurance?

In the end, the conclusion was that Subex is the bigger earner of revenue assurance revenues. If we start by analyzing Sonaecom's SSI results, we see that nearly 40% of the SSI revenues relate to equipment sales. This must relate to Sonaecom's Bizdirect venture which resells IT equipment and software. The remainder, described as "service revenues" must be the total of revenues from WeDo and Sonaecom's Mainroad IT consultancy. SSI Service revenues in the last financial year were worth 47m euros (US$72.2m), which sets an upper limit on how much WeDo can be making from revenue assurance. Turning to Subex, we need to estimate how much of their revenues relate to RA and how much to service activation. It used to be easier to identify the separate revenue streams, but more recent shareholder advice blurs which is which. Other than that, I think it is fair to include fraud detection and other products under the heading of revenue assurance; WeDo also offer products that fall outside of the traditional "core" of revenue assurance. Looking at Subex's Q3 results, the company still looks on course to break 5bn Indian rupees for annual revenue i.e. to roughly meet the $US130m revenue targets, as stated in their guidance. That guidance also advises that ex-Syndesis will represent just over 30% of the total income, meaning that revenue assurance and fraud products will account for US$90m if targets are met. Unless the ratio of RA income to service activation income has changed significantly, then at Q3 Subex would have already generated over US$60m revenues from RA, with still a full quarter left to go to meet the US$90m target. This puts Subex comfortably ahead of WeDo, and makes Subex the worldwide biggest earner of revenue from revenue assurance products and services.

Independent Call Tests: Protecting Customers and Revenues

There is no question that revenue assurance revolves around the analysis of data. But what should you do when you want to check something, but you cannot pinpoint any data about the relevant network event? What can you do if there has been no relevant network event to check, or if you want to check somebody else’s network? One solution is to perform a test event on the network and see what happens. I spoke with Mario Margolis and Franco Primavesi of Networks Analytic Corporation (NAC) about the use of independent invasive testing in telecoms, and in particular about the recent NAC study into prepaid calling cards.

Eric: The Hispanic Institute recently asked you to test a series of international prepaid calling cards. The cards you tested are available in the U.S.A. and sold to people wanting to phone relatives in their home countries. Can you tell me about the objectives of the study?

Mario: The Hispanic Institute works in the interests of the Hispanic community in the U.S. They wanted to confirm whether the prepaid calling cards targeted at the Hispanic community were actually delivering the promised value to customers. To do this, they commissioned us to perform a series of test calls using a variety of calling cards.

Eric: What kinds of tests did you perform?

Mario: The different calling cards apply various kinds of charges. To make a call, customers type in the pin code from the calling card and they hear the balance they have remaining. Then they dial the destination number and they hear an announcement saying the total number of minutes their call may last. Our plan was to test the card values by performing a single long duration call to see how long the call would last before it was disconnected. Then we would compare the actual length of the call with the announcement that was made at the start of the call. We wanted to see if the call was actually as long as was promised in the announcement.

Eric: How many calling cards did you test? And what were the results?

Mario: We tested forty-five calling cards in total, and used them to make calls to both Guatemala and Mexico. Out of the forty-five, we were unable to connect a call with seven of the cards…

Eric: You were unable to connect a call? So those seven cards were completely useless? How many times did you try to place a call using those cards?

Franco: We attempted to place between seven and ten calls with each of those seven cards, but failed each time. This was particularly a problem when trying to call Guatemala.

Eric: And what of the other thirty-eight calling cards?

Mario: Only fifteen cards allowed us to achieve our original goal of exhausting the balance with just one call. Calls made with the other cards tended to drop after just a few minutes.

Eric: What did you do if the calls dropped?

Franco: We would make as many repeat calls as necessary to completely run down the balance on the card. Typically it would take seven or eight calls to do that.

Eric: That sounds like it would be very frustrating for real customers.

Franco: Yes, and expensive. Because there are charges applied for making each call, and because call durations are rounded, you get a shorter useful duration if you make several short calls instead of one long call.

Eric: So the real value of the card is greatly reduced if customers have to make several calls.

Mario: That was not the only problem. We found that in some cases the originator dialled the number and was charged, but there was no audio path back from the destination. We test the audio path both ways. The call was no good, but the customer was being charged anyway.

Franco: With some of the calling cards the duration is rounded up to the next three minutes. The customer makes a call, hears nothing and hangs up after a few seconds, but would still be charged for three minutes of use.

Eric: What were the results from the fifteen calling cards where you succeeded in exhausting the balance with a single call?

Franco: Only four calling cards lasted as long as promised. Five lasted somewhere between 80% and 50% of the promised duration. The other six cards were completely exhausted after calls that were half as long, or even less, than the duration announced at the start.

Eric: Do you have any advice for customers on what they should look for to tell the best cards from the worst? Or is it impossible to tell without doing the tests you did?

Mario: Customers need to be aware of the fine print about the charges. The less fine print, the better.

Franco: Customers should also avoid cards where you need to phone a customer services line or check a website to find out the full terms and conditions. Many were unreachable.

Mario: There is no obvious technical explanation, but in our tests the same kind of card may have given the complete duration as announced when used to call Guatemala, but less than the promised duration when used to call Mexico. There is no way to know except by using the card and seeing what happens.

Eric: What about calculating the true price per minute of each card?

Mario: I do not believe customers can really do that. Even a professional cannot determine the price that will be applied with complete certainty. There are many elements to the charges. There are weekly maintenance fees, hang-up fees, surcharges depending on the destination, and the calls are rounded in multiple minute increments.

Eric: I see from your examples that the fees are usually described as a range between a lower and higher number meaning you cannot be sure exactly how to calculate the price…

Franco: And the prices are subject to change without notice!

Eric: How can the calling card companies conduct business like this?

Mario: Many of the immigrants who purchase the cards are afraid about their legal status in the U.S. and have no desire to complain to any government agency. Also, regulations over the carriers vary from country to country.

Eric: Is anyone taking action as a consequence of your study?

Mario: The Hispanic Institute is lobbying for increased regulation to protect consumers. They have also asked us to conduct an expanded test, using more cards to make calls to seven countries in Latin America. Some government agencies, which we cannot name, have contacted us directly, in order to review our findings, our methods and our evidence.

Eric: What kind of evidence did you keep?

Mario: We keep all the data from the calls. For example, in addition to Call Detail Records, we have MP3 recordings of the audio paths from all the test calls that were made. That means there can be no argument about what was said in the announcements or about calls which were charged for but where there was no audio path.

Eric: What about the media? Are they interested in your findings?

Mario: The story has been picked up by a number of websites and local journals [see here and here for examples.] We have also been interviewed by a Washington D.C. television station dedicated to the Spanish-speaking community. Before they can broadcast it, they need to give the calling card companies an opportunity to make their own statements.

Eric: Your final report makes fascinating reading. I hope lots of people take a look at the detailed conclusions on the website of The Hispanic Institute. Are there other studies where you have performed independent testing and published the results publicly?

Mario: We did a study to correlate the audibility of DTMF tones with the line quality as measured on the PAMS scale. This was published by the IEC and presented to the ITU’s Quality of Service Group.

Eric: That sounds interesting. What was the conclusion?

Mario: In summary, recognition was not reliable if the PAMS measure was below 2.5. This sets a cut-off rule where the PAMS measure can be used to determine if the service quality is adequate to support services that rely on automated voice recognition.

Eric: Very useful if your business model is to make money by offering one of those automated information services…

Mario: Imagine trying to find out about a movie from an information service whilst driving to the cinema… you may arrive before you get through the first menu!

Eric: Tell me some of the reasons why telcos engage you to perform independent testing.

Franco: Independent testing enables calls to be performed and measured from the customer’s perspective. We perform tests following a predetermined test script, and keep a precise record of what happened from the customer’s point of view.

Mario: Every aspect of a call is precisely measured. Telecommunications firms use the data to assess a variety of things including the quality of the service given to customers and the accuracy of switch records and billing.

Franco: Calls that don’t complete, can’t be charged and poor call quality will cause customers to hang up rather than persist with a conversation, reducing revenues. If problems persist, customers will inevitably churn.

Mario: There is nothing to prevent one telco testing another and obtaining a competitive analysis. They can compare their own performance to rivals. Or, they pre-qualify a carrier they were considering partnering with. That way they can pick carriers based on the real quality of the service as well as the price, and even set Service Level Agreements based on these end-to-end perceptual metrics.

Eric: Why use an ‘intrusive’ testing approach to check billing?

Mario: To begin with, test calls give you an independent way to determine the actual start and end time of calls, and compare these to what was recorded in the switch CDR. Intrusive techniques enable the business to force something to happen on the network without waiting for customers to use a product. This can be very useful for checking new services.

Eric: We were talking about your study involving prepaid calling cards. Such traffic is typically carried by the so-called “bypass” operators. The motive behind your study was consumer protection. Why might a telco want to test for bypass operators?

Mario: Calling cards are so cheap because bypass operators avoid the termination rates levied by the destination network. Instead of paying the wholesale rate for termination, they only pay the retail rate for a local call. They can do this because they illegally link an international call carried by the bypass operator to a local call from a PBX or simbox in the destination country.

Eric: It is obvious this happens, because the prices boasted by these calling cards are lower than the termination rates to the destination countries. How easy is this to do, on a technical level?

Mario: An international VoIP call is connected to a local retail call, bypassing the need for a legitimate and legal interconnect.

Franco: People can buy the necessary hardware on eBay. All you need is a gateway to connect an interconnect call to a standard PBX. A seemingly honest business is used as a front for this kind of operation. For example, the front company may present itself as a marketing or customer service business, as these may be expected to make lots of calls.

Mario: These businesses generate relatively big bills which they pay on time, so they look like very good customers.

Eric: This makes the evidence for this kind of fraud very different to what you find with most other frauds. Most fraud results in bad debt, but bypass operations are likely to pay all bills on time.

Mario: Exactly. Although they pay their bills, they are still breaking the rules because they are finding a way to avoid the international termination rates that they should be paying.

Franco: There may also be help from people inside the destination operator. An employee may have aided the fraudsters by enabling a direct interconnection which is not being billed for. Another kind of help for fraudsters occurs when the operator’s staff decides to ignore the evidence that local calls are really the final leg of a bypass call. Yet another kind of bypass fraud occurs when stolen prepay SIM cards are taken to another country and put into a simbox. These are then used to make as many calls as possible until the network identifies and blocks the SIMs.

Eric: How does your testing prove what bypass operators are doing?

Mario: Because we originate the calls internationally and have precise details of the test calls being made, it is possible to match the test calls with the CDRs of the local call on the destination network. This is used to identify the address of fraudsters and stop them.

Franco: It is not enough to do the tests for a week or a month. You can cut them off, but the criminals will keep coming back, so it is necessary to keep on testing for them.

Mario: With our equipment, you get hard evidence of bypass operations. The calls are paid for like normal, and as the calls are made and the data recorded using our own equipment, there is no need to obtain anyone’s permission to do the testing.

Eric: Can you summarize the advantages of using external specialists like you to do independent testing on behalf of a telco?

Mario: This kind of testing, monitoring and quality control is not part of the core business of the carrier. By using an independent company, you get dedicated expertise, and a totally objective evaluation. A big benefit that cannot be obtained from in-house testing is that the telco can have its test results benchmarked against the results of other anonymous carriers.

Eric: Thank you for your time.