Sunday, September 10, 2017

Is it smart to use data from smart TVs?

Multichannel News has an article (It’s Time to Get the Return-Path Data Together) by Jane Clarke of CIMM on the complementary nature of audience data from STBs (set-top boxes) and smart TVs piped through ACR (automated content recognition). Generally, it’s a good idea, but some significant qualifiers come to mind:
  • VOD can be measured through STB data collection, and more than one data collection platform already supports this, if implemented correctly. However, it is unclear what any measurement on the playback device might add to proper design of the VOD system (such that all play and trickplay, and not just the original order for the programme, is reported to the server farm) and measuring from there. A smart TV, though, is going to capture some OTT traffic from devices connected using the likes of Google Chormecast, Amazon Fire TV and Roku, but unless measurement on the playback device or at the server farm is available, this will be a partial accounting—without any means of determining how partial; the proverbial little knowledge that is dangerous.
  • Likewise, the power state of the monitor, not currently available from an STB, would pertain to an unknown percentage of viewing (unless matched to same-STB data) and not be very usable for capping viewing reported by STBs. It would be far better if the STB-based data collection systems were enhanced to poll the monitor power state over HDMI, which will now be the default connection to UHD/4k as well as HD monitors. Then, as SD diminishes to zero over the coming years (faster in some countries than others), we would have real data in most cases in which currently we must use statistical approximation.
  • All smart TV ACR can reliably provide is the programme identity, and quite likely not in a format relatable to pay-TV operations (as there is little chance of a common reliable identifier; such an animal could exist but licensing policies are a big obstacle). Programmes alone are not sufficient in the present environment, in which media use is still largely organised around channels and rights flow through them as well.
  • Following Vizio’s comeuppance in court in the U.S. for undisclosed snooping, this practice has gained potential to become a slow meme, with even Consumer Reports explaining how to get rid of it. Especially with help from data-protection-sensitive Europe, this might become a common concern a little like the falsehood, often repeated in a certain genre of fiction, that a powered-off cellphone with a charged battery in place can be used to determine the location of its user. How much opt-out from measurement would render smart TVs not worth the trouble?

Internet advertising is being questioned, and some questions have no clear answers

Just as Internet advertising reached spending parity with television, large advertisers started doubting its effectiveness and cutting back, writes Nicole Sinclair in Yahoo Finance (Digital ads aren't working for big consumer brands). She lists two developments last year: a study that claimed the existence of rebates undisclosed to advertisers (kickbacks under another name) from media operators to advertising and media buying agencies (although not specific to Internet media), and Facebook’s admission that it included video views of under three seconds, exaggerating the overall viewing it reported by potentially as much as 80% (whatever that means). The article cites reductions in Internet spending by large consumer goods advertisers of, at most, 1.3% this year. Not much, perhaps, but the direction should give pause.

Individual advertising delivery cannot be measured by sample, but only by a census. This currently can only be self-administered by the carrier, and that has a credibility problem inherently, not just because of abuses. When chief executives of the half-dozen remaining global ad and media buying agencies, like Martin Sorrell of WPP, say that “the player and referee cannot be the same person” and the media operators should not “mark their own homework” (a phrase heard a lot lately), their companies presumably cannot then initiate the spending of large portions of clients’ budgets on such media. Can targeted digital advertising survive the lack of objective verification, never mind transparency of targeting decisions?


Furthermore, even objective reporting and realistic standards (unlike Facebook’s deeming of a video view any exposure longer than three seconds) might not rescue targeted advertising on the Internet. The current crop of targeting algorithms is rather obviously useless, with much irrelevance and ad nauseum repetitiveness of ads (often from an inappropriate competitor) for purchases already made. This is so despite cookies and tracking by the likes of Facebook. On Facebook itself, the problem is different—the complete irrelevance of most advertising messages—but it still means inappropriate expenditure in which advertisers pay high CPMs for targeting but get, at best, scattershot outdoor billboard delivery. Can targeting be seriously improved in a short time?

Saturday, July 27, 2013

Not every good idea is a good idea

PayPal, Tesla and SpaceX founder Elon Musk has been generating buzz for a concept he calls “hyperloop” for intercity transport, supposedly faster than subsonic aircraft (approx. one and a half times), and cheaper. Apparently the technology, to be unveiled 12 August, is based on air pressure/vacuum and magnetic acceleration. Musk has twitted that this is not a vacuum tunnel, so it must be a vacuum above-ground enclosed tube—otherwise air resistance would prevent the claimed speed and would require continuous power. Los Angeles to San Francisco is his suggestion of a first application.

Disbelief has to forcibly choked, not merely suspended, to avoid the conclusion that whatever it is, it would be far more expensive than the conventional high-speed line now being planned between these very cities as a result of a matching-funds deadly embrace between the effectively bankrupt state of California and the rescission-bound federal government. No-one claims that that project makes sense by any commercial standard. The likely ticket prices will target mostly airline passengers, of whom there are only 13,000 per day between the multiple airports in each region in both directions, split among more than half a dozen airlines—thus ensuring minimal prices. With traffic so low and priced so close to cost, one is at a loss to justify the existing rail project as sensible even in serving some significant unmet need. Musk is proposing something with far higher capital costs than air service, probably higher operating costs, and only inconsequentially higher speeds.

Yet this as-yet undeclared idea is spam du jour. Musk has transcended his real achievements (first commonly accepted electronic payment service, first and second proper electric car, first private mission to the ISS) and filled the…vacuum formerly occupied by Steve Jobs — that of the unassailable genius pronouncing ex cathedra.

It is not that Musk isn’t that, but rather that his two well-known, business-jeopardising mistakes were both due to false economies—behaviour antithetical to a high-capex project such as a hyperloop. PayPal’s inability to bring itself to pay for any meaningful customer service quickly made it the thief’s friend, before Ebay purchased it and cleaned it up. And years later at Tesla, to save an inconsequential amount, he built charging stations that were A Bridge Too Far—one rather than two on each of Washington–New York and New York–Boston, and a little too far apart between the California coast and Las Vegas. He then gave reporters $100k+ Model S cars with the best batteries and they got stuck. And stuck. And almost stuck twice. Unsurprisingly, that is what they then wrote, for the opposite effect from the desired validation of Tesla’s fitness for the real world.

The moral of this story: don’t buy hopelessly romantic technological dreams that would make Mitterand blanch from an entrepreneur who almost impaled two otherwise successful companies on fits of irrational tightfistedness.

Friday, July 26, 2013

Design and death

In Spain’s worst rail disaster in almost 70 years, 78 people are dead and 32 are in serious condition.

The high-speed ALVIA service uses a preexisting tight curve at that location, three km south of Santiago de Compostella on the Madrid-El Ferrol line. Straightening the route would have been costly, so train drivers are required to slow sharply from 200km/h to 80.

Train drivers, like car drivers, often do not do as they should. On Spain’s dedicated high-speed lines, as in many other parts of Europe, a system named ERTMS would then apply the train’s brakes. But there was no ERTMS on this section of the route, nor any alternative automatic breaking system triggered by excessive speed, such as that used extensively in the U.K. (following a spate of horrific accidents there). Instead, Spain’s old ASFA signaling system was used, which merely informs the driver that he should slow down. But the driver hadn’t been paying adequate attention.

So the driver’s failure to slow down in time on a tight curve such as this automatically and ineluctably led to an accident. It was then up to the design of the rolling stock to minimize the harm from the result.

There is a best-practices design that has successfully done this for 32 years, with only two fatalities on a single train. It is Alstom’s TGV, used in several countries including, ironically, Spain’s own first high-speed line between Madrid and Seville, where they still run. Adjacent carriages are joined by rigid membranes and ride common bogies (trucks). The entire weight of the train acts to keep every part of it upright. It also prevents the carriages from jackknifing (folding on each other), as happened both in Spain and in the similar accident in Germany in 1998. The carriages’ departure from the track at high speed into a concrete wall, their falling down on their sides, and their jackknifing were major contributors to the carnage.

The Bombardier-Talgo S730 trainset that crashed in Spain represents a nod to some of those principles but not enough of them to prevent a bloodbath. It does have a low centre of gravity. It is not made of aluminium extrusions; those tend to tear along the windows like stamps along perforations, and apparently contributed substantially to the toll in the German ICE accident. However, it is made of light aluminum that shattered on impact, the car ends were torn from their tilting suspensions, and the aft gas turbine generator engine was thrown from its dedicated carriage, landing in its entirety on the embankment above. It does use joint bogies, but these do not by themselves guarantee stability or integrity in the absence of perhaps the most important safety factor: rigid membranes between carriages. On the S730, the latter are fully articulated as on a conventional train. They are free to fall on their sides, fly into walls, collide with each other and fold like harmonicas.

This was not, as many terrible accidents are, the result of an unlikely combination of factors. Rather, this was a blatantly design-caused, foreseeable disaster. It would be unfair to say that nobody cared. However, by default we all labour under an overwhelming weight of lack of awareness of the meaning of our choices. Here, people from four companies — the train operator RENFE, track owner ADIF, Bombardier and Talgo — allowed a design to be developed and placed into service that relied entirely on the driver’s slowing down when entering that curve. If he did not pay full and timely attention — as they themselves had failed to do — or the train’s braking system failed, there would be no automation to stop him and nothing to prevent a terrible outcome.

Thursday, July 25, 2013

Leaving Las Vegas

Television — with which the average person (of course not you or I) supposedly spends hours per day — is changing much faster than befits such a dominant, time-tested institution. As media use becomes individualised, the little fish plus the Web plus streaming services are ganging up on the big fish.

The latest trend is for big terrestrial networks to threaten to switch to pay-TV distribution only (cable and DBS). So long as pay TV has near-total penetration, and pay-TV-only channels are challenging the major broadcast networks’ ratings, they say, why should we be subjected to the injustices and iniquities of regulation?

It is an obvious bluff. But not because the bluffers won’t carry out their threat if they don’t get what they want. It’s because they will carry it out even if they do. And not a moment earlier either way.

ITV, long the U.K.’s top network with a 31 full-day viewer share in 1992, has plummeted to 16 by last year (its only comparably sized competitor, BBC1, went from 25 to 20 at the end of last decade but since rose back to 23). It operates on limited-time franchises issued by a public authority. It still produces some expensive “quality” drama (although much less than it used to) and a fair bit of national and local news. Having adjudged these to be bad for its business, it started carrying the line that it was seriously thinking about leaving terrestrial distribution unless the relevant regulations were seriously relaxed. The government did not want to deal with this issue and extended ITV’s licenses until 2024.

Would ITV leave the public spectrum? What would happen to it? Its next nearest competitors BBC2 and Channel 4/S4C have shares around 7; Channel 5 has 5. The rest are at 2 or lower. And ITV is quite profitable, with a ~10% net margin last year.

Content may be king — some of that expensive programming that differentiates ITV may also permit it to soar above all but one other channel, as it still does — but it is a constitutional, primus enter pares king: pay-TV-only channels with arguably better programming, which they use against each other, cannot touch ITV, apparently because of its privileged terrestrial position. If it were to leave, it would lose access to the 46% of U.K. households that have no pay-TV, but also its disproportional appeal to those who do — based on its terrestrial distribution, ostensibly irrelevant to them. Perhaps it is the very public-service-obligation programming that it is trying to shirk that confers upon it this special status, although it may not be evident in each programme’s direct ROI. (Such indirect effects are NBC’s argument for paying for the Olympics even when they run at a loss.)

So ITV won’t leave under current conditions (barring the group insanity of its management). But it may well continue to cut programming costs and dumb down their appeal in response to declining ratings; it is the global poster child for this disease (see the previous post). And unless it stops, it may reach a point at which there won’t be much benefit to staying free-to-air.

The latest big bluffer is Fox in the U.S. It is unhappy that Aereo, a startup that streams terrestrial channels from personal antennas, refuses to pay it retransmission fees. These now approach $2.4bln but media rep SNL Kagan projects a rise to $6bln by 2018. U.S. terrestrial TV also takes in around $47bln in advertising. Fox was second this season, usually several times higher than the top pay-TV-only channel. There is no precedent for the switch of a high-cost, high-rating terrestrial network to pay-only distribution. There was, however, a high-profile failure to do what that would almost certainly require: sharply control costs. It was NBC’s replacement of drama (ER) with Jay Leno, and it failed disastrously, with affiliates criticising the network in public and replacements having to be hastily procured midseason. Network TV may be down at heels but not that down.

Aereo, precisely to avoid having to pay for retransmission, offers terrestrial channels only. As such, it supports the small but highly profitable — for terrestrial broadcasters — cohort that does not use pay TV or prefers not to use it. Aereo offers essentially an extension of conventional terrestrial distribution, for which, of course, there are no retransmission fees. The good news for the networks and their affiliates are the huge profits they make, burdened by little or no competition, off those 15% of U.S. households (and a larger percentage of viewers, now that viewing has largely become individual). The day may come when the networks conclude they have nothing to lose by abandoning terrestrial distribution; that day is still very far, and services like Aereo would not be a factor because, far from harming the networks, they restore their glory days of oligopoly — among subscribers. Until then, Fox would be nuts to move to pay TV, but it may be right in considering members of Congress and federal appellate judges daft enough to think that it would.

Monday, July 22, 2013

No news is better than good news

Large terrestrial television networks have for many years been losing audience across the industrialised world. Those with the highest programming costs — in the U.S. and the U.K. — are on a vicious cycle of declining revenues that lead to less attractive programming, rinse, repeat. ITV in the U.K. is barely recognisable from twenty years ago, La Cinq in France is long dead, The WB and UPN in the U.S. were shut down and merged into the barely profitable CW, and the country’s most-watched network on Fridays, and in the crucial 18–34 demo on other days, is now routinely the Spanish-language Univisión. Heading a major terrestrial network has become a very stressful job.

The same is happening in Russia. The top three terrestrial networks, Channel One, Russia 1 and NTV, had a combined 55.4 full-day audience share in 2005 (full-year and regardless of means of distribution) in the country’s TNS TV Index. By 2008, this dropped to 51.3. Then the rate of decline doubled, and in 2012, the three networks had a 41.0 share. At this rate, they would drop to zero in 16 years (of course they won’t but they can easily engage a vicious circle that would render them irrelevant to most).

The main reason for the big three’s decline over time seems to be their heavy bias towards older viewers. They had a 53.4 share in Jan.–Oct. 2012 among people 55+ (life expectancy there is 64.3 for men and 76.1 for women, so this cohort is proportionally smaller than in most other industrialised countries), 39.4 among people of ages 35–54, 29.9 among those 18–34, and 17.0 among children 4–17.

This is interesting not just from the perspective of broadcast management. Almost from his election in 2000, Vladimir Putin has based his autocracy on near-total control of these three networks, which he quickly established, and on the dissuasion of other terrestrial networks from any informational role (the runner-up TNT and STS networks are tolerated because they have no news programming; the once-critical REN was acquired by a progovernment owner and largely neutered). On the big three, the opposition that has emerged since the fraudulent parliamentary elections in December 2011 is occasionally pilloried as foreign agents but usually not mentioned at all. Of the several protest events since then that brought out more than 100,000 Muscovites, only one was mentioned — briefly — on two of those channels, and only because their news staff threatened to strike. The third canceled its main newscast that day. The leading opposition figure Alexei Navalny is blacklisted from any mention; his arrest last week after being sentenced to five years in prison on a trumped-up charge was covered — briefly — on just one of the big three. The Russia visible on these screens has no meaningful political choice at all.

Putin has relied heavily on the support of older, poorer and provincial Russians, most of whom vote either for him and the majority United Russia Party or for the declawed and controlled Communist Party. These are thought to watch mostly the  terrestrial channels: many cannot afford pay TV and have no interest in other channels anyway; few of them use the Internet. He is known to review only the newscasts of the big three networks, usually to the exclusion of any other media.

If the régime doesn’t topple earlier, the big three could lose half of their remaining share by the time Putin seeks reelection in 2018. If they do, television news will cease being a regular item on the menu of most Russians — an unprecedented development in the industrialised world. What will be the effect of the loss of the country’s main source of information?

The TNS report, in Russian, is at http://tnsglobal.ru/media/content/B7525726-B5E1-4C12-BE25-4C543F42F3EE/TV%20in%20Russia.pdf .

Sunday, July 21, 2013

Living by one’s wits

Conventional wisdom often can’t keep up with reality. The U.S. may have lost much of its manufacturing base but still exports a lot of high-tech manufactured goods (aerospace, computers, pharmaceuticals, scientific instruments, electrical machinery, etc.). Right?

Not as much as it used to and, relative to its population, less than practically all other major industrialised countries. Here are such exports per capita (click to enlarge):
Source: World Bank analysis of the United Nations Comtrade database, http://data.worldbank.org/indicator/TX.VAL.TECH.MF.ZS/countries . Population data compiled in Wikipedia, which see for sources, http://en.wikipedia.org/wiki/List_of_countries_by_population .

Singapore earns half its GDP from high-tech exports; the U.S.—less than 1%. This would not be so alarming had the U.S. not had a huge balance-of-trade deficit. Singapore, of course, has a large surplus.

Now here’s how the major exporters of high-tech manufactured goods (above $50bln/year) are trending:
Takeaways:
  1. China is on a tear, exporting half the total of the other majors combined and growing rapidly. High-tech goods now make up 26% of all its manufactured exports; the U.S. fraction is only 18%.
  2. Almost all the other majors are growing except the U.S., which is now third behind Germany, a country almost four times less populous.
  3. The U.S. topped out in the middle of the last decade and dropped sharply in the first year of the economic crisis, from where it hasn’t recovered.
Furthermore, the majors are not very major, having accounted for only 23% of high-tech manufactured exports (not consumption) by value in 2010 (the latest year for which complete data are available). Manufacturing dependent on high tech is already widely spread around the industrialised countries — and many others.

Like most statistics, these numbers lie, and in a very specific way. When one country (e.g. China) exports manufactured goods (e.g. computers) made possible by R&D conducted in other countries (e.g., the U.S. and Europe), it is the exporting country that books the value of the finished goods (computers). The foreign R&D contributors book little: a much smaller value for microchips exported to China for inclusion in the computer, and no value at all for the motherboard and graphics card made there under license or, probably, any of the software. The same principle applies to exports of pharmaceuticals (from, e.g., India) developed elsewhere (e.g., the U.S. or Europe). This is how China can rack up these enormous numbers while not really being competitive (yet) with the U.S. in producing high-end high-tech manufactured goods (aerospace, medical devices etc.).

However, recognising this lie results in another lie. Money, in the balance of trade, is money. Unlike China, the U.S. has a huge deficit in its trade with the rest of the world (specifically, with China). It doesn’t matter that the U.S. developed a product of interest to other countries if it cannot use most of its value to cover that gap. Of course, it could develop more products and try to live by its R&D capacity alone, but that is clearly not happening.