Comcast files their compliance plan

Today was the deadline for Comcast to tell the FCC how its existing congestion management system works, as well as how its “protocol agnostic” replacement is going to work. To the dismay of some critics, they’ve done just that in a filing that was hand-delivered as well as electronically filed today. It will be posted to the Comcast web site shortly.

The filing corrects some of the false allegations made by critics with respect to privacy, making it very clear that the existing system simply inspects protocol headers (“envelopes”) and not personal data. David Reed in particular got himself worked into a tizzy over the idea that Comcast was deciding which streams to delay based on content, but this is clearly not the case. Inside the IP envelope sits a TCP envelope, and inside that sits a BitTorrent envelope. User data is inside the BitTorrent (or equivalent) envelope, and Comcast doesn’t look at it.

The current system sets a bandwidth quota for P2P, and prevents P2P as a group from crossing the threshold from this quota (about 50% of total upstream bandwidth) with new uni-directional upload (AKA, file-server-like) streams by tearing down requested new streams with the TCP Reset bit. The system is a bit heavy-handed, but reserving 50% of the network for one class of application seems pretty reasonable, given that no more than 20% of customers use P2P at all.

Nonetheless, the new system will not look at any headers, and will simply be triggered by the volume of traffic each user puts on the network and the overall congestion state of the network segment. If the segment goes over 70% utilization in the upload direction for a fifteen-minute sample period, congestion management will take effect.

In the management state, traffic volume measurement will determine which users are causing the near-congestion, and only those using high amounts of bandwidth will be managed. The way they’re going to be managed is going to raise some eyebrows, but it’s perfectly consistent with the FCC’s order.

High-traffic users – those who’ve used over 70% of their account’s limit for the last fifteen minutes – will have all of their traffic de-prioritized for the next fifteen minutes. While de-prioritized, they still have access to the network, but only after the conforming users have transmitted their packets. So instead of bidding on the first 70% of network bandwidth, they’ll essentially bid on the 30% that remains. This will be a bummer for people who are banging out files as fast as they can only to have a Skype call come in. Even if they stop BitTorrent, the first fifteen minutes of Skyping are going to be rough. A more pleasant approach would be to let excessive users out of QoS jail with credit for good behavior – if their utilization drops to Skype level, let them out in a few seconds, because it’s clear they’ve turned off their file sharing program. This may be easier said than done, and it may raise the ire of Kevin Martin, given how irrational he is with this anti-cable vendetta.

The user can prevent this situation from arising, of course, if he wants to. All he has to do is set the upload and download limits in BitTorrent low enough that he doesn’t consume enough bandwidth to land in the “heavy user” classification and he won’t have to put up with bad VoIP quality. I predict that P2P applications and home gateways are going to incorporate controls to enforce “Comcast friendly” operation to prevent de-prioritization. There are other more refined approaches to this problem, of course.

At the end of the day, Comcast’s fifteen/fifteen system provides users with the incentive to control their own bandwidth appetites, which makes it an “end-to-end” solution. The neutralitarians should be happy about that, but it remains to be seen how they’re going to react.

It looks pretty cool to me.

UPDATE: Comcast-hater Nate Anderson tries to explain the system at Ars Technica. He has some of it right, but doesn’t seem to appreciate any of its implications. While the new system will not look at protocol headers (the evil “Deep Packet Inspection” that gets network neophytes and cranks so excited) , and it won’t use TCP Resets, that doesn’t mean that P2P won’t be throttled; it will.

That’s simply because P2P contributes most of the load on residential networks. So if you throttle the heaviest users, you’re in effect throttling the heaviest P2P users, because the set of heavy users and the set of heavy P2P users is the same set. So the “disparate impact” will remain even though the “disparate treatment” will end.

But the FCC has to like it, because it conforms to all of Kevin Martin’s rabbit-out-the-hat rules. The equipment Comcast had had to purchase for this exercise in aesthetic reform will have utility down the road, but for now it’s simply a tax imposed by out-of-control regulators.

Ars Technica botches another story

Why is it so hard for the tech press report on the broadband business with some semblance of accuracy? I know some of this stuff is complicated, but if it’s your business to explain technology and business developments to the public, isn’t it reasonable to suppose you’re going to get the facts right most of the time?

Case in point is Matthew Lasar at Ars Technica, the hugely popular tech e-zine that was recently purchased by Conde Nast/Wired for $25 million, healthy bucks for a web site. Lasar is a self-appointed FCC watcher who seems to consistently botch the details on targets of FCC action. The most recent example is a story about a clarification to AT&T’s terms of use for its U-Verse triple play service. The update advises customers that they may see a temporary reduction in their Internet download speed if they’re using non-Internet U-Verse television or telephone services that consume a lot of bandwidth. Lasar has no idea what this means, so he turns to Gizmodo and Public Knowledge for explanation, and neither of them gets it either. So he accepts a garbled interpretation of some AT&T speak filtered through Gizmodo’s misinterpretation as the gospel truth of the matter:

Ars contacted AT&T and was told by company spokesperson Brad Mays that the firm has no intention of “squeezing” its U-verse customers. “It’s more a matter of the way data comes into and travels around a home,” Mays said. “There are things (use of PCs, video, etc.) that can impact the throughput speed a customer gets. We are not doing anything to degrade the speed, it’s just a fact of the way data travels.”

The AT&T guy is trying to explain to Lasar that U-Verse TV uses the same cable as U-Verse Internet, but U-Verse TV has first call on the bandwidth. The cable’s bandwidth is roughly 25 Mb/s, and HDTV streams are roughly 8 Mb/s. If somebody in your house is watching two HDTV shows, 16 of that 25 is gone, and Internet can only use the remaining 9, which is a step down from the 10 Mb/s that it can get if you’re running one HDTV stream alongside an SDTV stream.

This isn’t a very complicated issue, and it shouldn’t be so muddled after multiple calls to AT&T if the writers in question were mildly up-to-speed on IPTV.

Lasar botched another recent story on Comcast’s agreement with the Florida Attorney General to make its monthly bandwidth cap explicit as well, claiming that Comcast had adopted the explicit cap in a vain attempt to avoid a fine:

Ars contacted the Florida AG about this issue, and received the following terse reply: “We believe the change pursuant to our concerns was posted during our investigation.” When asked whether this means that when the AG’s probe began, Comcast didn’t post that 250GB figure, we were told that the aforementioned one sentence response explains everything and to have a nice day.

In fact, the cap was part of its agreement with Florida, as the AG’s office explains on its web site:

Under today’s settlement, reached with Comcast’s full cooperation, the company has agreed not to enforce the excessive use policy without prior clear and conspicuous disclosure of the specific amount of bandwidth usage that would be considered in violation of the policy. The new policy will take effect no later than January, 1, 2009.

And everybody who follows the industry knows that. The Comcast cap is also less meaningful than Lasar reports, since Comcast says they’re only going to get tough on customers in excess of the cap who are also in the top 1% of bandwidth consumers, so simply going over 250 GB won’t get you in trouble at the future date in which everyone is doing it.

The tech press in general and Ars Technica in particular needs to upgrade its reporting standards. It’s bad enough when Ars trots out opinion pieces on network neutrality by Nate Anderson thinly disguised as reporting; most sensible readers understand that Anderson is an advocate, and take his “reporting” with the necessary mix of sodium chloride. But Anderson doesn’t consistently get his facts wrong the way Lasar does.

It would be wise for Ars to spend some of the Conde Nast money on some fact-checkers, the better to avoid further embarassment. We understand that Gizmodo is simply a gadget site that can’t be counted on for deep analysis, and that Public Knowledge is a spin machine, but journalists should be held to a higher standard.

Technorati Tags: , ,

Our Efforts Bearing Fruit

Regular readers are aware of my Op-Ed criticizing Google’s rapacious ways, written for the San Francisco Chronicle and subsequently re-printed in the Washington Times. That doesn’t happen too often, BTW. The Wall St. Journal reports that the Justice Department is paying attention:

WASHINGTON — The Justice Department has quietly hired one of the nation’s best-known litigators, former Walt Disney Co. vice chairman Sanford Litvack, for a possible antitrust challenge to Google Inc.’s growing power in advertising.

Mr. Litvack’s hiring is the strongest signal yet that the U.S. is preparing to take court action against Google and its search-advertising deal with Yahoo Inc. The two companies combined would account for more than 80% of U.S. online-search ads.

Google shares tumbled 5.5%, or $24.30, to $419.95 in 4 p.m. trading on the Nasdaq Stock Market, while Yahoo shares were up 18 cents to $18.26.

For weeks, U.S. lawyers have been deposing witnesses and issuing subpoenas for documents to support a challenge to the deal, lawyers close to the review said. Such efforts don’t always mean a case will be brought, however.

An 80% market share in search ads is not good for democracy, of course, so we applaud the impending suit in advance.

Technorati Tags: , ,

Kevin Martin threatens Comcast

Kevin Martin is upset that Comcast has challenged his authority by filing a lawsuit against the FCC for making up law out of thin air. The Chairman of the FCC expressed his scorn by releasing a statement that makes him sound like one of the dumbest men in America:

“Given Comcast’s past failure to disclose its network management practices to its customers, it is important Comcast respond to the many still-unanswered questions about its new management techniques,” Martin warned in a statement released this afternoon. Most notably, what exactly does Comcast mean when it says it will have a “protocol agnostic” management system in place by the end of the year?

And as for the bandwidth limits that Comcast has now announced: “How will consumers know if they are close to a limit?” Martin asked. “If a consumer exceeds a limit, is his traffic slowed? Is it terminated? Is his service turned off?”

Let’s see if we can help the Chairman:

1. The “end of the year” is December 31, at midnight. In urban areas, people will make noise and drink a lot. It would be good for Kevin Martin to be among them.

2. Comcast has said they’ll write a *very mean letter* to customers over the 250 GB limit and among the top 1% in bandwidth consumption. It was in the papers, but not on the funny page.

3. I won’t define “protocol agnostic” as that subject was covered, at length, the order the FCC’s lawyers wrote in the Comcast matter. Martin should have one of them explain it to him.

Where did Bush find this person?

Comcast Appeals

Comcast has appealed the FCC’s crazy order in the DC Circuit today. Here’s the statement:

Although we are seeking review and reversal of the Commission’s network management order in federal court, we intend to comply fully with the requirements established in that order, which essentially codify the voluntary commitments that we have already announced, and to continue to act in accord with the Commission’s Internet Policy Statement. Thus, we intend to make the required filings and disclosures, and we will follow through on our longstanding commitment to transition to protocol-agnostic network congestion management practices by the end of this year. We also remain committed to bringing our customers a superior Internet experience.

We filed this appeal in order to protect our legal rights and to challenge the basis on which the Commission found that Comcast violated federal policy in the absence of pre-existing legally enforceable standards or rules. We continue to recognize that the Commission has jurisdiction over Internet service providers and may regulate them in appropriate circumstances and in accordance with appropriate procedures. However, we are compelled to appeal because we strongly believe that, in this particular case, the Commission’s action was legally inappropriate and its findings were not justified by the record.

It’s a little odd that they have to appeal to resolve the procedural irregularities despite planning to follow the order anyhow. But that’s life.

Media Access Project has already filed appeals in the 2nd, 3rd, and 9th circuits, in an attempt to create a jurisdiction fight that would have to be resolved by the Supremes. MAP wants the court to waive the phase out period for Comcast’s Sandvine system, but that’s simply a pretext for the jurisdiction fight.

Story in Broadcasting and Cable.

Your broadband service is going to get more expensive

See my article in The Register to understand why your broadband bill is going to rise:

Peer-to-peer file sharing just got a lot more expensive in the US. The FCC has ordered Comcast to refrain from capping P2P traffic, endorsing a volume-based pricing scheme that would “charge the most aggressive users overage fees” instead. BitTorrent, Inc. reacted to the ruling by laying-off 15 per cent of its workforce, while network neutrality buffs declared victory and phone companies quietly celebrated. Former FCC Chairman Bill Kennard says the legal basis of the order is “murky.”

Comcast will probably challenge on grounds that Congress never actually told the regulator to micro-manage the Internet. In the absence of authority to regulate Internet access, the Commission has never had a need to develop rules to distinguish sound from unsound management practice. The order twists itself into a pretzel in a Kafka-esque attempt to justify sanctions in the absence of such rules.
Technically speaking, they’re very confused

The FCC’s technical analysis is puzzling, to say the least.

The order describes an all-powerful IP envelope, seeking to evoke an emotional response to Deep Packet Inspection. The order claims the DPI bugaboo places ISPs on the same moral plane as authoritarian regimes that force under-aged athletes into involuntary servitude. But this is both uninformed and misleading. Network packets actually contain several “envelopes”, one for each protocol layer, nested inside one another like Russian dolls. Network management systems examine all envelopes that are relevant, and always have, because there’s great utility in identifying protocols.

The FCC’s order is especially bad for people who use both P2P and Skype. The comments lack the usual snarkiness, and I don’t know if that’s good or bad.

UPDATE: Right on cue, a price war is breaking out between cable and phone companies, according to the Wall St. Journal. I wonder if the converts are going to be the high-volume users worried about the caps, or the nice, low volume grannies every carrier wants.

Technorati Tags: , ,

The best broadband in the world

I ran the Speedmatters test on my Comcast connection today, just for the fun of it (OK, I’m bored with this Obama vs. the Moose Hunter stuff.) This test is sponsored by the Communication Workers union, as an argument for taxpayer subsidies for broadband. The results I got are not what they’re hoping for:

So my little Comcast account is faster than all that fiber in Japan and Korea.

So why all the whining?

Comcast defines “excessive use”

Comcast has modified its terms of use to clarify that “excessive use” is 250 GB per month. If you download more than this, and are on the list of heaviest users, you’ll get a letter from Comcast telling you to dial it back. If you don’t you’ll be canned. Over-limit fees are not part of the deal:

In May when the cap was first rumored, there was also buzz that Comcast might try to charge customers $15 for every 10GB they went over the limit. As far as we can tell from Comcast’s announcement and the accompanying FAQ page, that is not the case… yet, anyway. Even so, Comcast’s honesty with the 250GB cap will probably only go so far, and customers with the option to do so may end up turning to an ISP such as AT&T, Verizon, or Qwest that has the infrastructure available to offer broadband without bandwidth limits.

Most people will never come anywhere close to 250 GB, but there’s a lot of adverse reaction to this plan, mainly on the issue of Comcast making it hard for you to know how much you’ve used in the current month. You may be able to get this info from your home router, but there’s no guarantee.

Regarding the threat of heaviest users to take their business elsewhere, I;m guessing Comcast won’t miss them a whole lot.

Technorati Tags: , , ,

Guardian takes on the Google myth

David Smith confronts the Google myth for The Observer, including accounts of the pilgramages politicians take to Google HQ:

Shortly after Obama’s pilgrimage to the ‘Googleplex’, it was the turn of David Cameron. Cameron was accompanied there by Steve Hilton, his director of strategy, who has since moved permanently to California with his wife, Rachel Whetstone, Google’s vice-president of global communications and public affairs (she is also godmother to Cameron’s eldest son, Ivan). Andrew Orlowski, executive editor of the technology website The Register, says: ‘The web is a secular religion at the moment and politicians go to pray at events like the Google Zeitgeist conference. Any politician who wants to brand himself as a forward-looking person will get himself photographed with the Google boys.’

Washington, also, is keen to bathe in Google’s golden light. Al Gore, the former Vice-President, is a long-time senior adviser at the company. Obama has been taking economic advice from Google CEO Eric Schmidt and received generous donations from Google and its staff. Google will be omnipresent at the Democratic and Republican national conventions, providing software for delegates such as calendars, email and graphics. ‘Google has moved into the political world this year,’ says its director of policy communications, Bob Boorstin, a former member of the Clinton administration.

Google’s staff in Washington include five lobbyists, among them Pablo Chavez, former general counsel for John McCain. This year Google moved into new 27,000-square-foot headquarters in one of Washington’s most fashionable, eco-friendly buildings. Visiting senators and congressmen can now share in the famed ‘googly’ experience of free gourmet lunches, giant plasma screens and a game room, named ‘Camp David’, stocked with an Xbox 360 and pingpong.

None of this much impressed Jeff Chester, the executive director of the small but influential Center for Digital Democracy, when he was invited there. ‘It puts all the other lobbying operations to shame,’ he says. ‘They invite politicians into their Washington HQ to give advice on using Google to win re-election. It is the darling of the Democratic Party and there’s no doubt that a win by Obama will strengthen Google’s position in Washington.’

Undeterred by criticisms of his benefactor, Google’s professor of piracy rights, Larry Lessig, congratulates Google’s boys at the FCC for protecting the Google monopoly in a rare foray into the world of the written word. It’s quite amusing and utterly deranged.

Technorati Tags: , , .

FCC finally issues Comcast memo

Kevin Martin and his Democratic Party colleagues at the FCC have issued their Comcast order, available at this link. They find some novel sources of authority and apply some interesting interpretations of the facts. I’ll have some detailed commentary after I’ve read it all and checked the footnotes. It’s an amusing exercise, if you like that sort of thing.

For a good summary of the order, see IP Democracy.