From the beginning — that is, since the advent of the net neutrality concept early last decade — I argued that a strict neutrality regime would have outlawed, among other important technologies, CDNs, which prioritized traffic and made (make!) the Web video revolution possible.

So I took particular notice of this new interview (sub. required) with Akamai CEO Paul Sagan in the February 2011 issue of MIT’s Technology Review:

TR: You’re making copies of videos and other Web content and distributing them from strategic points, on the fly.

Paul Sagan: Or routes that are picked on the fly, to route around problematic conditions in real time. You could use Boston [as an analogy]. How do you want to cross the Charles to, say, go to Fenway from Cambridge? There are a lot of bridges you can take. The Internet protocol, though, would probably always tell you to take the Mass. Ave. bridge, or the BU Bridge, which is under construction right now and is the wrong answer. But it would just keep trying. The Internet can’t ever figure that out — it doesn’t. And we do.

There it is. Akamai and other content delivery networks (CDNs), including Google, which has built its own CDN-like network, “route around” “the Internet,” which “can’t ever figure . . . out” the fastest path needed for robust packet delivery. And they do so for a price. In other words: paid priority. Content companies, edge innovators, basement bloggers, and poor non-profits who don’t pay don’t get the advantages of CDN fast lanes.

So important are CDNs in today’s Internet architecture that the FCC felt the need to explicitly exempt them. So much for a “neutral” policy.

In footnote 235 and elsewhere, the FCC seems to think CDNs are all about geographic advantages (to overcome speed-of-light delay) and server-consolidation (yielding infrastructure efficiencies to content and app providers). True enough, but the FCC ignores what Sagan believes is his key service — real-time prioritization.

The net neutrality Order allows CDN prioritization but says paid priority by broadband service providers on the customer link “would raise significant cause for concern,” and “as a general matter, it is unlikely that pay for priority would satisfy the ‘no unreasonable discrimination’ standard.”

Numerous legal infirmities are likely to kill the entire Order when reviewed by the courts. But the substantive technological problems and inconsistencies embodied in the paid priority section need to be examined. Parsing these items should help us all understand how this very complex thing we call the Internet works . . . perhaps chasten the FCC when it attempts to enforce its new rule . . . and hopefully inform a better policy should this Order be vacated.

The FCC fails to explain persuasively why CDN prioritization is much different from last-mile broadband prioritization. Even if a meaningful distinction were demonstrated, we’d still be left with a probable ban on last-mile prioritization, which is a problem because last-mile prioritization will likely prove essential for a variety of real-time communication services.

The FCC’s case really rests on Section II.B, which is all about the supposed motives of broadband service providers. Apparently, the FCC thinks CDNs should be exempt because they have no malign intent whereas broadband service providers are awash in “incentives to limit Internet openness.”

The FCC says broadband providers may have incentives to

(1) disadvantage some edge providers by blocking or controlling the transmission to end-users;

(2) charge edge providers for access or priority to end-users; and

(3) “degrade or decline to increase the quality of the service they provide to non-prioritized traffic.”

The “no blocking” principle that all parties agreed to way back in 2005 would seem to take care of ominous incentive (1). And a much simpler reliance on existing consumer and/or antitrust law could easily defang ominous incentives (2) and (3).

But these specifics fail to address the larger point: Is it even true that most incentives steer broadband service providers toward a less open Internet? Did the FCC even consider incentives that point in the opposite direction — toward a more open Internet? I can’t find any evidence they did.

The FCC apparently cannot see that the vast bounty of content and apps on the Web created an entirely new market for telcos and cablecos. Namely, broadband Internet access. (Of course, in the typical two-sided coin of positive-sum innovation, it was broadband that created a new market for content and apps.)

As I wrote in The Wall Street Journal way back in 2006:

Blocking and degrading Internet access would quite simply be business suicide for incumbent service providers. Compared to cable’s other content operations like basic and premium TV channels, its broadband cable modem services are more than 50 times as profitable per unit of bandwidth consumed. This means that with just a tiny sliver of the usable bandwidth in its pipes, cable’s Internet services supply about 20% of the revenue and the majority of their net income. Does anyone really think the bandwidth providers are going to kill their golden goose?

Yes, it’s true that popular broadband Internet services also cannibalize some existing products. Long distance voice went away, and Web video is now beginning to compete with cable TV. But the telcos and cablecos know they will never be the key creators of content and apps — not compared to the rest of the world. They get the wonderful Web for free. Compared to hefty sums they must pay for TV content (e.g., ESPN) or movies, broadband access is a simple business. Why decimate the value of one of their three basic products (the others being TV and mobile) by closing off big chunks of the Web to their customers? It would be dumb. It won’t happen. It hasn’t happened.

So the FCC twists itself in pretzels trying to use a high-minded “net neutrality” or “open Internet” policy to do what it really wants — the much more vulgar task of regulating the telcos and cablecos — while exempting (for now) technologies and services that it knows are absolutely essential to a well-functioning Internet but are not at all “neutral” or “open” according to the FCC’s own criteria.

I’m glad CDNs are not covered by the rules, but in its feeble attempt to explain the broadband-CDN distinction, the FCC overlooked the fact that the no-priority rules could limit or block innovation in key real-time communications services.

CDNs are good for speeding static content and even putting some broadcast content (like live sports events) onto fast-lanes to consumers. (Akamai’s record traffic day to that point was its Web broadcast of the Masters golf tournament last spring.) But when it comes to decentralized, real-time, interactive, unpredictable, transactional content — like high-resolution video conferencing or online gaming — CDNs won’t do. We will need some form of in-stream prioritization.

But this is a matter of engineering and economics. There are several ways to achieve quality-of-experience for multimedia applications. We can create virtual (logical) channels using packet priority technologies. We can dedicate frequency (analog) channels using cable-TV like banding or, in the optical realm, wavelength division multiplexing (WDM) within a wire. Or we can deploy more wires (or wireless spectrum). There are technical and financial tradeoffs between using computer power (switching) and communications power (bandwidth) to achieve these ends. They depend on the state of the existing infrastructure, the cost-performance ratios of the technologies and resources (which change over time), and the strategic architecture and business model of the network. In the end we will either prioritize digitally on the last-mile link or prioritize incoming/outgoing traffic onto/from a frequency channel just outside the FCC “no priority” zone. But that will then raise the question of whether providing such channels is itself paid priority. Do we begin to see why these are not questions that can be answered by crude politics?

By exempting CDNs, the FCC acknowledges their herculean task in delivering multimedia to the masses. Akamai cogently described the state of play when unveiling its new HD video service:

Why is it so difficult to deliver an optimal end-user experience? Simply put, it’s challenging to reliably deliver high-throughput data streams across the Web – especially to large audiences.

The fundamental challenges of online video delivery lie within the Internet itself. Given that the Internet is made up of over 13,000 competing networks, it works surprisingly well. But its many bottlenecks and capacity limitations are unpredictable and difficult to manage – lying outside the control of any single entity or group. While these problems affect the delivery of all types of Internet content, they are particularly challenging for video, which requires the transfer of large data volumes at very high rates.

But if delivering static and broadcast content is a challenge, doubly so for the coming wave of real-time interactive cinema-quality video. It’s a challenge CDNs cannot conquer and will require new technologies, architectures, and business models — many of them requiring some form of broadband prioritization — to master.

It would be a shame if the FCC’s new Order interrupted this essentially technological and economic story because of a dubious analysis that narrowly focuses on the supposed political motivations of broadband service providers and completely ignores powerful incentives pushing all parties toward Internet openness.

Despite the Federal Communications Commission’s “net neutrality” announcement this week, the American Internet economy is likely to survive and thrive. That’s because the new proposal offered by FCC chairman Julius Genachowski is lacking almost all the worst ideas considered over the last few years. No one has warned more persistently than I against the dangers of over-regulating the Internet in the name of “net neutrality.”

In a better world, policy makers would heed my friend Andy Kessler’s advice to shutter the FCC. But back on earth this new compromise should, for the near-term at least, cap Washington’s mischief in the digital realm.

. . .

The Level 3-Comcast clash showed what many of us have said all along: “net neutrality” was a purposely ill-defined catch-all for any grievance in the digital realm. No more. With the FCC offering some definition, however imperfect, businesses will now mostly have to slug it out in a dynamic and tumultuous technology arena, instead of running to the press and politicians.

In a speech this morning, FCC chair Julius Genachowski outlined a proposal he hopes the other commissioners will approve at their December 21 meeting. The proposal, which comes more than a year after the FCC issued its Notice of Proposed Rule Making into “Preserving the Open Internet,” appears mostly to codify the “Four Principles” that were agreed to by all parties five years ago. Namely:

• No blocking of lawful data, websites, applications, services, or attached devices.
• Transparency. Consumers should know what the services and policies of their providers are, and what they mean.
• A prohibition of “unreasonable discrimination,” which essentially means service providers must offer their products at similar rates and terms to similarly situated customers.
• Importantly, broadband providers can manage their networks and use new technologies to provide fast, robust services. Also, there appears to be even more flexibility for wireless networks, though we don’t yet know the details.

(All the broad-brush concepts outlined today will need closer scrutiny when detailed language is unveiled, and as with every government regulation, implementation and enforcement can always yield unpredictable results. One also must worry about precedent and a new platform for future regulation. Even if today’s proposal isn’t too harmful, does the new framework open a regulatory can of worms?)

So, what appears to be off the table? Most of the worst proposals that have been flying around over the last year, like . . .

• Reclassification of broadband as an old “telecom service” under Title II of the Communications Act of 1934, which could have pierced the no-government seal on the Internet in a very damaging way, unleashing all kinds of complex and antiquated rules on the modern Net.
• Price controls.
• Rigid nondiscrimination rules that would have barred important network technologies and business models.
• Bans of quality-of-service technologies and techniques (QoS), tiered pricing, or voluntary relationships between ISPs and content/application/service (CAS) providers.
• Open access mandates, requiring networks to share their assets.

Many of us have long questioned whether formal government action in this arena is necessary. The Internet ecosystem is healthy. It’s growing and generating an almost dizzying array of new products and services on diverse networks and devices. Communications networks are more open than ever. Facebook on your BlackBerry. Netflix on your iPad. Twitter on your TV. The oft-cited world broadband comparisons, which say the U.S. ranks 15h, or even 26th, are misleading. Those reports mostly measure household size, not broadband health. Using new data from Cisco, we estimate the U.S. generates and consumes more network traffic per user and per capita than any nation but South Korea. (Canada and the U.S. are about equal.) American Internet use is twice that of many nations we are told far outpace the U.S. in broadband. Heavy-handed regulation would have severely depressed investment and innovation in a vibrant industry. All for nothing.

Lots of smart lawyers doubt the FCC has the authority to issue even the relatively modest rules it outlined today. They’re probably right, and the question will no doubt be litigated (yet again), if Congress does not act first. But with Congress now divided politically, the case remains that Mr. Genachowski’s proposal is likely the near-term ceiling on regulation. Policy might get better than today’s proposal, but it’s not likely to get any worse. From what I see today, that’s a win for the Internet, and for the U.S. economy.

— Bret Swanson

• Does the U.S. really rank 15th — or even 26th — in the world in broadband? No.
• The U.S. generates and consumes substantially more IP traffic per Internet user and per capita than any other region of the world.
• Among individual nations, only South Korea generates significantly more IP traffic than the U.S. (Canada and the U.S. are equal.)
• U.S. wired and wireless broadband networks are among the world’s most advanced, and the U.S. Internet ecosystem is healthy and vibrant.
• Latency is increasingly important, as demonstrated by a young company called Spread Networks, which built a new optical fiber route from Chicago to New York to shave mere milliseconds off the existing fastest network offerings. This example shows the importance — and legitimacy — of “paid prioritization.”
• As we wrote: “One way to achieve better service is to deploy more capacity on certain links. But capacity is not always the problem. As Spread shows, another way to achieve better service is to build an entirely new 750-mile fiber route through mountains to minimize laser light delay. Or we might deploy a network of server caches that store non-realtime data closer to the end points of networks, as many Content Delivery Networks (CDNs) have done. But when we can’t build a new fiber route or store data — say, when we need to get real-time packets from point to pointover the existing network — yet another option might be to route packets more efficiently with sophisticated QoS technologies.”
• Exempting “wireless” from any Net Neutrality rules is necessary but not sufficient to protect robust service and innovation in the wireless arena.
• “The number of Wi-Fi and femtocell nodes will only continue to grow. It is important that they do, so that we might offload a substantial portion of traffic from our mobile cell sites and thus improve service for users in mobile environments. We will expect our wireless devices to achieve nearly the robustness and capacity of our wired devices. But for this to happen, our wireless and wired networks will often have to be integrated and optimized. Wireline backhaul — whether from the cell site or via a residential or office broadband connection — may require special prioritization to offset the inherent deficiencies of wireless. Already, wireline broadband companies are prioritizing femtocell traffic, and such practices will only grow. If such wireline prioritization is restricted, crucial new wireless connectivity and services could falter or slow.”
• The same goes for “specialized services,” which some suggest be exempted from new Net Neutrality regulations. Again, necessary but not sufficient.
• “Regulating the ‘basic’ Internet but not ’specialized’ services will surely push most of the network and application innovation and investment into the unregulated sphere. A ’specialized’ exemption, although far preferable to a Net Neutrality world without such an exemption, would tend to incentivize both CAS providers and ISPs service providers to target the ’specialized’ category and thus shrink the scope of the ‘open Internet.’ In fact, although specialized services should and will exist, they often will interact with or be based on the ‘basic’ Internet. Finding demarcation lines will be difficult if not impossible. In a world of vast overlap, convergence, integration, and modularity, attempting to decide what is and is not ‘the Internet’ is probably futile and counterproductive. The very genius of the Internet is its ability to connect to, absorb, accommodate, and spawn new networks, applications and services. In a great compliment to its virtues, the definition of the Internet is constantly changing.”

What we have here is “mission creep.” First, Net Neutrality was about an “open Internet” where no websites were blocked or degraded. But as soon as the whole industry agreed to these perfectly reasonable Open Web principles, Net Neutrality became an exercise in micromanagement of network technologies and broadband business plans. Now, Louderback wants to go even further and regulate prices. But there’s still more! He also wants to regulate the products that broadband providers can offer.

A Net Neutrality regime will not make the Internet more “open.” The Internet is already very open. More people create and access more content and applications than ever before. And with the existing Four Principles in place, the Internet will remain open. In fact, a Net Neutrality regime could close off large portions of the Internet for many consumers. By intruding in technical infrastructure decisions and discouraging investment, Net Neutrality could decrease network capacity, connectivity, and robustness; it could increase prices; it could slow the cycle of innovation; and thus shut the window to the Web on millions of consumers. Net Neutrality is not about openness. It is far more accurate to say it is about closing off experimentation, innovation, and opportunity.

Hooray. We live in a nation of laws and elected leaders, not a nation of unelected leaders making up rules for the rest of us as they go along, whether in response to besieging lobbyists or the latest bandwagon circling the block hauled by Washington’s permanent “public interest” community.

This was the reassuring message yesterday from the D.C. Circuit Court of Appeals aimed at the Federal Communications Commission. Bottom line: The FCC can abandon its ideological pursuit of the “net neutrality” bogeyman, and get on with making the world safe for the iPad.

The court ruled in considerable detail that there’s no statutory basis for the FCC’s ambition to annex the Internet, which has grown and thrived under nobody’s control.

. . .

So rather than focusing on new excuses to mess with network providers, the FCC should tackle two duties unambiguously before it: Figure out how to liberate the nation’s wireless spectrum (over which it has clear statutory authority) to flow to more market-oriented uses, whether broadband or broadcast, while also making sure taxpayers get adequately paid as the current system of licensed TV and radio spectrum inevitably evolves into something else.

Second: Under its media ownership hat, admit that such regulation, which inhibits the merger of TV stations with each other and with newspapers, is disastrously hindering our nation’s news-reporting resources and brands from reshaping themselves to meet the opportunities and challenges of the digital age. (Willy nilly, this would also help solve the spectrum problem as broadcasters voluntarily redeployed theirs to more profitable uses.)

As Washington and the states pile up mountainous liabilities — $3 trillion for unfunded state pensions, $10 trillion in new federal deficits through 2019, and $38 trillion (or is it $50 trillion?) in unfunded Medicare promises — the U.S. needs once again to call on its chief strategic asset: radical innovation.

One laboratory of growth will continue to be the Internet. The U.S. began the 2000’s with fewer than five million residential broadband lines and zero mobile broadband. We begin the new decade with 71 million residential lines and 300 million portable and mobile broadband devices. In all, consumer bandwidth grew almost 15,000%.

Even a thriving Internet, however, cannot escape Washington’s eager eye. As the Federal Communications Commission contemplates new “network neutrality” regulation and even a return to “Title II” telephone regulation, we have to wonder where growth will come from in the 2010’s . . . .