As discussed on Byteside Tech #1, we recently conducted a series of network data tests using the iPhone’s Speedtest.net app.

We had concurrent access to four iPhone 3GS handsets, one on each of the four Australian networks — Telstra, Optus, Vodafone, and 3. Travelling around the Sydney CBD and Sydney suburban areas, we ran close to 150 individual speed tests. Tests ranged from Manly to Homebush, Annandale to North Sydney, and plenty in between.

At each location tested, we ran four tests in rapid succession to try and get a reasonably accurate data set at each location while still pushing onward with the test as quickly as possible. Rapid successive tests would also, in theory, minimise excuses for high latency due to packet connection initiation times.

UPDATE: One thing we forgot to mention is that everywhere we tested we only ran the test when we could find full bars of coverage strength for all networks. So we were never testing good signal versus bad. Data strength may have had its own fluctuations in availability, but for most purposes we felt watching the standard signal meter was the best way to ensure we aimed for a level playing field at all locations.

Note there are almost 40 less data points in the Optus list than the other three. We had a data problem and lost most of our recordings from the first day of testing. But things did perform in a similar fashion on both days, so we’re confident this had very little impact on the overall statistics. You can see in the raw data the exact parallel tests if you want to purely compare test for test.

RESULTS

The summary? You really do get what you pay for. Telstra blows away the competition with speeds almost double the next best network, while the best value cheapest data network Three delivered the slowest results. Indeed Three’s best single result was slower than Telstra’s average.

All that said, even the slowest network delivered reasonable test results. In the context of landline access, wireless speeds were better than a home 512K connection.

Other notable concerns were the very high pings experienced across all networks. If you need low latency, wireless has a very long way to go.

We should note that of the 110 Optus tests conducted, no result could be obtained on nine occasions. And this was a similar experience on the first day’s missing Optus results. So while their final results look quite good, there was close to a 10% failure experience during the period of testing. We marked these results as ‘zero’ for down and up, and left the ping stat blank.

KEY STATISTICS

Network Stat Down Up Ping
Telstra Average 2681 263 2992
  Median 2416 280 2358
  Best 6151 335 212
Optus Average 1637 218 4493
  Median 1903 279 2636
  Best 3654 359 214
Vodafone Average 1283 140 7489
  Median 1125 107 5398
  Best 3349 357 209
Three Average 629 128 2211
  Median 525.5 128 2247
  Best 2290 315 206

For all raw data, which includes date, time and GPS coordinates plus more statistical anaylsis, grab the XLS here.