Two weeks ago, I offered this assessment of airfare aggregators — sites that perform an identical search across multiple travel sites and report the results to you. But most of these sites can be used for hotel searches as well. How do the aggregators stack up for lodging?

Hotel searches are trickier than airfares, for the most part, because not all rooms are created equal, and hotel location is less standardized than air travel routes. Finding a low rate isn’t helpful if you have strong preferences for two queen beds vs. one king bed, or smoking vs nonsmoking, or if you need to be within walking distance of a particular location.

(Note also: For many large chains’ loyalty programs, you now are required to reserve the room through their own sites in order to collect the points. The aggregators may be helpful in finding a lower rate booked through another site, but be sure you’re aware of point accrual rules before committing to anything.)

In contention here are Kayak, SideStep, FareChase, Mobissimo, Qixo, Bezurk, PriceGrabber, and the newly-launched hotel-only SearchParty.

I ran three separate searches on all engines: one stay in San Francisco, one in Paris, and one in Moab, Utah. The idea was to test large and small U.S. destinations, as well as an international location. I also ran the same searches on Travelocity and Orbitz to see how the traditional sites compared.

Once again, Kayak comes out on top. But this time the competition is closer on its heels. Farechase comes in a close second for North American searches, with Sidestep and Bezurk coming close for international. Worst performer of the bunch, by far, is Qixo — when its servers were working at all. SearchParty is unique in showing the cancellation policies, but its prices are still too unreliable for me to recommend the site; in time, it may improve.

The breakdown:

Kayak
Kayak offered a comprehensive mix of independent and chain hotels, including hotels you couldn’t book online. Their goal — to catalog every hotel on earth — is not quite reached, but they do an admirable job. They even include small, independent hotels that can’t be booked anywhere online (they give you a phone number in such cases, but these offline hotels may be listed without rates). Kayak’s controls are also the best. The difference: More options to let you narrow the search, and not just sort results. For example: While others, such as Farechase and Sidestep, let you narrow down results by neighborhood, and Farechase lets you sort results by distance from a given point, only Kayak lets you narrow the search by a geographic radius — without sacrificing the other variables you want to control. It’s a subtle difference, but this level of output control makes filtered results far more relevant. They include a small map as well (powered by Google), which is helpful. Downsides: No reviews or photos (minor quibbles), and they could offer more room amenity options to filter results.

Farechase
Update: Yahoo has abandoned Farechase; this review remains up for posterity, but the site is gone.
Yahoo’s Farechase responded more quickly than the other sites — the fastest response in the group. Controls to narrow results include price range, class (stars), neighborhoods, bed type, and an amenity list. The results can be sorted by popularity (default), price, name, or distance from the search term. Results include a small photo of the hotel, if available, but I’m really not sure how useful this is. Sometimes the quality is poor, sometimes it’s just a photo of a bed. You can’t garner much from the photos. The map is huge — maybe too big, even. One nice feature is the consumer reviews, garnered from Yahoo and Travelocity. TripAdvisor is still a far richer resource for reviews, but having user reviews is a positive, nonetheless. Major downside to FareChase: Searches are possible for US and Canada hotels only. Get a passport, guys!

SideStep
Sidestep’s output is similar to Farechase, but without a map, and without a way to limit bed types. Like Kayak and Farechase, sponsored results get top ranking. Photos are the same size and quality as Farechase. A small number of Sidestep-user-generated reviews. Prices were good for international searches. A solid performer.

Mobissimo
Mobissimo has fewer controls than the others. Default ranking is by price, without regard for location or class. You can sort results by stars, price, name, or provider, but it doesn’t give you any choices over the location of the hotel or the kind of room you’re searching. International search results were good, but the results are so hard to wade through, it’s still an inferior search.

Qixo
Like Mobissimo, Qixo doesn’t offer many controls over the output. For some reason, the site had trouble loading on one computer I was using, but worked fine on another computer in the same network. (Qixo shifts from qixo.com to res99.com for search results, which may have something to do with it.) But regardless of the networking issues, it was still an inferior product. The highest prices, by far. The least control over the output. Don’t bother with this site.

Bezurk
Bezurk found the lowest prices for the Paris search, but it was far less effective for US-based searches. (Their best deals seem to come from HotelClub.com, which I did not see listed in any of the other aggregators.) Not as many controls as the others, but the deals are good.

Pricegrabber
Update: PriceGrabber has thrown in the towel, shutting down their travel search feature. The rest of their site is still up and running. This review stays up, though the travel service is defunct.
PriceGrabber grabbed some pretty high prices in Paris and San Francisco. Its rates were par for the course in Moab. Their initial search has limited options, but the results can be filtered further (star rating, price, features, etc., but not distance from a particular point). Still, other sites offer better controls. PriceGrabber isn’t bad, but you can do better.

SearchParty
SearchParty, a new entrant specializing entirely in hotel searches, needs to work some kinks out. The site is attractive in its presentation: For each hotel, they show the prices of the three least expensive providers. When you click through to compare the booking options, you see the cancellation policies and fees, which is a VERY nice feature. But the prices that come up in the search are simply unreliable. Click on that $69 rate at the Sleep Inn, and the very next screen tells you it’s actually $99. What good is an aggregator that can’t get its prices right? Further, its searches are limited to the United States only. Finally, there’s no way to limit searches by bed/room type. SearchParty has potential, but it has a way to go.

The “Control Group” in the experiment: Neither Orbitz nor Travelocity found as many options as the aggregators. Orbitz was easier to narrow down and control. But price-wise, the aggregators found lower base rates.

(image: Intercontinental Amstel Hotel, Amsterdam, photo via larscapes.com)

The great benefit of these sites is that you get greater transparency of fares. However, not all aggregators are created equal. I put a few to the test.

For the time being, I limited my comparison to airfare searches. I looked for accuracy (did the quoted price match the price actually offered at the provider’s page?), depth of information (does the site give the booking class, cancellation policies, etc.?), and control (can you sort searches easily, by provider, by price, by distance, etc.?)

For airfare, I compared Kayak, Farechase, Mobissimo, Bezurk, Farecompare, Sidestep, and Pricegrabber. (Since I’m based in the United States, these results may be biased toward North American searches.)

The result: Kayak came out on top, with the lowest prices, the most control over the output, and most information about both airlines and sellers. Sidestep comes close. Farecompare gets an honorable mention for its price-driven approach. All sites accurately reported fares — there were no surprises when clicking through to the target site. However, no single aggregator actually found every flight option or every major travel site.

Kayak
If you know your dates of travel, Kayak offers the most powerful site, in my opinion. It covers a range of websites, including a number of consolidators. The fare results can be sorted by airline, by time, by price, by airports (it searches alternate airports automatically), and by stops. One of the biggest benefits is the ability to see the precise fare booking code, by clicking “details.” (This is great if you’re looking for a cheap but upgradable fare, for example.) A downside to Kayak is that they seem to exclude the big three online agencies — Travelocity, Expedia, and Orbitz don’t seem to come up in searches. On the plus side, JetBlue, who (like Southwest) doesn’t show up in the big three’s searches, comes up for comparison on Kayak. Negative is that they don’t seem to grab every possible routing from every airline (a common complaint for all aggregators). Kayak is 95% there, but not quite 100%.

SideStep
Sidestep is a very close runner-up to Kayak on the pure-airfare search. It covers a similar range of sites, plus includes Orbitz in the search. It has one interesting benefit: offering air and hotel package searches across multiple sites. Note that Sidestep is perhaps best known for its downloadable toolbar, which “watches” where you browse, and offers fare alternatives. I am not a fan of this over-the-shoulder co-browsing, but you don’t have to use their toolbar in order to run a search.

Farechase
Farechase, owned by Yahoo, copies much of Kayak’s template, but searches a slightly different universe of sites, including both Orbitz and Cheaptickets. The total number of sites searched is smaller, but doesn’t overlap entirely with Kayak or Sidestep. One downside: the flight details do not include the booking class/fare code. Presumably you need to go through the process of a complete booking in order to see that info.

Mobissimo
Like Farechase, Mobissimo DOES include some of the online agencies: Orbitz, CheapTickets, and Opodo, for example. However, it offers less flexibility in sorting the data than Farechase, and it doesn’t give much in the way of flight details. While the fares it finds are comparable to Farechase, the presentation is previous-generation.

Pricegrabber
Update: PriceGrabber has thrown in the towel, shutting down their travel search feature. The rest of their site is still up and running. This review stays up, though the travel service is defunct.
Pricegrabber is a comparison shopping site, and their travel search is just one among many. The search engine again follows the Kayak template, but it doesn’t tell you up front which sites it has searched. Results can be sorted by price, airline, time ranges, and, interestingly, ontime statistics. But you can’t see the flights’ booking class here either, the range of alternate airports is limited, and you don’t even know who the seller is until you choose the flight. They do work with Orbitz, and perhaps others, but they need to provide more information.

Bezurk
This is an Asia-based site that taps into a completely different pool of providers. It copies the Kayak model, again. However, because the search is based on Asian companies, it may be difficult to find a fare you can actually purchase if your travels don’t touch Asia. Nonetheless, for international travel, check it out.

Farecompare
This recently unveiled site is notable for its price-driven approach. Instead of entering cities/dates and comparing options thereafter, Farecompare asks for cities only, and drills down on the basis of price. Much like Travelocity’s Dream Maps or Search by Price, you may end up with a great price… on dates you can’t use. However, the site is interesting for the sheer volume of information it provides, and it offers historical data tracking the city pair’s fare trend over time.

What if you just care about price, without regard to anything else? Who has the best price? I did two searches, one for Chicago to Los Angeles, one for San Francisco to Sydney. The city pairs made no difference: In both cases, Kayak, SideStep, and Mobissimo found the identical lowest prices. Farechase’s “lowest price” was more than the others.

Aggregators are a great tool, but even then, you may want to run one or two of them, to see if they differ. Maybe we need an aggregator of aggregators (perhaps metakayak.com?) to truly get thorough searches.

In two weeks, I’ll test the aggregators’ searches for hotels, which offer an entirely different set of challenges. If there are any sites that you believe I have missed, or if you think my assessment is way off base, let me know by leaving a comment or using the contact link at the top right of the page.

Update (April 24, 2006): One reader wrote, reminding me of ITA Software’s excellent fare search tool. ITA powers Orbitz.com for airfare searches, though Orbitz’s search engine is a dumbed-down version with far fewer features. The genius of ITA is that it is incredibly powerful, if you know how to phrase your searches. However, it’s not a booking site, just an informative flight search, so even if you find a great fare, you have to find and book it elsewhere. Since ITA doesn’t actually get you to a booking (and, as the aggregators demonstrate, fares aren’t always available everywhere), I didn’t originally include them in the earlier discussion.

Update (April 28, 2006): Reader Todd points out that I forgot to include Qixo.com in my review. He’s right. Ahem:

Qixo.com
Qixo came up short. It offered less information (fare booking classes, provider, etc.) and had the highest price for identical searches. I ran fresh searches for new dates, with the same city pairs. Once again, Kayak had the lowest fare with the most choices and depth of information. Sidestep and Farechase had the same prices, with less info. Pricegrabber was a few dollars more expensive. Bezurk found nothing at all for North American itineraries. And Qixo? $120 more than the others. When the site even worked. Qixo came in last.