Google to Launch Vertical Search Engine in a Box

July 17, 2007

Almost a month ago I was fortunate to be invited to help with the development of a brand new product which will be launched by Google tomorrow (July 17th, 2007). The Custom Search Business Edition (CSBE) will have a massive impact on the search engine community. We’ve read so much recently about various vertical search engines popping up all over the place and now Google has come up with their own “build a vertical” toolkit which should smash the vertical search market.

Example CSBE Website:
The new CSBE can be viewed on the top right corner of the Holiday Home Rental website run by Holiday Home Rentals, LLC. currently has 25,000 holiday rental homes represented by over 150,000 pages of mostly user-generated content. Vacationers looking for rental homes, search the website, find properties and submit enquiries directly to the homeowners.
The Google CSBE allows our users to search for things like “2 bedroom cottage in Cornwall near Newquay” or “1 bed apartment in Hyde Park” instead of being constrained to key database fields which require more precise search criteria.

We have been live with the new Google search for over a week now and have witnessed immediate and significant results. The number of referrals generated to our home owners has increased by approximately 30% and at the same time, the number of customer service requests has also significantly decreased. The results have been overwhelming. The newly implemented Google search tool enriches the users experience by giving them the power to simply think and type their search parameters which propels them to a more accurate and meaningful result set.

Setup and Configuration
It took just under one minute to build a search engine for my 150,000+ page Holiday Home Rentals website. A few hours later, the Holiday Home Rental template had been applied and was presented with Google quality search results in the Holiday Home Rental branding with zero banners (unlike the free Google Custom Search Engine (CSE)).

That last point is key to the CSBE. Like the Google mini search appliance, the CSBE has many features, one of the most significant being able to display search results without banners. We pay a lot of money for banners and can’t afford to have visitors click away after they’ve finally landed on our site. The CSBE enables business owners to do this.
Price Plan

  • 5,000 pages = $100 per year
  • 50,000 pages = $500 per year
  • 1 million pages = $15,000 per year

Compare this to the Google mini which costs $3000 per 100,000 pages and it is a pretty good deal. The big difference in the two is where the index is housed. The CSBE relies solely on the Google index and if your content is not in there, then it will not appear in the search results. For the more established sites, this shouldn’t be too much of a concern as Google would typically be grabbing fresh content on a regular basis (especially if you’re taking advantage of the sitemaps to let Google know which content has been updated and when).

Additional Functionality:
The Holiday Home Rentals site contains mostly user-generated content. However, we differentiate between properties based on several factors, one of which is the quality of the listing. The CSBE will allow you to boost the results of different parts of your website using URL patterns so you can more broadly give higher weighting to certain sections of the site instead of individually trying to tune search results based on keyword. While the waiting is good, it doesn’t solve the problem of showcasing the property results differently based on the level of our “property points”. Fortunately Google thought of a way around this. Using the search API, we are able to use the business search account and get the results back as an array rather than preformatted HTML as we have it now (formatted by Google). Which means we are able to look up the results before displaying them, and see which were gold, platinum or had the highest property point values. We are then able to give them a different treatment in the result list. For example, make them bigger or bolder, give them a background to make them standout, show the number of stars, or even just show the property photo etc.

Of course if we wanted to, we could even manipulate the results. For example, if the 1000th result was a platinum sponsor we could optionally bring that result to position number one (using the array method). Although this would have a direct impact on the search result relevancy it could be useful in some instances. A more typical use for this is taking each page of 10 results and perhaps changing the order of each page vs. changing the order of the entire result set. This way you are ‘tweaking’ the relevancy a little while striking a nice compromise with your site’s key sponsors/partners.

Meta Tags (advanced stuff)
A much easier way to do the above would be if Google included meta tag info in their GWebResult object. Using the Google Search API you can set the CSS class for the results of an entire search, using GSearch.setUserDefinedClassSuffix. In other words, all results of this search would have the given CSS styles applied. We’ve suggested to Google that the value of the CSS class come from a meta tag in the source. For example, the higher ranked properties could be tagged with:

META NAME=”Rating” VALUE=”Highest”

And the Google generates HTML results could add “Highest” to the class name of each result that had the tag. If a different property was rated well, but not as well, it would have:

META NAME=”Rating” VALUE=”High”

And that CSS class would highlight it, but not as much.

The basic idea would be to add META tag info to website pages to indicate some value i.e. rating etc. and, if Google included the meta data in their results objects, we could easily use that to change the treatment of the search results thru CSS. This is the same as described above, but would be much more efficient.

META tags could be used to much greater effect if the Google business search used them, similar to how the Google search appliance does. The CSBE doesn’t support this at the moment, but the Google development team has indicated they like the idea and will consider it for future development.

Effect on Google Search Results
While I’ve seen no impact on my search engine placement in this short period of time, I have noticed a quicker than normal response from the Googlebot to recently added content. It could just be a coincidence but might be something to look out for.

Social Media Opportunities
I’ve been trying to think of ways in which we might be able to use the CSBE for social media. We could certainly add an AJAX based rating system next to all of the results or perhaps add a “Add to Favorites” etc. since we can format the results out of the array. I have a feeling there are a lot of opportunities around this – just need to figure them out.

Vertical Portal Opportunities
With an attractive price tag of $100 for 5,000 pages, it makes you wonder if there are suddenly going to be new vertical search engines popping up all over the place. For example, if I were interested in “Travel in the Lake District”, I could find what I think are the best websites, filter out the non-relevant pages using the filter tools and then create a CSBE generated search engine for just the filtered pages of the approved sites. While vertical search engines are not new, they have never been this easy or this cheap to setup and customize before.

Authored by:
Andy Steggles
Holiday Home Rental, LLC

[From Google Website]
Business Edition overview
With Custom Search Business Edition you’ll enjoy these additional features and support to help you integrate Google search into your website:
Ads-free results pages
Ads do not appear alongside search results, so you can keep traffic on your website.

XML feed of search results
Use this raw XML feed of search results to integrate search results with your website’s look and feel.

Customizable search results
Through the XML feed, you can reorder search results as you see fit.

Google branding optional
You have the option of whether to brand your search engine as being powered by Google.

Email support
Google will provide access to help center and e-mail support for paying customers on a 24 x 7 basis. Standard Support requests are responded to with a target initial response time of one business day during Business Hours only. Service Unusable Requests are responded to 24 x 7 with a target initial response time of one hour. Phone support is also available for an additional fee.

Easy payment with Google Checkout
Custom Search Business Edition costs $100 per year for websites with less than 5,000 web pages, and $500 per year for websites between 5,000 and 50,000 web pages. Payments are made through Google Checkout, and payments do not automatically bill each year.

Custom Search Business Edition Screen Shot
(click to see the full screen view with the link to the business edition)
Google Custom Search Business Edition Screen Shot

Free Search vs. Custom Search Comparison
(click to see the full screen view with the link to the business edition)
Side by Side Comparison for Free vs. Business Search