{"id":77,"date":"2007-06-14T18:55:11","date_gmt":"2007-06-14T23:55:11","guid":{"rendered":"http:\/\/antipaucity.com\/2007\/06\/14\/i-know-why-search-is-broken\/"},"modified":"2007-06-14T18:55:11","modified_gmt":"2007-06-14T23:55:11","slug":"i-know-why-search-is-broken","status":"publish","type":"post","link":"https:\/\/merikebi.warrenmyers.com\/?p=77","title":{"rendered":"i know why search is broken"},"content":{"rendered":"<p>Search is broken. Google, Yahoo, Ask, Alta-Vista, and on, and on the list goes.<\/p>\n<p>Hundreds of companies, thousands of individuals. I know why search is broken, and I know what needs to be fixed. Now to figure out the how of fixing.<\/p>\n<p>When you&#8217;re looking for information, you search on keywords. Google&#8217;s been nice enough to rank results by &#8216;popularity&#8217; (yeah, it&#8217;s called PageRank, and it&#8217;s proprietary, but it&#8217;s a popularity\/relevance ranking). The problem is that you have to know what keywords were used. Some places are nice enough to suggest spelling fixes (it&#8217;s not &#8216;brittany spears&#8217;, it&#8217;s &#8216;britney spears&#8217;).<\/p>\n<p>But that&#8217;s not the issue. The issue is that you don&#8217;t know what word, term, or phrase to look for. You have the concept you need to find, like &#8216;module&#8217;. Except you don&#8217;t think of that word, you think of &#8216;chunk&#8217;. Bam! You&#8217;re out of luck: no author would use the word &#8216;chunk&#8217; when they mean &#8216;module&#8217;, right?<\/p>\n<p>To fix search, we need to search on not just the keyword, but the concept. In English, you&#8217;d use a thesaurus.<\/p>\n<p>So, you&#8217;re thinking: &#8220;This is easy! I&#8217;ll just build a comparator that looks at the keyword and then goes through an index of a thesaurus and finds stuff. And we&#8217;ll all be rich!&#8221;<\/p>\n<p>Hold it, buster. You missed something. This is a perfectly valid English sentence, and you can figure out what I&#8217;m saying, too: &#8220;Bring me the cooler cooler cooler from the cooler&#8217;s cooler.&#8221; Cooler is used five times, with the following meanings (at least): hip, less warm, box to keep things cool, jail cell, big refrigerator.<\/p>\n<p>That&#8217;s the problem with trying to fix search. Words can mean far too many things in English. But here&#8217;s your big chance to figure out a solution: I&#8217;ve told you the problem, and I&#8217;ve given you the target.<\/p>\n<p>Now go make it work.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Search is broken. Google, Yahoo, Ask, Alta-Vista, and on, and on the list goes. Hundreds of companies, thousands of individuals. I know why search is broken, and I know what needs to be fixed. Now to figure out the how of fixing. When you&#8217;re looking for information, you search on keywords. Google&#8217;s been nice enough &hellip;<br \/><a href=\"https:\/\/merikebi.warrenmyers.com\/?p=77\" class=\"more-link pen_button pen_element_default pen_icon_arrow_double\">Continue reading <span class=\"screen-reader-text\">i know why search is broken<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_hide_featured_image":false,"_jetpack_featured_image_duplicate_dismissed":0,"_jetpack_feature_clip_id":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_post_was_ever_published":false},"categories":[7,22,23,41],"tags":[],"keyring_services":[],"class_list":["post-77","post","type-post","status-publish","format-standard","hentry","category-commentary","category-ideas","category-insights","category-technical"],"jetpack_sharing_enabled":true,"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/merikebi.warrenmyers.com\/index.php?rest_route=\/wp\/v2\/posts\/77","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/merikebi.warrenmyers.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/merikebi.warrenmyers.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/merikebi.warrenmyers.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/merikebi.warrenmyers.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=77"}],"version-history":[{"count":0,"href":"https:\/\/merikebi.warrenmyers.com\/index.php?rest_route=\/wp\/v2\/posts\/77\/revisions"}],"wp:attachment":[{"href":"https:\/\/merikebi.warrenmyers.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=77"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/merikebi.warrenmyers.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=77"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/merikebi.warrenmyers.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=77"},{"taxonomy":"keyring_services","embeddable":true,"href":"https:\/\/merikebi.warrenmyers.com\/index.php?rest_route=%2Fwp%2Fv2%2Fkeyring_services&post=77"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}