Transcribed

Exploring the Deep Web with Semantic Search

EXPLORING THE DEPTHS OF THE DEEP WEB

Eighty-five percent of Web users use search engines to find needed information, but nearly as high a percentage cite to the inability to find desired information as one of their biggest frustrations.

85%

0.03%

Internet searchers are searching one in 3,000 of the pages available to them today.

40% SURFACE WEB

Linked content search engine crawlers can find; Content submitted to search engine

19 TB of content

1B unique documents

96% DEEP WEB

AKA 'invisible web'

7500+ TB of content

Largest growing category of new information on the Internet

Dynamic content ; Password protected of unlinked content; Form-controlled entry restricted pages; Geo-tagged pages; Scripted Content; Non-HTML/text content; Pages updated or changed ahead of search engine indexing

550B unique documents

400-550X more public information than the Surface Web

Traditional search tools are ill-equipped to navigate The Deep Web. Serious information seekers are turning to semantic search technologies to surface answers in the Deep Web. EXPLORING THE DEPTHS OF THE DEEP WEB Eighty-five percent of Web users use search engines to find needed information, but nearly as high a percentage cite the inability to find desired information as one of their biggest frustrations.12] 85% 4% 0.03% 0 03% Internet searchers are searching one in 3,000 of the pages available to them today. [4] 96% SURFACE WEB 19 TB of content 191 Linked content search engine crawlers can find; Content submitted to search engines IB unique documents 19. NASA Spinoff Roodling Online, Artic ul . Coordinatad Acons to the Rosearch Extenion Systam, Pubs Chem Feature Articles Orogon Stato Univorsity Extonsion Sorvice Molocular Thirapy Bulotin The Hong Kong Modical Journal Liver Transplantation Gencics and Raport Crop Sciance Joumal. Journal of Environmontal Quality Bono Journal of Exposure Science and Environmontal Epidomiology vator lopuodajada out on Forestors AZOM.com, Articles Promega Corp., Peotocols NASA Earth Observatory Protole Sclonce Environmontal Protaction Eyo World, Articlos Biological & Pharmacoutical as Aearch Nlational Tolocommunications and Information Adminhstration World Climate orapy Europaan Jounal of Clinical Nutrition Intornational Journal of Impotonce Rosearch Horedity Lincoln industrlal Safety BCH Indian Journal of Modical Arthritis aoumathm indian Journal of Sciontific focumant American Acadonny ydrology and Earth Systoms .Journal of Cotton Science pdeny of Nourology Journal - Consanvation Socioty DEEP WEB ----- AKA 'invisible web' hitgLibrar 7500+TB Largest growing category Dynamic content ; Password of content3 of new information on protected or unlinked content; Form-controlled entry restricted pages; Geo-tagged pages; Scripted Content; Non-HTML/text content; Pages updated or changed ahead of search engine indexing the Internet (s ache ral Plastichy uterials Sclance and 550B unique documentsl 400-550X more of Anten ibuted hotache oumal of Traditional search tools are public information than the Surface Webls1 and Tratm ondustructive Ill-equipped to navigate The Deep Web. Serious ico information seekers are tAdvance SoorX utional umal Pacific Drug Discov Ingrodionts Onlino ataria: hotics! A setics h Orthotics . OptoElactronics abcal PhysAmer Total quality 1000 – 2000X greater than the quality of the Surface Webis1, lonal ournal of A umal Distributed of Coll Biology octrochomistry Dontistry turning to semantic search -- eInternation bernational Nanotochnology rical and Conputer Eng logy Resarch Jounal Sonal Parkinson's Disoase Path jal of Construction Enginooring and Managamontonet, iowsJoumal of Hond ooingract Archive Amorican Acadomy of Orthopaodic Surgoons, Online Bullotin e lational Journal of Control Scior Journaof Obesity Journal of op ISimulatiof in Enginooring Obstatrics a technologies to surface. answers in the Deep Web. Rosearch and yRacont tytologica [1] NEC Research Institute study, published in Nature [2] Tenth edition of GVU's (graphics, visualizationand usability) WwW UserSurvey [3] Bergman, K. T. (2001). The deepweb: surfacing hidden value. The Journal of Electronic Publishing htt://dx doi.org/10.3998,/333 645 1. 0007.104 IHS. acquired InventionMachine has http://inventionmachine.com/DeepWeb

Exploring the Deep Web with Semantic Search

shared by allisonnlewis on Sep 18

7,015 views

0 faves

0 shares

0 comments

The Web is fast becoming a titanic, complex entity. By the year 2015, it’s estimated that one zettabyte of content will be added to the web each and every year. Navigating this sea of information pr... esents more and more of a challenge -- particularly when much of that content is not easily accessed by traditional search engines. The Surface Web - When most of us think of the Web, we think of the 'Surface Web', also known as the visible web - the webpages we access directly, via links or via common search engines like Google. However, the Surface Web makes up just 4 percent of all the content on the Internet. The Deep Web - The ‘Deep Web’ or ‘Invisible Web’ is several orders of magnitude larger than the Surface Web and represents a staggering 96 percent of information on the Web. This content includes: - Dynamic or scripted content - Unlinked content - pages which are not linked to by other pages, which may prevent web crawling pprograms from accessing the content. - Private or password-proected websites - Webpages with content varying for different access contexts (e.g., ranges of client IP addresses or previous navigation sequence). - Limited access content - sites that limit access to their pages in a technical way - Non-HTML/text content - textual content encoded in multimedia (image or video) files or specific file formats not handled by search engines. This content can only be mined and leveraged using sophisticated search technologies, such as Goldfire's world-class semantic search. If you aren't searching the Deep Web, check out what you might be missing:

Publisher

IHS