Key differentiating technologies for mobile search

3 downloads 59408 Views 667KB Size Report
Orange Labs - Research & Development – key technologies for mobile search – 9th June 2010 unrestricted. Technologies directly impacting on mobile search.
Key differentiating technologies for mobile search Orange Labs

Michel PLU, ORANGE Labs - Research & Development Exploring the Future of Mobile Search Workshop, GHENT

unrestricted

Some key differentiating technologies for mobile search

unrestricted

Technologies directly impacting on mobile search ("prospects of mobile search JRC Scientific and Technical report))

Enabling technologies

Search technologies

Specific mobile search technologies

Technology

Keywords

Wireless networks

Broadband access ubiquity, dynamic spectrum management

Sensor networks

RFID, Internet of Things

Devices

Multimedia, location, interoperability, user friendliness

Cloud computing

Web browser, Connectivity, security, data protection

Semantic and multimedia

Enriched Content Search

Cognitive

Environment understanding

Context awareness

Context acquisition and processing

Orange Labs - Research & Development – key technologies for mobile search – 9th June 2010

Augmented reality

Enriched content

unrestricted

Technologies directly impacting on mobile search ("prospects of mobile search JRC Scientific and Technical report))

Enabling technologies

Search technologies

Technology

Keywords

Wireless networks

Broadband access ubiquity, dynamic spectrum management

Sensor networks

RFID, Internet of Things

Devices

Multimedia, location, interoperability, user friendliness

Cloud computing

Web browser, Connectivity, security, data protection

Semantic and "multimedia multimodal"

Enriched Content Search

Cognitive

Environment understanding

Specific mobile Context awareness Context acquisition and search processing unrestricted Orange Labs - Research & Development – key technologies for mobile search – 9th June 2010 technologies Augmented reality

Enriched content

Agenda

Semantic Search

Contextual search

Multimedia Multimodal Search

Orange Labs - Research & Development – key technologies for mobile search – 9th June 2010

unrestricted

Semantic search

The "universal one box search"

Orange Labs - Research & Development – key technologies for mobile search – 9th June 2010

unrestricted

Semantic search

The "universal one box search"

Orange Labs - Research & Development – key technologies for mobile search – 9th June 2010

unrestricted

Semantic search

The "universal one box search"

Orange Labs - Research & Development – key technologies for mobile search – 9th June 2010

unrestricted

Semantic search

The "universal one box search"

Orange Labs - Research & Development – key technologies for mobile search – 9th June 2010

unrestricted

Semantic search

The "universal one box search"

Orange Labs - Research & Development – key technologies for mobile search – 9th June 2010

unrestricted

Semantic search

The "universal one box search"

Orange Labs - Research & Development – key technologies for mobile search – 9th June 2010

unrestricted

Semantic search

The "universal one box search" ƒ

The Value; – A single plain simple UI for accessing ALL services – keyword based navigation ( spoken or written) – No more manual service selection

ƒ

Based on – Semantic interpretation of the query – Semantic description of services/content sources

ƒ

For – Routing and formatting the query to the appropriate service

Orange Labs - Research & Development – key technologies for mobile search – 9th June 2010

unrestricted

Semantic search

Key Issue : Textual query management ƒ

Query spell checking

ƒ

Query completion – Even with misspelled current typing

ƒ

Query suggestion – Query expansion

ƒ

Specific forms of queries ( SMS like )

ƒ

Speech to text – Even in noisy outdoor environment

Orange Labs - Research & Development – key technologies for mobile search – 9th June 2010

unrestricted

Semantic search Challenges : natural language ambiguity

ƒ

Orange and apples …

Orange Labs - Research & Development – key technologies for mobile search – 9th June 2010

unrestricted

Semantic search Challenges : semantic interprétation

ƒ

Orange and apples …

Orange Labs - Research & Development – key technologies for mobile search – 9th June 2010

unrestricted

Semantic search Challenges : semantic interprétation

ƒ

Orange and apples …

Orange Labs - Research & Development – key technologies for mobile search – 9th June 2010

unrestricted

Semantic search Challenges : semantic interpretation

ƒ

Needs knowledge – Less and less expensive – Semantic web -> linked open data – Dbpedia …

ƒ

Needs more information about the query

– Contextual awareness => Multimodal search

Orange Labs - Research & Development – key technologies for mobile search – 9th June 2010

unrestricted

Contextual awareness ƒ

Context: – Any useful information to precise the query – – – – – –

Space Time User Device History ( with multiple scope ) Any other idea ?

Orange Labs - Research & Development – key technologies for mobile search – 9th June 2010

unrestricted

Contextual awareness : the challenge ƒ

What about the query "paris brest" ? – An itinerary ? – Brest is a good destination for summer holidays – Is the user currently on this way, has he planned some holidays ? – A transportation offer ? – Is the user usually travel by plane , by train ? – A French League football match ? – If the match is not finished , display the score – Does the user terminal can play video ? – If not provide a textual summary – A cake ?

Orange Labs - Research & Development – key technologies for mobile search – 9th June 2010

unrestricted

Contextual awareness : technologies ƒ

User modeling – So many digital information – On the device, on the web, through the user community … – Privacy and legal issues

ƒ

Contextual ranking – Business rules

ƒ

Multimodal queries => multimodal search

Orange Labs - Research & Development – key technologies for mobile search – 9th June 2010

unrestricted

Mulltimedia multimodal search

The query is multi modal : ƒ

keyword ( implicit or explicit)

ƒ

Multimedia – Images – Flash codes, book/CD/DVD covers, news paper pages, movie posters … – sounds – Music – Videos

Orange Labs - Research & Development – key technologies for mobile search – 9th June 2010

unrestricted

Audio search : a PHAROS use case 5. User reuses the saved information for getting the VIDEO clip of the music

1. User records a SAMPLE of MUSIC 2. Computed fingerprint is sent to the PHAROS Application 3. PHAROS Application recognizes the song and artist 4. User saves this information for future queries using PHAROS Search Engine Orange Labs - Research & Development – key technologies for mobile search – 9th June 2010

unrestricted

Multimedia multimodal search

The query is multi modal : ƒ

keyword ( implicit or explicit) – Catalog based => Structured ( XPath or Xquery ) – Free query => keywords

ƒ

Multimedia – Images and sounds

ƒ

Geographic position

ƒUser

profile

Orange Labs - Research & Development – key technologies for mobile search – 9th June 2010

unrestricted

The search must be also multi modal: The PHAROS multimodal search engine \\where[contains(“amsterdam”)] and \\topic[contains(“building”)]

52.37N 4.89 E

wor

ds

Lo ng

ath XP

K ey

Image

/L at

“amsterdam”

Query analysis Federation

G JP

Song

Music search Similarity index Image search

Text search Inverted index

XML search

Geo search

Semantic index

R-tree index

Orange Labs - Research & Development – key technologies for mobile search – 9th June 2010

Similarity index

unrestricted

Time to conclude

ƒMobile

– ƒFrom ƒ

search strengthen the constrains of multimedia search Less choice to display – Better precision with the same recall

documents search to information search

Queries are no more plain keyword based queries – But composite and multimodal

Orange Labs - Research & Development – key technologies for mobile search – 9th June 2010

unrestricted

Time to conclude

ƒMobile

– ƒFrom ƒ

search strengthen the constrains of multimedia search Less choice to display – Better precision with the same recall

documents search to information search

Queries are no more plain keyword based queries – But composite and multimodal

ƒ

Open challenges => opportunities for new innovations

ƒ

New open competition => Places for new leaders

"Search" does not start with a G => Business opportunities for European actors ƒ

Orange Labs - Research & Development – key technologies for mobile search – 9th June 2010

unrestricted