WO2021112807A1 - A system for using augmented reality in messaging applications - Google Patents
A system for using augmented reality in messaging applications Download PDFInfo
- Publication number
- WO2021112807A1 WO2021112807A1 PCT/TR2020/051234 TR2020051234W WO2021112807A1 WO 2021112807 A1 WO2021112807 A1 WO 2021112807A1 TR 2020051234 W TR2020051234 W TR 2020051234W WO 2021112807 A1 WO2021112807 A1 WO 2021112807A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- message
- application
- content
- augmented reality
- electronic device
- Prior art date
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
- H04L51/06—Message adaptation to terminal or network requirements
- H04L51/063—Content adaptation, e.g. replacement of unsuitable content
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
- H04L51/07—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail characterised by the inclusion of specific contents
- H04L51/18—Commands or executable codes
Definitions
- the present invention relates to a system whereby addition of augmented reality content into message content is enabled by analysis of message contents in messaging that are performed in a messaging application running on an electronic device.
- each of avatars represents sender of one of a plurality electronic messages.
- the invention comprises selecting the one corresponding to one of a plurality of messages that are presented in a virtual space in a computing environment, in connection with one of avatars.
- the system comprises receiving an indicator in order to present the corresponding electronic message in a virtual space and presentation of the corresponding electronic message in the virtual space by the computer.
- An objective of the present invention is to realize a system whereby addition of augmented reality content into message content is enabled in a real or virtual environment by analysis of message contents in messaging that are performed in a messaging application on an electronic device being able to take picture and run a messaging application.
- Figure 1 is a schematic block diagram of the inventive system for using augmented reality in messaging applications.
- the inventive system (1) for enabling addition of compatible augmented reality content into a message content comprises: at least one electronic device (2) which is configured to run at least one application on itself; at least one application (3) which runs on the electronic device (2) and is configured to ensure that the messaging content among the electronic devices (2) are transmitted over external server and the image or content and message contents symbolizing the person are viewed by augmented reality in a virtual or real environment; and at least one server (4) which is configured to decide on the message type - -that can be text, photo or sound- of the message content reaching from a messaging server to the application (3) in mutual messaging; to analyse the message content based on the message type it determines; and to add augmented reality content into the message; and to send the message wherein it added the augmented reality data to the application (3) of the other party.
- the electronic device (2) included in the inventive system (1) is a device such as mobile phone, tablet computer, desktop computer or portable computer.
- the electronic device (2) is configured to perform data exchange by using any communication protocol.
- the electronic device (2) performs data exchange over a mobile communication network or a data bus such as Internet.
- the electronic device (2) is a mobile phone.
- the application (3) is an instant messaging application configured to be run on the electronic device (2) and to present at least one interface.
- the application (3) is configured to enable users to make data entry. Message contents comprising elements such as text, sound, video, photo are created on the interface owned by the application (3); and the elements included in the content of the incoming message are viewed.
- the application (3) is configured to ensure that the chat type is selected as augmented reality; it is determined by the user whether the messaging comprising the augmented reality data will be realized in virtual or real environment; and the messages are sent in an environment determined by the other party. Thereby, the user selects over the interface of the application (3) whether the augmented reality mode will be realized in a virtual or real environment.
- the server (4) included in the inventive system (1) is configured to receive the message content reaching the electronic device (2); to determine the type of the message content received; to analyse the message content on the basis of the message type it determined; and to obtain information about the content.
- the server (4) is preferably configured to communicate with external servers wherein the message contents are included in order to analyse the message content it received. Thereby, accuracy of the augmented reality data to be added is increased by analysing the message content with high precision.
- the server (4) is configured to add the augmented reality data -that is compatible with the content information it received after analysis- into the message content and to share it with the application (3) over the electronic device (2).
- the server (4) adds the augmented reality data into the message content reaching the electronic device (2) over the application (3), on the basis of the virtuality or reality selection made over the application (3); and ensures that it is shared with the user by resending it to the application (3).
- the server (4) first determines the message type and in case that it determines that the message type comprises media, it adds compatible augmented reality data into the related message content and then resends it to the application (3).
- the server (4) ensures that the avatar of the message owner looks sad by using augmented reality on the application (3).
- the server (4) adds augmented reality data onto the avatar -that is usually a photo or content symbolizing the message owner- on the basis of the message type and content received over the application (3).
- the sad face status of the message owner is shared with the other party from the application (3).
- the server (4) receives the message reaching the application (3); determines the message type; and analyses the content thereof.
- the server (4) adds the augmented reality data into the content information obtained as a result of the content analysis and shares it with the user over the application (3). Thereby, avatar of the message owner created by the augmented reality and his/her messages are viewed on the application (3).
- the inventive system (1) it is ensured that the chats wherein a plurality of users included in the messaging applications (3) running on the electronic device (2), are presented to users’ experience in virtual or real environment.
- the inventive system (1) due to the fact that the message type characteristics used in the chat are transferred to the virtual environment and the message contents are interpreted further, the communication problems encountered are avoided by bringing the feelings into the forefront in the messaging applications (3) further.
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The present invention relates to a system (1) whereby addition of augmented reality content into message content is enabled by analysis of message contents in messaging that are performed in a messaging application running on an electronic device (2).
Description
A SYSTEM FOR USING AUGMENTED REALITY IN MESSAGING
APPLICATIONS
Technical Field
The present invention relates to a system whereby addition of augmented reality content into message content is enabled by analysis of message contents in messaging that are performed in a messaging application running on an electronic device.
Background of the Invention Use of smart phones and applications included on smart phones increase day by day. Messaging applications are the leading applications that are most commonly used on smart phones. In said messaging applications, mutual communication is realized by media components such as text, photo, and sound provided for applications. The said media components can only present their own technical characteristics to users. However, the message or feeling that you give to the person you communicate is limited to text and media components. Therefore, the message or feeling that you can give to the other party is as much as the characteristic and quality that the said components have. And this causes us not to be able to express our feelings to the other party clearly in our messaging with other parties. For this reason, today there is need for a solution whereby user experience is enhanced by interpreting text, sound and media components further in messaging applications and it is enabled to transfer feelings to persons to whom messages are delivered more clearly.
The United States patent document no. US2019204994 discloses a system which comprises interacting with one or more electronic messages. In the said system, each of avatars represents sender of one of a plurality electronic messages. The invention comprises selecting the one corresponding to one of a plurality of messages that are presented in a virtual space in a computing environment, in connection with one of avatars. The system comprises receiving an indicator in order to present the corresponding electronic message in a virtual space and presentation of the corresponding electronic message in the virtual space by the computer.
Summary of the Invention
An objective of the present invention is to realize a system whereby addition of augmented reality content into message content is enabled in a real or virtual environment by analysis of message contents in messaging that are performed in a messaging application on an electronic device being able to take picture and run a messaging application.
Detailed Description of the Invention
“A System for Using Augmented Reality in Messaging Applications” realized to fulfil the objective of the present invention is shown in the figure attached, in which:
Figure 1 is a schematic block diagram of the inventive system for using augmented reality in messaging applications.
The components illustrated in the figure are individually numbered, where the numbers refer to the following:
1. System
2. Electronic device
3. Application
4. Server
The inventive system (1) for enabling addition of compatible augmented reality content into a message content comprises: at least one electronic device (2) which is configured to run at least one application on itself; at least one application (3) which runs on the electronic device (2) and is configured to ensure that the messaging content among the electronic devices (2) are transmitted over external server and the image or content and message contents symbolizing the person are viewed by augmented reality in a virtual or real environment; and at least one server (4) which is configured to decide on the message type - -that can be text, photo or sound- of the message content reaching from a messaging server to the application (3) in mutual messaging; to analyse the message content based on the message type it determines; and to add augmented reality content into the message; and to send the message wherein it added the augmented reality data to the application (3) of the other party.
The electronic device (2) included in the inventive system (1) is a device such as mobile phone, tablet computer, desktop computer or portable computer. The electronic device (2) is configured to perform data exchange by using any communication protocol. In a preferred embodiment of the invention, the electronic device (2) performs data exchange over a mobile communication network or a data bus such as Internet. In a preferred embodiment of the invention, the electronic device (2) is a mobile phone.
In the inventive system (1), the application (3) is an instant messaging application configured to be run on the electronic device (2) and to present at least one interface. In a preferred embodiment of the invention, the application (3) is configured to enable users to make data entry. Message contents comprising elements such as text, sound, video, photo are created on the interface owned by the application (3); and the elements included in the content of the incoming message are viewed.
The application (3) is configured to ensure that the chat type is selected as augmented reality; it is determined by the user whether the messaging comprising the augmented reality data will be realized in virtual or real environment; and the messages are sent in an environment determined by the other party. Thereby, the user selects over the interface of the application (3) whether the augmented reality mode will be realized in a virtual or real environment.
The server (4) included in the inventive system (1) is configured to receive the message content reaching the electronic device (2); to determine the type of the message content received; to analyse the message content on the basis of the message type it determined; and to obtain information about the content. The server (4) is preferably configured to communicate with external servers wherein the message contents are included in order to analyse the message content it received. Thereby, accuracy of the augmented reality data to be added is increased by analysing the message content with high precision. The server (4) is configured to add the augmented reality data -that is compatible with the content information it received after analysis- into the message content and to share it with the application (3) over the electronic device (2). The server (4) adds the augmented reality data into the message content reaching the electronic device (2) over the application (3), on the basis of the virtuality or reality selection made over the application (3); and ensures that it is shared with the user by resending it to the application (3). For example, when a message comprising a sad emoji is delivered
to the application (3), the server (4) first determines the message type and in case that it determines that the message type comprises media, it adds compatible augmented reality data into the related message content and then resends it to the application (3). When a sad emoji is delivered to the application (3), the server (4) ensures that the avatar of the message owner looks sad by using augmented reality on the application (3).
The server (4) adds augmented reality data onto the avatar -that is usually a photo or content symbolizing the message owner- on the basis of the message type and content received over the application (3). Thereby, when a sad emoji is included in the message content, the sad face status of the message owner is shared with the other party from the application (3).
In the inventive system (1), in order that message contents can be received by augmented reality, users determine the chat type over the application (3) as augmented reality and then decides on whether the messaging comprising the augmented reality data will be realized in virtual or real environment. In the inventive system (1), after the chat type and the augmented reality environment are determined, the server (4) receives the message reaching the application (3); determines the message type; and analyses the content thereof. The server (4) adds the augmented reality data into the content information obtained as a result of the content analysis and shares it with the user over the application (3). Thereby, avatar of the message owner created by the augmented reality and his/her messages are viewed on the application (3).
With the inventive system (1), it is ensured that the chats wherein a plurality of users included in the messaging applications (3) running on the electronic device (2), are presented to users’ experience in virtual or real environment. With the inventive system (1), due to the fact that the message type characteristics used in the chat are transferred to the virtual environment and the message contents are
interpreted further, the communication problems encountered are avoided by bringing the feelings into the forefront in the messaging applications (3) further.
It is possible to develop various embodiments of the inventive system for using augmented reality in messaging applications (1); the invention cannot be limited to examples disclosed herein and it is essentially according to claims.
Claims
1. A system (1) for enabling addition of compatible augmented reality content into a message content comprising - at least one electronic device (2) which is configured to run at least one application on itself; characterized by at least one application (3) which runs on the electronic device (2) and is configured to ensure that the messaging content among the electronic devices (2) are transmitted over external server and the image or content and message contents symbolizing the person are viewed by augmented reality in a virtual or real environment; and at least one server (4) which is configured to decide on the message type - -that can be text, photo or sound- of the message content reaching from a messaging server to the application (3) in mutual messaging; to analyse the message content based on the message type it determines; and to add augmented reality content into the message; and to send the message wherein it added the augmented reality data to the application (3) of the other party.
2. A system (1) according to Claim 1; characterized by the electronic device (2) which is a device such as mobile phone, tablet computer, desktop computer or portable computer.
3. A system (1) according to Claim 1 or 2; characterized by the electronic device (2) which is configured to perform data exchange by using any communication protocol.
4. A system (1) according to any of the preceding claims; characterized by the electronic device (2) which performs data exchange over a mobile communication network or a data bus such as Internet.
5. A system (1) according to any of the preceding claims; characterized by the application (3) which is an instant messaging application configured to be run on the electronic device (2) and to present at least one interface.
6. A system (1) according to any of the preceding claims; characterized by the application (3) which is configured to enable users to make data entry.
7. A system (1) according to any of the preceding claims; characterized by the application (3) wherein message contents comprising elements such as text, sound, video, photo are created on the interface that it owns; and the elements included in the content of the incoming message are viewed.
8. A system (1) according to any of the preceding claims; characterized by the application (3) which is configured to ensure that the chat type is selected as augmented reality; it is determined by the user whether the messaging comprising the augmented reality data will be realized in virtual or real environment; and the messages are sent in an environment determined by the other party.
9. A system (1) according to any of the preceding claims; characterized by the server (4) which is configured to receive the message content reaching the electronic device (2); to determine the type of the message content received; to analyse the message content on the basis of the message type it determined; and to obtain information about the content.
10. A system (1) according to any of the preceding claims; characterized by the server (4) which is configured to communicate with external servers wherein
the message contents are included in order to analyse the message content it received.
11. A system (1) according to any of the preceding claims; characterized by the server (4) which is configured to add the augmented reality data -that is compatible with the content information it received after analysis- into the message content and to share it with the application (3) over the electronic device (2).
12. A system (1) according to any of the preceding claims; characterized by the server (4) which adds the augmented reality data into the message content reaching the electronic device (2) over the application (3), on the basis of the virtuality or reality selection made over the application (3); and ensures that it is shared with the user by resending it to the application (3).
13. A system (1) according to any of the preceding claims; characterized by the server (4) which adds augmented reality data onto the avatar -that is usually a photo or content symbolizing the message owner- on the basis of the message type and content received over the application (3).
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TR2019/19286 | 2019-12-04 | ||
| TR201919286 | 2019-12-04 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2021112807A1 true WO2021112807A1 (en) | 2021-06-10 |
Family
ID=76221856
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/TR2020/051234 WO2021112807A1 (en) | 2019-12-04 | 2020-12-04 | A system for using augmented reality in messaging applications |
Country Status (1)
| Country | Link |
|---|---|
| WO (1) | WO2021112807A1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114125491A (en) * | 2022-01-20 | 2022-03-01 | 阿里巴巴（中国）有限公司 | Virtual live broadcast control method and device |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140181229A1 (en) * | 2012-08-15 | 2014-06-26 | Imvu Inc. | System and method for increasing clarity and expressiveness in network communications |
| US20180143761A1 (en) * | 2016-11-22 | 2018-05-24 | Lg Electronics Inc. | Mobile terminal and method for controlling the same |
| US20190228552A1 (en) * | 2018-01-22 | 2019-07-25 | Samsung Electronics Co., Ltd. | Electronic device providing text-related image and method for operating the same |
-
2020
- 2020-12-04 WO PCT/TR2020/051234 patent/WO2021112807A1/en active Application Filing
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140181229A1 (en) * | 2012-08-15 | 2014-06-26 | Imvu Inc. | System and method for increasing clarity and expressiveness in network communications |
| US20180143761A1 (en) * | 2016-11-22 | 2018-05-24 | Lg Electronics Inc. | Mobile terminal and method for controlling the same |
| US20190228552A1 (en) * | 2018-01-22 | 2019-07-25 | Samsung Electronics Co., Ltd. | Electronic device providing text-related image and method for operating the same |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114125491A (en) * | 2022-01-20 | 2022-03-01 | 阿里巴巴（中国）有限公司 | Virtual live broadcast control method and device |
| WO2023138640A1 (en) * | 2022-01-20 | 2023-07-27 | 阿里巴巴（中国）有限公司 | Virtual livestream control method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20170041254A1 (en) | Contextual content sharing using conversation medium | |
| KR102327571B1 (en) | Displaying video call data | |
| AU2013280679B2 (en) | Communication system | |
| KR100968298B1 (en) | User interface for conducting chats over a network | |
| CN102150443B (en) | System and methods for communication between instant message users and short message service users | |
| US8775561B2 (en) | Expanding a social network by the action of a single user | |
| CN103326923B (en) | Method and device for information sharing | |
| US20100050092A1 (en) | Content Sharing and Instant Messaging | |
| JP6560453B2 (en) | Information updating method and apparatus, and server | |
| CN102138156A (en) | Persisting a group in an instant messaging application | |
| US9083693B2 (en) | Managing private information in instant messaging | |
| CN102859480A (en) | Screen sharing | |
| US20160127292A1 (en) | Method and system for controlling polling in message conversations across multiple devices | |
| US20130007142A1 (en) | Processing A Message | |
| EP3105891B1 (en) | Instant messaging with non subscriber users | |
| US20170019484A1 (en) | System and method for aggregating communication connections | |
| CN104219132A (en) | Method and system of implementing multi-party communication as well as information server | |
| US20160294982A1 (en) | Unified Location & Presence, Communication Across Real and Virtual Worlds | |
| WO2021112807A1 (en) | A system for using augmented reality in messaging applications | |
| WO2016149312A1 (en) | Information sharing control | |
| JP2010087704A (en) | Communication method, server device, and system for the same | |
| US20140038649A1 (en) | Connection System and Method to Dynamically Create and Collect a Group of Contextual Contacts | |
| CN115421841A (en) | Notification processing method, terminal device, server and computer storage medium | |
| EP2294780B1 (en) | A method for masking data | |
| US11948208B1 (en) | Variable graphical representations based upon graph-node distance |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 20897037 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 20897037 Country of ref document: EP Kind code of ref document: A1 |