US20140313542A1 - Cloud services platform - Google Patents
Cloud services platform Download PDFInfo
- Publication number
- US20140313542A1 US20140313542A1 US14/216,967 US201414216967A US2014313542A1 US 20140313542 A1 US20140313542 A1 US 20140313542A1 US 201414216967 A US201414216967 A US 201414216967A US 2014313542 A1 US2014313542 A1 US 2014313542A1
- Authority
- US
- United States
- Prior art keywords
- document
- user
- printer
- identification
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/12—Digital output to print unit, e.g. line printer, chain printer
- G06F3/1201—Dedicated interfaces to print systems
- G06F3/1278—Dedicated interfaces to print systems specifically adapted to adopt a particular infrastructure
- G06F3/1292—Mobile client, e.g. wireless printing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/50—Network service management, e.g. ensuring proper service fulfilment according to agreements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/12—Digital output to print unit, e.g. line printer, chain printer
- G06F3/1201—Dedicated interfaces to print systems
- G06F3/1202—Dedicated interfaces to print systems specifically adapted to achieve a particular effect
- G06F3/1203—Improving or facilitating administration, e.g. print management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/12—Digital output to print unit, e.g. line printer, chain printer
- G06F3/1201—Dedicated interfaces to print systems
- G06F3/1223—Dedicated interfaces to print systems specifically adapted to use a particular technique
- G06F3/1224—Client or server resources management
- G06F3/1226—Discovery of devices having required properties
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/12—Digital output to print unit, e.g. line printer, chain printer
- G06F3/1201—Dedicated interfaces to print systems
- G06F3/1223—Dedicated interfaces to print systems specifically adapted to use a particular technique
- G06F3/1237—Print job management
- G06F3/126—Job scheduling, e.g. queuing, determine appropriate device
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/12—Digital output to print unit, e.g. line printer, chain printer
- G06F3/1201—Dedicated interfaces to print systems
- G06F3/1278—Dedicated interfaces to print systems specifically adapted to adopt a particular infrastructure
- G06F3/1285—Remote printer device, e.g. being remote from client or server
- G06F3/1287—Remote printer device, e.g. being remote from client or server via internet
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/10—Office automation; Time management
- G06Q10/101—Collaborative creation, e.g. joint development of products or services
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/10—Office automation; Time management
- G06Q10/103—Workflow collaboration or project management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0207—Discounts or incentives, e.g. coupons or rebates
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0207—Discounts or incentives, e.g. coupons or rebates
- G06Q30/0237—Discounts or incentives, e.g. coupons or rebates at kiosk
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
- H04L12/2803—Home automation networks
- H04L12/2816—Controlling appliance services of a home automation network by calling their functionalities
- H04L12/2818—Controlling appliance services of a home automation network by calling their functionalities from a device located outside both the home and the home network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
- H04L67/025—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP] for remote control or remote monitoring of applications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
- H04L67/125—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks involving control of end-device applications over a network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/43615—Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals
Definitions
- This application relates generally to managing and controlling distributed electronic peripherals.
- Embodiments of the disclosed technology comprise a cloud-hosted central service platform that interfaces and enables access to both central and distributed resources and on-premises electronic peripherals for connected mobile or web applications.
- this platform allows service providers and application developers to create a large number of new classes of applications, leveraging web access to devices, sensors, and/or actuators of any kind.
- This platform can be applied to virtually any vertical segment including, but not limited to, automotive, telehealth care, home automation, retail, etc.
- Embodiments of the disclosed platform can also be used as the foundation of large scale systems controlled by a single operator, such as a government agency, a transportation consortium, a retail operator, a building operator, airport operator, and/or any single operator having some control over a plurality of distributed peripheral devices.
- companies with large distributed, connected assets that can benefit from a centralized control point can utilize such a platform.
- FIG. 1 illustrates a generalized example of a suitable computing hardware environment for a computing device with which several of the described embodiments can be implemented.
- FIG. 2 is a block diagram illustrating a convergence space of the mobile internet, the internet of things, and cloud computing and big data.
- FIG. 3 is a block diagram showing one illustrative architecture for a cloud services platform (CSP) according to the disclosed technology.
- CSP cloud services platform
- FIG. 4 is a schematic block diagram showing an example of an illustrative architecture according to the disclosed technology compared to a more traditional architecture.
- FIG. 5 is a schematic block diagram showing another illustrative architecture of a system according to one embodiment of the disclosed technology.
- FIG. 6 is a schematic block diagram showing one illustrative architecture for the components of the one or more central nodes.
- FIG. 7 is a block diagram showing services that can be available according to one illustrative embodiment of the disclosed technology.
- FIG. 8 is a schematic block diagram showing an illustrative architecture for the software components that can be used to implement a CSP edge node according to one embodiment of the disclosed technology.
- FIG. 9 is schematic block diagram of an illustrative example system architecture comprising a backend, a frontend, and mobile devices, which can be operated by a user to interact with the one or more peripherals.
- FIG. 10 is a schematic block diagram showing another example system architecture showing both the central node and the edge node in communication with one another via a network.
- FIG. 11 is a block diagram of an example network configuration for implementing embodiments of the technology.
- FIG. 12 is a schematic block diagram that illustrates an example of a real-time inner loop for managed peripherals.
- FIG. 13 is a schematic block diagram illustrating an example arrangement by which clusters of devices and peripherals are exposed on the internet.
- FIG. 14 is a schematic block diagram illustrating an edge node arrangement configured to expose peripheral services on the internet.
- FIG. 15 is a schematic block diagram illustrating an example arrangement for how a unified UI can be used with a connected cluster of heterogeneous devices.
- FIG. 16 is a schematic block diagram illustrating an exemplary arrangement of the disclosed technology that allows a mobile device to be mirrored on a TV screen screen over the internet.
- FIG. 17 is a schematic block diagram illustrating an exemplary arrangement of the disclosed technology for publishing targeted commercial content.
- FIG. 18 illustrates another example of a system according to the disclosed technology in which heterogenous clusters of peripherals are connected via a central node.
- FIG. 19 is a block diagram illustrating various components of an example printing solution and method acts that can be performed.
- FIG. 20 is a high-level flow chart illustrating the various actions performed according to one exemplary printing flow.
- FIGS. 21-30 illustrate exemplary screen shots for a printing flow.
- FIGS. 31-32 illustrate an exemplary display screen implementation for the disclosed technology.
- FIGS. 33-41 illustrate an exemplary check-in kiosk implementation for the disclosed technology.
- FIGS. 42-50 illustrate an exemplary document authentication implementation for the disclosed technology.
- FIGS. 51-58 illustrate an exemplary document authentication implementation for the disclosed technology.
- FIG. 59 is a block diagram of another embodiment of the one or more central nodes.
- FIG. 60 is an entity-relation diagram showing one illustrative relationship model for data in an embodiment of the disclosed technology.
- FIGS. 61A and 61B are schematic block diagrams showing one illustrative physical model of data according to an embodiment of the disclosed technology.
- FIG. 62 is a flowchart illustrating method acts performed by an application executed on a user's mobile device for implementing an exemplary print-to-TV flow using a cloud service platform.
- FIG. 63 is a flowchart illustrating method acts performed by a central server for implementing an exemplary print-to-TV flow using a cloud service platform.
- FIG. 64 is a flowchart illustrating method acts performed by an application executed on a user's mobile device for implementing an exemplary printing flow using a cloud service platform.
- FIG. 65 is a flowchart illustrating method acts performed by a central server for implementing an exemplary printing flow using a cloud-based platform.
- FIG. 66 is a flowchart illustrating method acts performed by an edge node and associated peripherals for implementing an exemplary check-in method using a cloud service platform.
- FIG. 67 is a flowchart illustrating method acts performed by a central server in communication with the edge node for implementing an exemplary check-in method using a cloud service platform.
- FIG. 68 is a flowchart illustrating method acts performed by an edge node and associated peripherals for implementing an exemplary shipping method using a cloud service platform.
- FIG. 69 is a flowchart illustrating method acts performed by a central server in communication with the edge node for implementing an exemplary shipping method using a cloud service platform.
- Disclosed below are representative embodiments of methods, apparatus, and systems for managing and controlling distributed peripherals.
- the disclosed methods, apparatus, and systems should not be construed as limiting in any way. Instead, the present disclosure is directed toward all novel and nonobvious features and aspects of the various disclosed embodiments, alone and in various combinations and subcombinations with one another. Furthermore, any features or aspects of the disclosed embodiments can be used in various combinations and subcombinations with one another or with other methods, apparatus, and systems.
- the disclosed methods, apparatus, and systems are not limited to any specific aspect or feature or combination thereof, nor do the disclosed embodiments require that any one or more specific advantages be present or problems be solved.
- Any of the disclosed methods can be implemented by computer-executable instructions stored on one or more computer-readable media (e.g., non-transitory computer-readable media, such as one or more optical media discs, volatile memory components (such as DRAM or SRAM), or nonvolatile memory components (such as hard drives)) executing on a computer (e.g., any commercially available computer), or some combination thereof.
- a computer e.g., any commercially available computer
- Any of the computer-executable instructions for implementing the disclosed techniques e.g., the disclosed peripheral management, peripheral control, or other techniques
- any intermediate or final data created and used during implementation of the disclosed systems can be stored on one or more computer-readable media (e.g., non-transitory computer-readable media).
- the computer-executable instructions can be part of, for example, a dedicated software application or as part of an application that is accessed or downloaded via a network (e.g., a local-area network, a wide-area network, a client-server network, or other such network).
- a network e.g., a local-area network, a wide-area network, a client-server network, or other such network.
- Such software can be executed on a single computer (e.g., a computer embedded in or electrically coupled to a printer, multiple purpose printing kiosk, display device, scanning apparatus, actuator, sensor, or other device or system with which the disclosed technology may operate) or in a network environment.
- the software can be executed by a computer embedded in or communicatively coupled to a printer, multiple purpose printing kiosk, display device, scanning apparatus, or other device or system with which the disclosed technology may operate.
- any of the software-based embodiments can be uploaded, downloaded, or remotely accessed through a suitable communication means.
- suitable communication means include, for example, the Internet, the World Wide Web, an intranet, software applications, cable (including fiber optic cable), magnetic communications, electromagnetic communications (including RF, microwave, and infrared communications), electronic communications, or other such communication means.
- the disclosed methods can also be implemented by specialized computing hardware that is configured to perform any of the disclosed methods.
- the disclosed methods can be implemented by a computing device comprising an integrated circuit (e.g., an application specific integrated circuit (“ASIC”) or programmable logic device (“PLD”), such as a field programmable gate array (“FPGA”)).
- ASIC application specific integrated circuit
- PLD programmable logic device
- FPGA field programmable gate array
- the integrated circuit or specialized computing hardware can be embedded in or directly coupled to a printer, multiple purpose printing kiosk, display device, scanning apparatus, actuator, sensor, or other device or system with which the disclosed technology may operate.
- FIG. 1 illustrates a generalized example of a suitable computing hardware environment 100 for a computing device with which several of the described embodiments can be implemented.
- the computing environment 100 is not intended to suggest any limitation as to the scope of use or functionality of the disclosed technology, as the techniques and tools described herein can be implemented in diverse general-purpose or special-purpose environments that have computing hardware.
- the computing environment 100 includes at least one processing unit 110 and memory 120 .
- the processing unit 110 executes computer-executable instructions.
- the memory 120 may be volatile memory (e.g., registers, cache, RAM), non-volatile memory (e.g., ROM, EEPROM, flash memory), or some combination of the two.
- the memory 120 stores software 180 for implementing one or more of the described techniques for operating or using the disclosed systems.
- the memory 120 can store software 180 for implementing any of the disclosed peripheral management, use, or control examples or techniques.
- the computing environment can have additional features.
- the computing environment 100 includes storage 140 , one or more input devices 150 , one or more output devices 160 , and one or more communication connections 170 .
- An interconnection mechanism such as a bus, controller, or network interconnects the components of the computing environment 100 .
- operating system software provides an operating environment for other software executing in the computing environment 100 , and coordinates activities of the components of the computing environment 100 .
- the storage 140 can be removable or non-removable, and includes magnetic disks, magnetic tapes or cassettes, CD-ROMs, DVDs, or any other tangible non-transitory storage medium which can be used to store information and which can be accessed within the computing environment 100 .
- the storage 140 can also store instructions for the software 180 implementing any of the described techniques, systems, or environments.
- the input device(s) 150 can be a touch input device such as a keyboard, mouse, touch screen, pen, or trackball, a voice input device, a scanning device, or another device that provides input to the computing environment 100 .
- the output device(s) 160 can be a display, touch screen, printer, speaker, or another device that provides output from the computing environment 100 .
- the communication connection(s) 170 enable communication over a communication medium to another computing entity.
- the communication medium conveys information such as computer-executable instructions or other data in a modulated data signal.
- a modulated data signal is a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal.
- communication media include wired or wireless techniques implemented with an electrical, optical, RF, infrared, acoustic, or other carrier.
- Computer-readable media are any available media that can be accessed within or by a computing environment.
- Computer-readable media include tangible non-transitory computer-readable media, such as memory 120 and storage 140 , and do not encompass transitory carrier waves or signals.
- program modules include routines, programs, libraries, objects, classes, components, data structures, and/or the like that perform particular tasks or implement particular abstract data types.
- the functionality of the program modules may be combined or split between program modules as desired in various embodiments.
- Computer-executable instructions for program modules may be executed within a local or distributed computing environment.
- Embodiments of the disclosed technology are designed to take advantage of three major trends in today's information technology: (i) cloud computing; (ii) the “internet of things”; and (iii) mobile applications. As shown in the diagram 200 of FIG. 2 , embodiments of the disclosed technology lie in the convergence space (termed embedded cloud space 210 ) of the mobile internet 220 , the internet of things 222 , and cloud computing and big data 224 .
- Certain embodiments of the disclosed technology comprise a cloud-hosted central service platform that interfaces and enables access to both central and distributed resources and on-premises peripherals for connected mobile or web applications.
- this platform allows service providers and application developers to create a large number of new classes of applications, leveraging web access to devices, sensors, and/or actuators of any kind.
- This platform can be applied to virtually any vertical segment including, but not limited to, automotive, telehealth care, home automation, retail, etc.
- Embodiments of the disclosed platform can also be used as the foundation of large scale systems controlled by a single operator, such as a government agency, a transportation consortium, a retail operator, a building operator, airport operator, and/or any single operator having some control over a plurality of distributed peripheral devices.
- companies with large distributed, connected assets that can benefit from a centralized control point can utilize such a platform.
- FIG. 3 is a block diagram showing one illustrative architecture 300 for a cloud services platform (CSP) according to the disclosed technology.
- the architecture 300 provides access from a mobile device 310 (such as a smartphone or tablet) to a desired one or more peripherals (shown collectively as peripheral(s) 320 ), which are connected to a CSP edge node 340 through a web service layer 330 (which, in the illustrated embodiment, is implemented through a cloud-hosted backend 332 ).
- a mobile device 310 such as a smartphone or tablet
- peripherals shown collectively as peripheral(s) 320
- a web service layer 330 which, in the illustrated embodiment, is implemented through a cloud-hosted backend 332 .
- proprietary hardware can be replaced by consumer/off-the-shelf peripherals (e.g., printers, scanners, monitors, card readers, sensors, actuators, and other such peripheral devices) shown at 320 .
- a publicly available web service layer 330 serves as the bridge between the peripheral(s) 320 and the one or more mobile devices 310 .
- the mobile device may execute one or more applications that can be (i) a native, connected application designed for the particular mobile device, (ii) a web application split between the client (rendering on the mobile equipment) and a server hosted on a network, such as the Internet, or (iii) some combination of both.
- applications can be (i) a native, connected application designed for the particular mobile device, (ii) a web application split between the client (rendering on the mobile equipment) and a server hosted on a network, such as the Internet, or (iii) some combination of both.
- FIG. 3 Other illustrative details of the architecture are shown in FIG. 3 itself. It should be noted that the particular configuration shown in FIG. 3 is for example purposes only and that any of the implementation details illustrated in FIG. 3 can be used alone or in any combination or subcombination with one another or substituted for other frontend or backend components.
- the illustrative CSP architecture 300 comprises one or more of: (a) one or more central nodes designed to host the platform core and enabling services (e.g., hosted in the web service layer 330 ); (b) one or more edge nodes, such as edge node 340 , designed to interface with on-premises peripherals; and (c) one or more mobile devices, such as mobile device 310 , implementing the user experience of the services.
- Certain implementations of the architecture allow real-time and/or low-latency interactions with an application agent/interface loaded on the edge node (e.g., edge node 340 ) of the solution platform.
- the architecture 300 can use one or more mobile applications configured to be executed by mobile devices, such as the mobile phone or tablet 310 .
- Example applications 312 , 314 are illustrated with mobile device(s) 310 .
- the one or more applications 312 , 314 executed by the mobile device(s) 310 can provide a user interface for allowing a user to select and use one or more services implemented in part by the peripheral(s) 320 and can also be used to help ensure continuous access to the central node of the platform (e.g., hosted in the web service layer 330 ).
- the mobile applications 312 , 314 executed on the mobile device(s) 320 may utilize the (managed) services implemented by the combination of central nodes, edge nodes and peripherals.
- These mobile applications 312 , 314 may, for example, be developed by external application developers and service providers, and then invoked by an end user of a mobile device to obtain a service.
- the mobile applications 312 , 314 may be, for example, mobile client-server Web applications with the client-side executing on a mobile device 310 (e.g., in a mobile web browser) and a server-side hosted in Internet application servers.
- FIG. 4 is a schematic block diagram showing an example of an illustrative architecture 410 according to the disclosed technology compared to a more traditional architecture 400 .
- FIG. 4 shows a monolithic approach 400 for providing cloud-based application versus a public approach 410 in which a common platform exists (operated by a platform operator) on which multiple service providers can create and implement a variety of different applications that can be downloaded or otherwise accessed by consumers and used to operate, use, and/or otherwise engage one or more consumer peripherals (e.g., any of the peripherals mentioned herein).
- the particular diagram in FIG. 4 does not feature load balancing and clustering for the public approach 410 , although it should be understood that such features can be available in embodiments of the disclosed technology.
- FIG. 5 is a schematic block diagram showing another illustrative architecture 500 of a system according to one embodiment of the disclosed technology.
- the architecture 500 includes a mobile end 510 (e.g., comprising one or more mobile devices 512 operated by an end user), a cloud-based back end 520 (e.g., comprising one or more central nodes 522 implemented using cloud-based hosted servers), and a front end 530 (e.g., comprising one or more edge nodes 532 that are communicatively coupled to one or more peripherals and configured to control the functionality of the peripherals (for instance, to receive and/or send data from a printer, scanner, monitor, actuator, sensor, or any other such peripheral device).
- a mobile end 510 e.g., comprising one or more mobile devices 512 operated by an end user
- a cloud-based back end 520 e.g., comprising one or more central nodes 522 implemented using cloud-based hosted servers
- a front end 530 e.g., comprising one or
- the illustrative architecture provides an outer communication loop 542 involving the backend 520 , and an inner communication loop 540 that substantially omits the backend 520 .
- the mobile end 510 and the front end 530 may provide a direct, low latency, real-time interaction between a managed peripheral and the edge node of the solution end.
- the one or more central nodes can be running on a public infrastructure (e.g., any publicly available cloud-based hosting service) and can implement any one or more of the following functionalities:
- FIG. 6 is a schematic block diagram showing one illustrative architecture 600 for the components of the one or more central nodes.
- the illustrated embodiment should not be construed as limiting, however, as any one or more of the components can be implemented alone or in combination or subcombination with one or more of the other components.
- FIG. 59 Another embodiment of the one or more central nodes is illustrated in architecture 5900 of FIG. 59 .
- the components in the architecture 5900 are self-labeled and are not to be construed as limiting. Instead, the components can be used alone or in any combination or subcombination with one another.
- the central data server hosts a data model that implements any one or more of the following:
- FIG. 60 is an entity-relation diagram showing one illustrative relationship model 6000 for data in an embodiment of the disclosed technology.
- the relationships and particular data objects shown in FIG. 60 should not be construed as limiting, however, as other implementations can use any one or more of the data objects or any one or more of the illustrated relationship alone or in any combination with one another.
- FIGS. 61A and B are schematic block diagrams showing one illustrative physical model 6100 A and 6100 B of data according to an embodiment of the disclosed technology.
- the relationships and particular data objects shown in FIGS. 61A and 61B should not be construed as limiting, however, as other implementations can use any one or more of the data objects or any one or more of the illustrated relationship alone or in any combination with one another.
- FIG. 7 is a block diagram 700 showing services that can be available according to one illustrative embodiment of the disclosed technology.
- the services and arrangement of services shown in FIG. 7 are by way of example only. Any one or more of the services can be offered alone or in any combination with one another.
- the illustrative service view shown in FIG. 7 provides a high-level description of the services that the CSP can provide to various actors, including, for example:
- the CSP edge nodes implement any one or more of the following functionalities:
- FIG. 8 is a schematic block diagram showing an illustrative architecture 800 for the software components that can be used to implement a CSP edge node according to one embodiment of the disclosed technology.
- the edge node is implemented using Freescale i.MX6Q boards with one or more quad-core ARM processors running Mentor Graphics' embedded Linux.
- the edge node can be configured to manage and control the peripherals via one or more central APIs.
- the edge node can comprise one or more connectors, including one or more of a USB port, HDMI port, Ethernet port, or any other port and associated driver hardware for connecting and controlling one or more peripherals.
- the illustrative embodiment shown in FIG. 8 should not be construed as limiting in any way, however, as any of the components can be used alone or in any combination or subcombination with one another.
- businesses may desire the edge node to have additional features.
- the edge node can have one or more additional features, including one or more of:
- FIG. 9 is schematic block diagram of an illustrative example system architecture 900 comprising a backend 912 (which can be the central node 600 and further include one or more of the illustrated components), a frontend 910 (which can be one or more the edge nodes 800 and further include one or more of the illustrated components), and mobile devices 920 , which can be operated by a user to interact with the one or more peripherals 914 .
- the communications between the backend 912 and the frontend 910 as well as the communications between the backend 912 and the mobile devices 920 can be facilitated, for example, via the internet or other public network.
- the illustrative embodiment shown in FIG. 9 should not be construed as limiting in any way, however, as any of the components can be used alone or in any combination or subcombination with one another.
- FIG. 10 is a schematic block diagram showing another example system architecture 1000 showing both the central node 1012 and the edge node 1010 in communication with one another via a network 1020 .
- the network 1020 can be, for example, the internet or other public network.
- the illustrative embodiment shown in FIG. 10 should not be construed as limiting in any way, however, as any of the components can be used alone or in any combination or subcombination with one another.
- One example embodiment of the disclosed technology is a system comprising: one or more central servers configured to host a set of web services and applications; and one or more edge nodes in communication with the one or more central servers, each of the one or more edge nodes being further configured to drive two or more peripherals, wherein the web services and applications are configured to be accessed by a mobile device separate from the central servers and the edge nodes and to facilitate operation of at least one of the peripherals driven by an edge node at a location in common with the mobile device without the mobile device directly communicating with the at least one of the peripherals.
- the two or more peripherals can be non-internet-enabled electronic peripherals.
- Another example embodiment of the disclosed technology is a system, comprising: one or more central servers; and one or more edge nodes in communication with the one or more central servers, each of the one or more edge nodes comprising an edge node processor executing edge node software services including one or more of (a) a local web server/proxy request parser; (b) a local web browser configured to provide a local interface and execution client; and (c) one or more local device handlers or drivers, each of the one or more edge nodes being further configured to control one or more peripheral devices.
- the one or more peripherals can be non-internet-enabled electronic peripherals.
- the one or more peripheral devices can comprise two or more heterogeneous peripherals that operate using (a) different peripheral drivers;
- the one or more central servers can host one or more web services accessible via a mobile device application, at least one of the web services being configured to communicate with a respective edge node and drive a respective peripheral connected to the edge node in response to a request from a mobile device executing the mobile device application at a location coincident with the respective peripheral.
- Illustrative embodiments of the disclosed technology are configured with scalability in mind.
- certain implementations of the disclosed technology are configured to handle a large number of recurrent transactions.
- implementations of the disclosed technology are designed to reach to people in strategic places of their day to day life such as their office, their car, or their home.
- Applications can be provided to such individuals through the use of their mobile devices.
- the mobile devices can leverage the peripheral environment that surrounds them.
- smartphones are becoming so ubiquitous that it is desirable to provide one or more applications that can be distributed to these smartphones and allow the user to access peripherals that exist or can exist throughout the environments that the user occupies in the course of their lives.
- any place with an identifiable set of peripherals can be targeted by the described technology, such as for example: hospital, mall, stadium, point of historical or sociological interest, and/or the like.
- a set of peripherals e.g., a printer, scanner, monitor, actuator, sensor, or other such peripheral device
- a system ecosystem e.g., a system of interconnected peripheral devices
- the disclosed technology can be deployed in a variety of environments.
- Example environments are disclosed below, but such environments should not be construed as limiting, as the number of the environments in which aspects of the disclosed technology can be used are not limited.
- any number or variety of peripherals can be coupled to an edge node and used to create a customized deployment of the disclosed cloud-based service platform.
- the peripherals can include, for instance, one or more of: a multi-touch display, an image capture device (e.g., a camera), a microphone, a keypad, an RFID reader, a fingerprint reader, a Wi-Fi access point, a USB connector, a scanner (e.g., a barcode reader), a document scanner, a scale, a display device (e.g., a digital sign), a credit card reader, a smart card reader, a USB/phone charger, or other such electronic peripheral.
- a multi-touch display e.g., an image capture device (e.g., a camera), a microphone, a keypad, an RFID reader, a fingerprint reader, a Wi-Fi access point, a USB connector, a scanner (e.g., a barcode reader), a document scanner, a scale, a display device (e.g., a digital sign), a credit card reader, a smart card reader, a USB/phone charger, or other such electronic peripheral.
- the office peripherals can comprise office peripherals such as: one or more printers, scanners, copiers, scales, coffee machines, information displays, access control systems, or the like;
- a car environment comprising one or more car peripherals
- the peripherals can comprise peripherals such as: one or more automotive built-in instrument controls (e.g., speed, acceleration, motor control, and/or the like), safety systems, navigation systems, user mobile phones on a dock, cameras, multimedia devices, driver assistance sensors, driver assistance actuators, or the like;
- a health care environment comprising one or more health care peripherals.
- the peripherals can comprise peripherals such as: one or more connected weight scales, blood pressure monitors, oxygen meters, glucose meters, cameras, external body sensors, internal body sensors/actuators (e.g., pacemakers), or the like.
- a connected home environment comprising one or more home peripherals.
- the home peripherals can comprise peripherals such as: printers, scanners, copiers, cameras, burglar alarms, electricity/gas meters, TVs, access systems, remote controls, or the like.
- a platform operator can be used to administrate the central platform as described above and allow any one or more application developers or any one or more peripheral and/or service suppliers to participate in the advantages of embodiments of the disclosed architecture.
- a “platform operator” can be formed to administrate the platform and collect operating revenues.
- this operator can collect recurrent revenues as the platform is utilized by multiple applications and/or operated by multiple service providers. Since platform services are managed, multiple business models can be implemented and enforced. For example, the platform services can be offered according to one or more of the following business models:
- barriers to entry to use embodiments of the disclosed technology can be lowered, using for example any one or more of the following techniques:
- the managed APIs are given access to application developers.
- the APIs can be accessed and distributed through an “API store” web portal that presents peripheral and peripheral-related services in an intuitive way (similar to a mobile app store that is now a common experience).
- the web developer can then pick and choose the pay-per-use APIs he/she is interested in for a given application and subscribe to (or purchase) them.
- the application developer can then create any connected application (e.g., web application, native application or hybrid application) using/calling the APIs he/she has subscribed to.
- an applications' metadata (or other description) is advertised to end users via a CSP-specific application store.
- the barrier to entry is desirably high. According to embodiments of the disclosed technology, this is the case at many different levels.
- One or more of the following can be used to help secure a high barrier of entry for competitive platform providers:
- This service operator can collect, for example, subscription revenue directly from the end users.
- Various implementations of the technology may be used to allow a variety of mobile computing devices to work with a variety of stationary or semi-stationary supported computing devices.
- FIG. 11 is a block diagram of an example network configuration 1100 for implementing embodiments of the technology.
- the network configuration 1100 implementing various aspects of the technology can include a Web service layer host 1103 , a plurality of mobile computing devices 1105 , and a plurality of supported computing devices 1107 .
- the network configuration 1100 also may include an edge node host 1109 , a display device 1111 , or some combination of both.
- a user will initially carry a mobile computing device 1105 , such the smartphone 1105 A or a tablet computing device 1105 B, to a location having one or more supported computing devices 1107 .
- the supported computing devices 1107 include a printer 1107 A and a multifunction device 1107 B, but with alternate implementations of the technology the supported computing devices 1107 may be medical testing or evaluation devices, devices used for shipping (such as scales), resource tracking devices such as those used in retail stores or warehouses, or others.
- a recognition application is launched by the mobile computing device 1105 .
- the recognition application can be manually launched by the user of the mobile computing device 1105 .
- the recognition application can be manually launched in response to some stimulus, such as a particular movement of the mobile computing device 1105 , an electromagnetic or sonic signal, a trigger from a positioning application (e.g., a Global Positioning Satellite position indication application), etc.
- the user then employs the recognition application of the mobile computing device 1105 to obtain supported device identification information identifying at least one of the supported computing devices 1107 .
- the recognition application may be used to scan an identification marker physically located on a supported computing device 1107 , such as a Near Field Communication (NFC) marker or a Quick Response (QR) code marker.
- NFC Near Field Communication
- QR Quick Response
- the recognition application may use any known technique to identify a particular supported computing device 1107 .
- the supported device identification information may identify a particular known environment of multiple supported computing devices 1107 .
- the mobile computing device 1105 transmits the supported device identification information to the Web service layer host 1103 .
- the Web service layer host 1103 hosts a CSP backend as described in detail above.
- the mobile computing device 1105 can transmit the supported device identification information to the Web service layer host 1103 using any suitable communication medium, such as, for example, through a public or private electronic communication network (e.g., the internet).
- the mobile computing device 1105 can also transmit user identification information to the Web service layer host 1103 .
- the user identification information will include information identifying the mobile computing device 1105 , the user of the mobile computing device 1105 , the particular known environment of multiple supported computing devices 1107 , or some combination of both.
- the Web service layer host 1103 conveys application information back to the mobile computing device 1105 . More particularly, the Web service layer host 1103 provides the mobile computing device 1105 with application information corresponding to applications associated with the identification information. For example, if the identification information identified a supported computing device 1107 as a particular model of printer, then the application information may correspond to a printing application that allows the mobile computing device 1105 to print from that particular model of printer. Further, if the identification information identified the supported computing device 1107 as being at a particular retail location and identified the user as being a person with a purchase history at that retail location, then the application information may correspond to an application that provides coupons relevant to the user's purchase history and allows the mobile computing device 1105 to print the coupons from that particular model of printer. With various implementations of the technology, the application information may be a list of applications already resident on the mobile computing device 1105 , the applications themselves for subsequent installation, or a link to the applications at another location for downloading or remote execution.
- the associated applications may convey data to the supported computing device 1107 through the Web service layer host 1103 .
- an associated application is a photo application for printing photographs on a supported computing device 1107 that is a particular printer
- the photograph data to be printed may be sent by the mobile computing device 1105 to the Web service layer host 1103 .
- the user may employ the mobile computing device 1105 to select photograph data stored at some remote location accessible to the Web service layer host 1103 (e.g., at a “cloud” storage location).
- the Web service layer host 1103 in turn will relay data from the associated application (e.g., the photograph data to be printed) to the supported computing device 1107 through any suitable communication medium, such as, for example, through a public or private electronic communication network (e.g., the Internet).
- a public or private electronic communication network e.g., the Internet
- the Web service layer host 1103 typically will relay data from the associated application to the supported computing device 1107 through an edge node, as discussed in detail above.
- the supported computing device 1107 will communicate with the Web service layer host 1103 through an edge node located in a separate edge node host 1109 (such as with the multifunction device 1107 B).
- the supported computing device 1107 will communicate with the Web service layer host 1103 through an edge node located in the supported computing device 1107 itself (such as with the printer 1107 A).
- the supported computing device 1107 may alternately or additionally send or exchange data with the supported computing device 1107 directly (either through the edge node or outside of the edge node).
- the Web service layer host 1103 may send additional data to the supported computing device 1107 or another associated device based upon the identification information.
- the network configuration 1100 includes a display monitor 1111 located near the multifunction device 1107 B. If the multifunction device 1107 B and the display monitor 1111 are located at a retail location, they can be used to provide coupon or other sales-related information to the user of the mobile computing device 1105 .
- the identification information identifies the user as being a person with a purchase history at that retail location
- a service application at the Web service layer host 1103 (or at another related location) may generate or otherwise identify advertisement information relevant to the user's purchase history.
- the Web service layer host 1103 may then select the advertisement information for display to the user. For example, the Web service layer host 1103 may transmit generated advertisement information to the display monitor 1111 for display via the edge node 1109 .
- the user may then use the multifunction device 1107 B to print the coupon.
- the user may print the coupon (or otherwise act upon the advertisement information) by interacting with display monitor 1111 , the multifunction device 1107 B, mobile computing device 1105 , or some combination thereof.
- the Web service layer host 1103 may employ the visual displays of two or more of the display monitor 1111 , the multifunction device 1107 B, and the mobile computing device 1105 together to convey information to the user or to otherwise perform some function.
- general advertisement information may be stored and displayed by the mobile computing device 1105 even before the identification information is sent, and subsequently updated and/or further displayed on the display monitor 1111 or on a display of the multifunction device 1107 B in response to the Web service layer host 1103 receiving the identification information.
- the network configuration 1100 may support the use of a greeting card generation application.
- the purchase of a greeting card may be presented to a user on the display monitor 1111 in response to the Web service layer host 1103 receiving the identification information.
- the user may then purchase the card, format the card, take a photograph to add to the card, and sign the card using the mobile computing device 1105 .
- the user may then print the card using the multifunction device 1107 B.
- the mobile computing device 1105 may employ the processing resources of the supported computing device 1107 , an edge node host 1109 , or some combination of both.
- the mobile computing device 1105 may convey a photograph to the multifunction device 1107 B through the Web service layer host 1103 .
- the mobile computing device 1105 may communicate directly with the edge node host 1109 , and may further use processing power available from the edge node host 1109 to format the card prior to printing by the multifunction device 1107 B.
- the recognition application may store identification information for previously recognized supported computing devices 1107 , or alternately or additionally allow a user to remotely obtain identification information for supported computing devices 1107 .
- a user may employ various aspect of the technology to remotely employ supported computing devices 1107 .
- Embodiments of the disclosed technology address this problem by using an edge node on the device/peripheral premises in order to enable a low latency, real-time capable “inner loop” between the managed devices/peripherals and the end user client side of the application.
- This “inner loop” operates in conjunction with the traditional internet “outer loop”.
- FIG. 12 is a schematic block diagram that illustrates an example of a real-time inner loop for managed peripherals.
- edge node 1213 is hosting a local process 1216 in charge of the real-time, low-latency part of the transaction that is taking place between a client application 1210 and a device/peripheral 1214 over the outer loop.
- the local process 1216 is actually a part of the device/peripheral service 1215 the client 1210 has invoked.
- the introduction of this inner loop in the device/peripheral service path allows complex, real time transactions to take place over the control of a web interface.
- the edge node 1213 is equipped with a WiFi transceiver to enable direct communication with the client application 1210 , which will typically be running on a mobile device such as a smartphone or tablet.
- the client application 1210 which will typically be running on a mobile device such as a smartphone or tablet.
- the “outer loop” invoking the internet can be avoided and low-latency processing in the “inner loop” between the edge node and the client application 1210 can be facilitated. In this way, processing for the client application 1210 can be distributed between the edge node and the central node.
- One example embodiment for implementing the distributed processing of peripherals over the internet comprises: one or more central servers; and one or more edge nodes in communication with the one or more central servers via the internet, each of the one or more edge nodes comprising an edge node processor for executing edge node software services and a wireless transceiver, each of the one or more edge nodes being further coupled to and configured to control one or more peripheral devices, wherein a respective one of the edge nodes is configured to provide processing support to an application executing on a mobile device via a direct connection to the respective edge node through the wireless transceiver, thereby avoiding transactions using the internet, wherein the application executing on the mobile device interfaces with the one or more peripheral devices coupled to the respective edge node and uses the direct connection for transactions with the one or more peripheral devices.
- the transactions that are through the direct connection between the respective one of the edge nodes and the one or more peripheral devices can be substantially in real-time and not delayed by internet processing.
- the one or more central servers can also configured to communicate with the application executing on the mobile device and provide additional processing support to the application, the additional processing support being for processes that do not require real-time transactions with the one or more peripheral devices.
- the one or more peripheral devices can be non-internet-enabled electronic peripheral devices.
- the one or more central servers can also be configured to communicate with the application executing on the mobile device, and can be further configured to receive a request from the mobile device to use the one or more peripheral devices connected to the respective node and to transmit data indicative of the request to the respective edge node in order to facilitate the establishment of the direct connection between the mobile device and the respective edge node.
- devices and peripherals are grouped into clusters that share a common higher-level purpose.
- Internet services for these clusters can then be published or otherwise made available for connected client applications.
- the internet services can terminate on either a single device/peripheral cluster node, or a group of cluster nodes, hence abstracting the cluster into multi-form macro devices/peripherals.
- FIG. 13 is a schematic block diagram illustrating an example arrangement by which clusters of devices and peripherals are exposed on the internet.
- a series of edge nodes 1313 , 1313 ′, 1313 ′′ are each used to aggregate a set of devices and peripherals onto a consistent cluster.
- These edge nodes are connected to a central server 1312 over the internet.
- the example shown in FIG. 13 shows three examples of device/peripheral clusters: office, telehealthcare, or car. These particular clusters are for illustrative purposes only. Additional or alternative clusters may be included in the arrangement and adapted for any desired purpose or functionality.
- the central server exposes/publishes internet versions of the cluster services. Published services are terminating either on a single device/peripheral cluster node or on a group of nodes.
- the cluster services are integrated into one or more connected applications, which can be accessed and used by users 1311 .
- the applications can render on any web client, mobile or not.
- Central nodes 1312 can also route a service request to the proper edge node and log the activity for reconciliation and billing.
- the central nodes 1312 can accumulate utilization and profile information that feeds a large database used to provide fine grain data services pertaining to the device/peripheral cluster utilization and users.
- FIG. 18 illustrates another example of a system according to the disclosed technology in which heterogeneous clusters of peripherals are connected via a central node.
- the example shown in FIG. 18 shows three examples of device/peripheral clusters: office, telehealthcare, and connected home.
- edge nodes of any of the disclosed embodiments can also have additional features or capabilities, such as one or more of the following:
- Embodiments of the disclosed technology comprise an arrangement that creates an additional, centralized interface to access any such device/peripheral from the internet.
- the publication of these device/peripheral services on a managed internet server enables connected applications to access a large range of devices/peripherals on various premises.
- FIG. 14 is a schematic block diagram illustrating an edge node arrangement configured to expose peripheral services on the internet.
- a series of edge nodes 1413 , 1413 ′ are deployed at two different premises: premise #1 and premise #2. These edge nodes are used to integrate the various devices/peripherals (e.g., PO, drivers, and handlers (collectively shown as peripherals 1414 , 1414 ′).
- peripherals 1414 , 1414 ′ are connected to a central server 1412 over the internet.
- the central server 1412 exposes/publishes internet versions of the various device/peripheral services.
- the published services are integrated into one or more connected applications, which can be accessed and used by users 1411 .
- Such connected applications can render on any web client, mobile or not.
- the central nodes 1412 can help ensure that the service request is routed to the proper edge node and log the activity for reconciliation and billing.
- One example embodiment for managing clusters of heterogeneous electronic peripherals on the internet and/or publishing and managing on-premises peripherals over the internet comprises: one or more central servers; and one or more edge nodes in communication with the one or more central servers via the internet, each of the one or more edge nodes comprising an edge node processor for executing edge node software services, each of the one or more edge nodes being further coupled to and configured to control one or more peripheral devices, the one or more peripheral devices being non-internet-enabled peripheral devices, wherein the one or more central servers are configured to provide services over the internet to a mobile device, the services including an application that can be installed on the mobile device and that provides access to each of the one or more edge nodes and their associated peripheral devices, thereby providing internet access to non-internet-enabled peripheral devices.
- the one or more edge nodes can comprise a first edge node coupled two or more heterogeneous peripheral devices.
- the two or more heterogeneous peripheral devices can have heterogeneous operating systems, heterogeneous drivers, or heterogeneous APIs.
- the services can include a first application that can be installed on the mobile device providing access to a first set of multiple edge nodes and a second application that can be installed on the mobile device providing access to a second set of multiple edge nodes different from the first set.
- each edge node in the first set of multiple edge nodes can be coupled to a first combination of peripheral device types
- each edge node in the second set of multiple edge nodes can be coupled to a second combination of peripheral device types different from the first combination of peripheral device types.
- a heterogeneous set of devices is grouped into a connected cluster to deliver services that leverage the different capabilities of each device.
- the existing user interface of each device in the cluster can vary dramatically from: none (e.g., a temperature sensor) to very simple (e.g., a 7-segment display) to more elaborated interfaces (e.g., an LCD or touch screen interface).
- Embodiments of the disclosed technology provide a unified user interface for controlling and using a heterogeneous cluster of devices.
- the unified user interface can be rendered onto the end user's personal mobile device.
- This user interface can provide any one or more of the following advantages: (i) devices without display or with rudimentary user interface can interact with the end user via modern, high resolution screens with touch panels used in now ubiquitous smartphones and tablets; (ii) the user interface deals with the cluster of devices in a unified manner, guiding the user in his individual device interactions in a service-centric manner, as opposed to a traditional, device-centric user set of interfaces; (iii) the end user experience can be improved by using the typical set of peripherals on board smart phones and tablets (e.g., camera, microphone, virtual or real keyboard, NFC tags, RFID reader, and/or other such peripherals).
- peripherals on board smart phones and tablets e.g., camera, microphone, virtual or real keyboard, NFC tags, RFID reader, and/or other such peripherals.
- FIG. 15 is a schematic block diagram illustrating an example arrangement for how a unified UI can be used with a connected cluster of heterogeneous devices.
- a series of one or more edge nodes 1513 are used to aggregate a set of peripheral onto a cluster. These edge nodes 1513 are connected to a central server 1512 over the internet.
- the edge nodes 1513 embed Local Device Handlers (LDH) that expose Central Device Controllers (CDC) hosted on an internet server.
- LDH Local Device Handlers
- CDC Central Device Controllers
- there is one set of CDC services for one set of LDH services though other arrangements are possible.
- the end user mobile device (smartphone or tablet) is connected to the internet either via a cellular data connection or a WiFi access point on the local premises.
- the end user mobile client connects to a web application (e.g., a downloadable application or web-based application), which then provides a user interface.
- the user interface invokes the CDC service(s) to interact with the devices, based on the end user inputs originated from the mobile device. In this way, a single unified user interface can be used to interact with two or more heterogeneous devices, which may themselves have little or no user interface capability.
- One example embodiment for a mobile user interface for a heterogeneous cluster of devices comprises: one or more central servers; and one or more edge nodes in communication with the one or more central servers via the internet, each of the one or more edge nodes comprising an edge node processor for executing edge node software services, each of the one or more edge nodes being further coupled to and configured to control two or more peripheral devices, wherein the one or more central servers are configured to provide services over the internet to a mobile device, the services including a web-based or downloadable application that can be accessed by the mobile device and that provides a single unified user interface on the mobile device operative to control the two or more peripheral devices.
- the two or more peripheral devices can be non-internet-enabled electronic peripheral devices.
- the two or more peripheral devices can be heterogeneous peripheral devices.
- at least one of the peripheral devices has no separate user interface.
- the single unified user interface comprises a user interface rendered on a touchscreen of the mobile device that includes a first set of one or more user-selectable regions for controlling a first peripheral and a second set of one or more user-selectable regions for controlling a second peripheral.
- the first set and second set of user-selectable regions are simultaneously displayed to the user via the single unified user interface.
- the application can be a first application, and the one or more central servers can be configured to provide a second application that can be accessed by the mobile device and that provides a single unified user interface on the mobile device operative to control a different set of two or more peripheral devices controlled by a different edge node.
- Embodiments of the disclosed technology can be used to connect a user's mobile device to a specialized device in a unique manner.
- exemplary arrangements of the disclosed technology allow a user to print artifacts or other materials from mobile devices to TV screens that are registered in an embedded cloud.
- Embodiments of the disclosed technology can also facilitate the user to control the screen display remotely via the mobile device. These embodiments can be used to eliminate the need for specialized devices and physical connections that were previously necessary to connect a mobile device user to such devices.
- Embodiments of the disclosed technology can provide any one or more of the following advantages: (i) allowing the user to display mobile device artifacts on the fly; (ii) eliminating the need for physical connections and interfaces; (iii) eliminating the need for specialized equipment, and thereby allowing the user to access services using only their mobile device and internet access; (iv) improving the user experience as the user currently only needs to access a mobile device application to spool his mobile device artifact to a screen that is registered on the cloud; (v) allowing the mobile device to be used to edit the artifact using the touch panel/stylus of the mobile equipment; (vi) allowing edits to be committed to the original document; and/or (vii) allowing mobile equipment to control the display of the document, such as the number of pages, magnification, etc.
- FIG. 16 is a schematic block diagram illustrating an exemplary arrangement of the disclosed technology that allows a mobile device to be mirrored on a TV screen screen over the internet.
- edge nodes 1613 are used to connect TV screens to a central server 1612 over the internet.
- the edge nodes 1613 embed Local Device Handlers (LDH) that expose Central Device Controllers (CDC) hosted on an internet server.
- LDH Local Device Handlers
- CDC Central Device Controllers
- the end user mobile device (smartphone or tablet) is connected to the internet either via a cellular data connection or a WiFi access point on the local premises.
- the end user mobile client connects to a web application.
- the user interface of this web application invokes the CDC service to interact with the identified TV screen, based on the end user inputs originated from the mobile device.
- the user interface on the user's mobile device can include the option to “print to screen”, whereby a document stored on the cloud (or sent to the cloud from the mobile device) can be rendered by the cloud server and then displayed on the screen (e.g. because the TV has a video input coupled directly to the edge node).
- the document or files is rendered by the edge node itself.
- the user interface on the user's device can have a “mobile-screen to TV-screen link” operation or a “white board” operation for displaying the screen on the mobile device on the TV screen.
- a security services using a camera e.g., a camera installed on or used with the TV
- room energy-saving features e.g., cooling, lighting, etc.
- FIG. 62 is a flowchart 6200 illustrating method acts performed by an application executed on a user's mobile device for implementing an exemplary print-to-TV flow using a cloud service platform.
- FIG. 63 is a flowchart 6300 illustrating method acts performed by a central server for implementing an exemplary print-to-TV flow using a cloud service platform. The illustrated method acts are not to be construed as limiting, as they can be used alone or in any combination or subcombination with one another or with other methods.
- an identification of a display device on which a user desires to display digital media is received (e.g., input, buffered, or otherwise prepared for further processing).
- the receiving can comprise performing a scanning operation of a machine-readable code associated with the display device (e.g., a tag with a QR code on or near the display device) or performing a near-field communication (NFC) scanning operation on a NFC tag associated with the display device (e.g., an NFC tag on or near the display device).
- a Bluetooth, RFID, or other wireless connection can be established with display device, thereby providing the display device identification to the mobile device.
- the display device may have an identification number displayed on it that the user can input manually via the application on the mobile device.
- the display device identification can be an identification number assigned to the display device or some other form of unique identifier (e.g., a UUID, MAC address, or other such identification means).
- the digital media can be any suitable data file for display, such as a Word document, Power Point presentation, PDF, image data (e.g., JPEG), video data (e.g., MPEG, h.264, HEVC, or other such video file), or other such displayable media file.
- a Word document Power Point presentation
- PDF image data
- image data e.g., JPEG
- video data e.g., MPEG, h.264, HEVC, or other such video file
- video file e.g., MPEG, h.264, HEVC, or other such video file
- the identification of the display device along with either the identification of the digital media or data for the digital media is wirelessly transmitted to a central server separate from the display device.
- user-selected display parameters affecting how the digital media will be displayed are received by an application on the mobile device.
- the display parameters can include, for example, rotation, cropping, zooming field, color, resolution, and/or other such display parameters.
- the identified display parameters can then be transmit to the central server.
- the identification of the document received comprises an indication of digital media stored on a cloud storage provider.
- the digital media can be retrieved from the cloud storage provider for display (e.g., using previously stored user credentials or using credentials that the user inputs as part of this particular print-to-TV request).
- an identification of a selected display device on which a user of the mobile device desires to display a digital media is received from a mobile device.
- the identification of the video monitor on which the user desires to display digital is generated by the user using the mobile device to perform a scanning operation of a machine-readable code associated with the display device or to perform a near-field communication (NFC) scanning operation on a NFC tag associated with the display device.
- NFC near-field communication
- the digital media data for display is received.
- an identification of the digital media data can be received by the mobile device, wherein the identification indicates that the digital media data is stored on a cloud storage provider.
- the act of receiving the digital media data can comprise retrieving the digital media data from the cloud storage provider.
- the digital media data itself is received directly from the mobile device.
- the digital media data for display is rendered.
- the digital media data can be converted (e.g., decompressed according to a codec and rendered) into a format suitable for display on the display device.
- the rendered digital media data is transmitted to an edge node remote from the central server and coupled to the selected display device.
- a user selection of display parameters affecting how the digital media will be displayed is also received and the rendering is performed in accordance with the display parameters.
- the edge node is separate from the video monitor and is configured to provide a video signal to the video monitor that is compatible with the video monitor.
- a request from the user for modifications to the digital media data can be received, a modified version of the digital media data can be rendered based on the received request, and the rendered modified version of the digital media data is transmitted to the edge node.
- the request from the user for modifications to the digital media data can indicate that a different page of a document is to be displayed or a different slide of a presentation, or can indicate new material to be added to the digital media data and displayed (e.g., edits to a document or additional mark-ups to a displayed image using a “whiteboard” feature).
- Certain embodiments of the disclosed technology comprise a distributed print service that delivers localized and profiled commercial content to end users, in addition to the requested printout.
- the additional commercial content e.g., an advertisement or coupon
- a cloud-hosted distributed print service also implements localized advertisement services that correlates location-based information with end user profile data and other contextual information or analytics in order to deliver highly profiled and targeted commercial content to the print service user, in addition to his/her requested printout.
- edge nodes and print service infrastructure can be any of the configurations or arrangements disclosed herein.
- the fact that the edge nodes 1713 , 1713 ′, 1713 ′′ are managed by the service infrastructure allows one or more of the following to be factored in and used to determine what commercial content to deliver: (i) actual location of the end user, without needing any assistance from a GPS or positioning device (because the edge nodes are on known premises); (ii) proximity of commercial operations/businesses being advertised; (iii) actual profile of the end user, provided from his/her print service account information; (iv) additional contextual information that can be gathered from previous uses by the end user or at the edge node (analytics); and/or (v) additional contextual information gathered from additional on-premises peripherals controlled by the same infrastructure and edge node (e.g. a camera for facial recognition).
- edge nodes 1713 , 1713 ′, 1713 ′′ are on premises allows the commercial content to be readily available on premises, which is desirable for fast delivery of high quality/high resolution commercial content.
- the edge nodes will store locally the commercial contents in local cache storage which is updated outside of the print transaction time.
- embodiments of the disclosed technology can: (i) offset the cost of the service, making it more affordable for endusers; (ii) introduce additional services to the end use; and/or (iii) create innovative business collaboration between service operator, advertisement company, and local (to the edge node) businesses.
- FIG. 17 is a schematic block diagram illustrating an exemplary arrangement for providing profiled commercial content on a cloud-based printer infrastructure.
- FIG. 17 illustrates an arrangement for delivering localized and profiled commercial content together with the end user printout.
- One example embodiment for delivering localized and profiled commercial content on paper media is a system, comprising: one or more central servers; and one or more edge nodes in communication with the one or more central servers via the internet, each of the one or more edge nodes comprising an edge node processor for executing edge node software services, each of the one or more edge nodes being further coupled to and configured to control one or more peripheral devices, a respective one of the edge nodes being coupled to and configured to control a printer, wherein the one or more central servers are configured to provide services over the internet to a mobile device, the services including an application that can be installed on or accessed by the mobile device and that facilitates a transaction with a user of the mobile device that causes a document to be printed at the printer controlled by the respective one of the edge nodes, wherein the one or more central servers are further configured to select commercial material targeted for the user and to cause the targeted commercial material to be printed at the printer with the document.
- the commercial material can comprise a coupon or advertisement.
- the one or more central servers can be configured to select the commercial material based on a known and previously stored location of the printer.
- the commercial material can comprise a coupon or advertisement for a business and the one or more central servers can be configured to select the commercial material by identifying one or more businesses that are in a geographic range of the printer and selecting the commercial material for one or more of the business identified as being within the geographic range.
- the one or more central servers can be configured to select the commercial material based on profile data for the user stored with the one or more central servers.
- the one or more central servers can be configured to select the commercial material based on analytics generated using transaction data from previous transaction between the user and the one or more central servers.
- the one or more central servers can be configured to select the commercial material based on information gathered from an additional peripheral device coupled to and controlled by the respective one of the edge nodes.
- the additional peripheral device can be a camera configured to capture an image of the user
- the one or more central servers can be configured to perform a facial recognition process on the image and to select the commercial material based on the facial recognition data.
- the platform is used to provide printing services at various locations by allowing users to identify a local printer using their mobile device (e.g., a smartphone), upload document data and print identification data to the cloud-based server, and receive a printed copy of the document at the identified printer.
- the cloud-based central server can perform file manipulation and/or file conversion.
- FIG. 19 is a block diagram 1900 illustrating various components of the printing solution and method acts that can be performed.
- FIG. 20 is a high-level flow chart illustrating the various actions performed according to one exemplary printing flow.
- FIGS. 21-30 further illustrate the various actions identified in FIG. 20 and also show example screen shots that may be appear to the user on their mobile device (e.g., via an app that is downloaded or accessed by a web browser to implement the printing process).
- the illustrated method acts are not to be construed as limiting, as they can be used alone or in any combination or subcombination with one another or with other methods.
- FIG. 64 is a flowchart 6400 illustrating method acts performed by an application executed on a user's mobile device for implementing an exemplary printing flow using a cloud service platform.
- FIG. 65 is a flowchart 6500 illustrating method acts performed by a central server for implementing an exemplary printing flow using a cloud-based platform. The illustrated method acts are not to be construed as limiting, as they can be used alone or in any combination or subcombination with one another or with other methods.
- a user login for his or her mobile printing account managed by a cloud-based central server is received.
- An example login screen is shown in FIG. 21 .
- the user may login with a user name and password, and may optionally select a location.
- the location may also be determined by GPS coordinates of the mobile device or be absent from the login screen.
- an identification of a printer on which a user desires to print a document is received (e.g., input, buffered, or otherwise prepared for further processing).
- the receiving can comprise performing a scanning operation of a machine-readable code associated with the printer (as shown in FIGS. 22-23 ) or performing a near-field communication (NFC) scanning operation on a NFC tag associated with the printer (as shown in FIGS. 24-25 ).
- NFC near-field communication
- a Bluetooth, RFID, or other wireless connection can be established with printer, thereby providing the printer identification to the mobile device.
- the printer may have an identification number displayed on it that the user can input manually via the application on the mobile device.
- the printer identification can be an identification number assigned to the printer or some other form of unique identifier (e.g., a UUID, MAC address, or other such identification means).
- an identification of the document that the user desires to print can be received (as shown in FIG. 26 ).
- the term “document” encompasses multiple file formats that stored digital media that might desirably be printed, such as a Word document, Power Point presentation, PDF, JPEG, or other such printable media file.
- the document can be stored locally at the device or be a file stored in a cloud-hosted storage service (e.g., administered by a third party).
- the identification of the printer along with either the identification of the document (when the document is stored in a cloud-hosted storage service) or data for the document itself (e.g., data for a document, presentation, picture, or any file desirably printed) is wirelessly transmitted to a central server (e.g., to a central node of the cloud service platform).
- a central server e.g., to a central node of the cloud service platform.
- the digital media can be retrieved from the cloud storage provider for printing (e.g., using previously stored user credentials or using credentials that the user inputs as part of this particular print request).
- user-selected printing parameters affecting how the document will be printed are also received by the application on the mobile device (as shown in FIG. 28 ).
- the printing parameters can include, for example, paper size, orientation, color, number of copies, double sided, print range, and/or other such print parameters.
- the printing parameters can then be sent to the central server for use in processing and preparing the document for printing.
- a user selection indicating that the user desires to receive coupons for local services when printing the document is received by the application on the mobile device (as shown in FIG. 29 ).
- the user selection indicating that the user desires to receive coupons can then be transmitted to the central server.
- the selection to receive one or more coupons may allow a reduction in any printing price that is charged (e.g., the printing may be free or at least partially subsidized by the user's selection to receive coupons). Or, the user may simply desire to receive coupons for local businesses.
- the coupons to be printed with the selected document can be selected based on the location of the identified printer (e.g., local businesses) and/or user preferences.
- the content for the coupons can be maintained on the central server, the edge node itself, or accessed from a third-party server upon request by the central server.
- an identification of a selected printer on which a user of the mobile device desires to print a document is received from a mobile device.
- the identification can be obtained, for example, by the user performing a scanning operation of a machine-readable code associated with the selected printer or performing a near-field communication (NFC) scanning operation on an NFC tag associated with the selected printer.
- NFC near-field communication
- data for the document is received.
- an identification of the document can be received by the mobile device, wherein the identification indicates that the document is stored on a cloud storage provider.
- the act of receiving the data for the document can comprise retrieving the document from the cloud storage provider.
- the document data itself is received from the mobile device.
- document printing data is transmitted to an edge node remote from the central server and associated with the selected printer.
- the document printing data is data that causes the document to be printed at the selected printer in accordance with any selected printing parameters.
- a user selection of printing parameters affecting how the document will be printed is also received, and the document printing data is generated based at least in part on the printing parameters (e.g., to apply the printing parameters).
- a user selection indicating that the user desires to receive coupons for local services when printing the document is received, coupon data associated with the location of the selected printer is received (e.g., accessed locally or accessed from another server), and the document printing data is supplemented with the coupon data so that one or more coupons are printed at the selected printer along with the document.
- the edge node is separate from the printer and is configured to communicate with the printer using printer drivers designed for the printer.
- FIGS. 31-32 are block diagrams illustrating an example in which a cloud service platform is used to display digital media on a digital display or digital sign.
- the digital display can be connected to a central server via an edge node as disclosed herein.
- the edge node can also be connected one or more additional peripherals, such as a printer or image capture device as shown in FIGS. 31 and 32 .
- the cloud-based central server can be used to manage and update digital media data on the display device.
- the cloud-based central server can, in some embodiments, also perform one or more of the processing tasks associated with rendering the digital media for display (e.g., by performing encoding or decoding operations).
- the cloud-based central server can perform file manipulation and/or file conversion (e.g., conversion from Power Point to PDF).
- the digital display can be used to present any type of desired information at the digital display, such as corporate information, stock information, weather, news, promotions, and the like (as shown in FIG. 31 ), or emergency instructions in the event of an emergency. Any of the information displayed can be supplemented by one or more advertisements, which can be maintained at the central server or accessed from a third-party server storing the advertisements.
- the platform is used to provide visitor check-in services at a portal in a building, establishment, or other area.
- FIGS. 33-41 illustrate various actions associated with the performance of one exemplary method.
- the illustrated method acts are not to be construed as limiting, as they can be used alone or in any combination or subcombination with one another or with other methods.
- FIGS. 66 and 67 are flow charts that illustrate an example implementation of the method introduced by FIGS. 33-41 .
- FIG. 66 is a flowchart 6600 illustrating method acts performed by an edge node and associated peripherals (e.g., a video display device, a scanner, an imaging device, and/or a printer) for implementing an exemplary check-in method using a cloud service platform.
- FIG. 67 is a flowchart 6700 illustrating method acts performed by a central server in communication with the edge node for implementing an exemplary check-in method using a cloud service platform.
- the illustrated method acts are not to be construed as limiting, as they can be used alone or in any combination or subcombination with one another or with other methods.
- a passkey can be provided to the user by the user pre-scheduling the visit to the managed area.
- the passkey can be, for example, a one-time password, number, or code.
- the passkey can be either provided directly to the user via a website that manages the scheduling or by an authorized host (e.g., a resident in the managed building or employee of a company in the restricted area).
- the edge node and its associated peripherals can also be used to display check-in instructions. For instance, instructions for performing any one or more of the operations below can be displayed to the user during the check-in process.
- a visitor is authenticated by (a) receiving a visitor passkey input from the visitor, transmitting the passkey to a central server, and receiving an indication from the central server that the visitor is authenticated; or (b) receiving a visitor passkey transmitted from the central server, receiving a visitor passkey input from the visitor, and authenticating the visitor if the visitor passkey from the central server matches the visitor passkey input from the visitor.
- the user may not have a passkey and can instead check-in as a guest and optionally provide the name of his or her contact person. This authentication operation is also shown in FIG. 35 .
- an identification document of the guest is scanned via a scanner controlled by the edge node (as further shown in FIG. 36 ).
- the identification document can be, for instance, a driver's license, passport, or other identity card.
- there may be legal terms or safety instructions concerning the visit that can be printed out for the visitor at this point or at any other point during the check-in operation.
- a digital image of the guest is captured via an image capture device controlled by the edge node.
- a signature or other information about the visitor can be requested and obtained (e.g., a thumbprint, an email address, a mailing address, a social security number, or other such information).
- a personalized tag to be worn by the visitor can be generated and printed.
- the tag can be a personalized tag with the visitor's name, picture, date, access rights, access restrictions, and/or other such data.
- the personalized tag can be created when the visit is pre-scheduled, and when the visit is not pre-scheduled, the host can be prompted to authenticate the visitor. In some instances, a digital image of the host can also be taken.
- the host can be notified of the visitor's arrival. For instance, the host can be automatically notified via a SMS message, email message, and/or voice mail message.
- a record of the visitor is generated.
- the record can comprise at least the identification document and digital image.
- the record is transmitted to the central server.
- the record can be stored by the central server for any period of time (e.g., days, months, or years).
- the authentication process can further comprise using the digital image to perform a facial recognition process.
- the facial recognition process can be performed by the central server.
- a printer controlled by the edge node can be used to print a parking pass for the visitor.
- FIG. 67 which illustrates an exemplary process performed by the central server to implement the check-in process
- a scheduling request from a visitor or host for a visitor-managed area is received.
- a visitor passkey is generated and transmitted to the visitor.
- the authentication of the visitor at the visitor-managed area is facilitated by (a) receiving a visitor passkey transmitted from an edge node coupled to two or more peripherals, comparing the visitor passkey transmitted from the edge node with the visitor passkey transmitted to the visitor, and transmitting an authentication confirmation if the visitor passkey transmitted from the edge node matches the visitor passkey transmitted to the visitor; or (b) transmitting the visitor passkey previously transmitted to the visitor to the edge node coupled to two or more peripherals.
- a record of the visitor at the visitor-managed area is received and stored.
- the record can comprise at least a scanned image of an identification document for the visitor and a digital image of the visitor.
- the scanned image can be obtained by a scanner coupled to the edge node, and the digital image of the visitor can be obtained by an image capture device at the edge node.
- a facial recognition process is performed on the digital image of the visitor, and the act of facilitating the authentication of the visitor at the visitor-managed area comprises transmitting an authentication confirmation based on the facial recognition process to the edge node.
- the platform is used to facilitate an automated notarization process for documents.
- notarization is used, it should be understood that the term is used in a broad sense to encompass authentication processes by which a document is assigned a unique identification and a record is created for the document evidencing the date, time, and user who input the document. Such information can be used for various authentication purposes as well as document control and storage purposes.
- FIGS. 42-50 illustrate various actions associated with the performance of one exemplary method.
- the illustrated notary method can be performed by an edge node and associated peripherals (e.g., a video display device, a scanner, a fingerprint scanner, an imaging device, and/or a printer).
- instructions for performing the notarization process can be displayed to the user via the display device as the user interacts with the edge-peripherals.
- the illustrated method acts are not to be construed as limiting, as they can be used alone or in any combination or subcombination with one another or with other methods.
- a user is authenticated.
- the user can be authenticated using a mobile wallet app, a username and password, NFC card/tag, or RFID card/tag.
- the user's fingerprint is taken (e.g., via a fingerprint scanner controlled by an edge node).
- the document desired to be notarized is scanned (e.g., via a scanner controlled by the edge node).
- an identification of the user is scanned (e.g., a driver's license, passport, or other official form of identification).
- an image of the user is obtained.
- payment information for the transaction is received from the user, potentially along with the user's electronic or other signature.
- a copy of the document with watermarks and/or a unique ID indicating the notarization (or authenticating the document as having been presented on the day and time stored) is printed for the user.
- the copy can also or alternatively be sent to the user via email (e.g., at a fee).
- the document and the identification information of the user is transmitted to the central server and stored for any desired amount of time (e.g., days, months, or years). The user may later desired to access the document and the authentication of the date and time at which it was scanned for authentication purposes.
- the user can access and re-print and/or re-send the authenticated document.
- the platform is used to facilitate an automated kiosk for shipping packages.
- FIGS. 51-58 illustrate various actions associated with the performance of one exemplary method.
- the illustrated method acts are not to be construed as limiting, as they can be used alone or in any combination or subcombination with one another or with other methods.
- FIGS. 68 and 69 are flow charts that illustrate an example implementation of the method introduced by FIGS. 51-58 .
- FIG. 68 is a flowchart 6800 illustrating method acts performed by an edge node and associated peripherals (e.g., a video display device, a scale, and/or a printer) for implementing an exemplary shipping method using a cloud service platform.
- FIG. 69 is a flowchart 6900 illustrating method acts performed by a central server in communication with the edge node for implementing an exemplary shipping method using a cloud service platform.
- the illustrated method acts are not to be construed as limiting, as they can be used alone or in any combination or subcombination with one another or with other methods.
- a weight of the package is received from the scale.
- the package can be placed on a scale peripheral connected to the edge node (e.g., via a prompt from the display device).
- an indication of a destination for the package is received from the user. For instance (and as shown in FIG. 52 ), the user can be requested to enter destination information via a display device and a user input device (e.g., a touchpad, keyboard, or touch screen).
- a user input device e.g., a touchpad, keyboard, or touch screen.
- the indication of the destination for the package (and, in some embodiments, the weight) is transmitted to the central server. For instance, as shown in FIG. 53 , this information can be used by a central server to request real-time bids from multiple shipping service providers.
- an indication of multiple shipping bids for the package is received from the central server.
- One or more of the shipping bids can indicate a cost of shipping the package and a delivery time for the package.
- one or more of the multiple shipping bids are displayed to the user via the video display device.
- the multiple bids can be displayed in the form of cost and/or delivery time.
- an indication of a selected one of the shipping bids is received from the user. For instance (as shown in FIG. 55 ), the user can then select a desired bid.
- payment information for the selected one of the shipping bids is received from the user.
- the indication of the selected one of the shipping bids and the payment information is transmitted to the central server.
- a shipping label is printed via the printer upon acceptance of the payment information.
- a notification is transmitted to a shipping company responsible for the selected one of the shipping bids of the package and the payment information.
- an indication of a destination for a package is received from an edge node coupled to two or more peripherals separate from the edge node, the two or more peripherals including at least a video display device and a printer.
- two or more shipping bids for the package are generated by transmitting shipping bid requests that include the destination for the package (and, in some embodiments, the weight) to two or more shipping companies.
- the two or more shipping bids for the package are transmitted to the edge node.
- an indication of the selected one of the shipping bids and payment information are received from the edge node.
- an acceptance of the payment information for the selected one of the shipping bids is received (e.g., from the selected shipping company or a payment card provider transacting the payment).
- the acceptance of the payment information is transmitted to the edge node.
- the central server can also transmit a notification to a shipping company responsible for the selected one of the shipping bids of the package and the payment information.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Business, Economics & Management (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Strategic Management (AREA)
- Entrepreneurship & Innovation (AREA)
- General Engineering & Computer Science (AREA)
- Human Resources & Organizations (AREA)
- Human Computer Interaction (AREA)
- General Business, Economics & Management (AREA)
- Development Economics (AREA)
- Economics (AREA)
- Marketing (AREA)
- Finance (AREA)
- Accounting & Taxation (AREA)
- Operations Research (AREA)
- Tourism & Hospitality (AREA)
- Quality & Reliability (AREA)
- Data Mining & Analysis (AREA)
- Game Theory and Decision Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Transfer Between Computers (AREA)
- Computer And Data Communications (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- User Interface Of Digital Computer (AREA)
- Stored Programmes (AREA)
Abstract
Embodiments of the disclosed technology comprise a cloud-hosted central service platform that interfaces and enables access to both central and distributed resources and peripherals for connected mobile applications. For example, this platform allows service providers and application developers to create a large number of new classes of applications, leveraging web access to devices, sensors, and/or actuators of any kind. This platform can be applied to virtually any vertical segment. Any of the disclosed features or aspects of the disclosed embodiments can be used in various combinations and subcombinations with one another or with other methods, apparatus, and systems.
Description
- This application claims the benefit of U.S. Provisional Application No. 61/801,857, filed on Mar. 15, 2013, and entitled “CLOUD SERVICES PLATFORM”, and U.S. Provisional Application No. 61/889,525, filed on Oct. 10, 2013, and entitled “CLOUD SERVICES PLATFORM”, both of which are hereby incorporated herein by reference.
- This application relates generally to managing and controlling distributed electronic peripherals.
- Embodiments of the disclosed technology comprise a cloud-hosted central service platform that interfaces and enables access to both central and distributed resources and on-premises electronic peripherals for connected mobile or web applications. For example, this platform allows service providers and application developers to create a large number of new classes of applications, leveraging web access to devices, sensors, and/or actuators of any kind. This platform can be applied to virtually any vertical segment including, but not limited to, automotive, telehealth care, home automation, retail, etc. Embodiments of the disclosed platform can also be used as the foundation of large scale systems controlled by a single operator, such as a government agency, a transportation consortium, a retail operator, a building operator, airport operator, and/or any single operator having some control over a plurality of distributed peripheral devices. Also, companies with large distributed, connected assets that can benefit from a centralized control point can utilize such a platform.
- The patent or application file contains at least one drawing executed in color. Copies of this patent or patent application publication with color drawings will be provided by the Office upon request and payment of the necessary fee.
-
FIG. 1 illustrates a generalized example of a suitable computing hardware environment for a computing device with which several of the described embodiments can be implemented. -
FIG. 2 is a block diagram illustrating a convergence space of the mobile internet, the internet of things, and cloud computing and big data. -
FIG. 3 is a block diagram showing one illustrative architecture for a cloud services platform (CSP) according to the disclosed technology. -
FIG. 4 is a schematic block diagram showing an example of an illustrative architecture according to the disclosed technology compared to a more traditional architecture. -
FIG. 5 is a schematic block diagram showing another illustrative architecture of a system according to one embodiment of the disclosed technology. -
FIG. 6 is a schematic block diagram showing one illustrative architecture for the components of the one or more central nodes. -
FIG. 7 is a block diagram showing services that can be available according to one illustrative embodiment of the disclosed technology. -
FIG. 8 is a schematic block diagram showing an illustrative architecture for the software components that can be used to implement a CSP edge node according to one embodiment of the disclosed technology. -
FIG. 9 is schematic block diagram of an illustrative example system architecture comprising a backend, a frontend, and mobile devices, which can be operated by a user to interact with the one or more peripherals. -
FIG. 10 is a schematic block diagram showing another example system architecture showing both the central node and the edge node in communication with one another via a network. -
FIG. 11 is a block diagram of an example network configuration for implementing embodiments of the technology. -
FIG. 12 is a schematic block diagram that illustrates an example of a real-time inner loop for managed peripherals. -
FIG. 13 is a schematic block diagram illustrating an example arrangement by which clusters of devices and peripherals are exposed on the internet. -
FIG. 14 is a schematic block diagram illustrating an edge node arrangement configured to expose peripheral services on the internet. -
FIG. 15 is a schematic block diagram illustrating an example arrangement for how a unified UI can be used with a connected cluster of heterogeneous devices. -
FIG. 16 is a schematic block diagram illustrating an exemplary arrangement of the disclosed technology that allows a mobile device to be mirrored on a TV screen screen over the internet. -
FIG. 17 is a schematic block diagram illustrating an exemplary arrangement of the disclosed technology for publishing targeted commercial content. -
FIG. 18 illustrates another example of a system according to the disclosed technology in which heterogenous clusters of peripherals are connected via a central node. -
FIG. 19 is a block diagram illustrating various components of an example printing solution and method acts that can be performed. -
FIG. 20 is a high-level flow chart illustrating the various actions performed according to one exemplary printing flow. -
FIGS. 21-30 illustrate exemplary screen shots for a printing flow. -
FIGS. 31-32 illustrate an exemplary display screen implementation for the disclosed technology. -
FIGS. 33-41 illustrate an exemplary check-in kiosk implementation for the disclosed technology. -
FIGS. 42-50 illustrate an exemplary document authentication implementation for the disclosed technology. -
FIGS. 51-58 illustrate an exemplary document authentication implementation for the disclosed technology. -
FIG. 59 is a block diagram of another embodiment of the one or more central nodes. -
FIG. 60 is an entity-relation diagram showing one illustrative relationship model for data in an embodiment of the disclosed technology. -
FIGS. 61A and 61B are schematic block diagrams showing one illustrative physical model of data according to an embodiment of the disclosed technology. -
FIG. 62 is a flowchart illustrating method acts performed by an application executed on a user's mobile device for implementing an exemplary print-to-TV flow using a cloud service platform. -
FIG. 63 is a flowchart illustrating method acts performed by a central server for implementing an exemplary print-to-TV flow using a cloud service platform. -
FIG. 64 is a flowchart illustrating method acts performed by an application executed on a user's mobile device for implementing an exemplary printing flow using a cloud service platform. -
FIG. 65 is a flowchart illustrating method acts performed by a central server for implementing an exemplary printing flow using a cloud-based platform. -
FIG. 66 is a flowchart illustrating method acts performed by an edge node and associated peripherals for implementing an exemplary check-in method using a cloud service platform. -
FIG. 67 is a flowchart illustrating method acts performed by a central server in communication with the edge node for implementing an exemplary check-in method using a cloud service platform. -
FIG. 68 is a flowchart illustrating method acts performed by an edge node and associated peripherals for implementing an exemplary shipping method using a cloud service platform. -
FIG. 69 is a flowchart illustrating method acts performed by a central server in communication with the edge node for implementing an exemplary shipping method using a cloud service platform. - Disclosed below are representative embodiments of methods, apparatus, and systems for managing and controlling distributed peripherals. The disclosed methods, apparatus, and systems should not be construed as limiting in any way. Instead, the present disclosure is directed toward all novel and nonobvious features and aspects of the various disclosed embodiments, alone and in various combinations and subcombinations with one another. Furthermore, any features or aspects of the disclosed embodiments can be used in various combinations and subcombinations with one another or with other methods, apparatus, and systems. The disclosed methods, apparatus, and systems are not limited to any specific aspect or feature or combination thereof, nor do the disclosed embodiments require that any one or more specific advantages be present or problems be solved.
- Although the operations of some of the disclosed methods are described in a particular, sequential order for convenient presentation, it should be understood that this manner of description encompasses rearrangement, unless a particular ordering is required by specific language set forth below. For example, operations described sequentially may in some cases be rearranged or performed concurrently. Moreover, for the sake of simplicity, the attached figures may not show the various ways in which the disclosed methods can be used in conjunction with other methods. Additionally, the description sometimes uses terms like “determine” and “generate” to describe the disclosed methods. These terms are high-level abstractions of the actual operations that are performed. The actual operations that correspond to these terms may vary depending on the particular implementation and are readily discernible by one of ordinary skill in the art. Furthermore, as used herein, the term “and/or” means any one item or combination of items in the phrase.
- Any of the disclosed methods can be implemented by computer-executable instructions stored on one or more computer-readable media (e.g., non-transitory computer-readable media, such as one or more optical media discs, volatile memory components (such as DRAM or SRAM), or nonvolatile memory components (such as hard drives)) executing on a computer (e.g., any commercially available computer), or some combination thereof. Any of the computer-executable instructions for implementing the disclosed techniques (e.g., the disclosed peripheral management, peripheral control, or other techniques) as well as any intermediate or final data created and used during implementation of the disclosed systems can be stored on one or more computer-readable media (e.g., non-transitory computer-readable media). The computer-executable instructions can be part of, for example, a dedicated software application or as part of an application that is accessed or downloaded via a network (e.g., a local-area network, a wide-area network, a client-server network, or other such network).
- Such software can be executed on a single computer (e.g., a computer embedded in or electrically coupled to a printer, multiple purpose printing kiosk, display device, scanning apparatus, actuator, sensor, or other device or system with which the disclosed technology may operate) or in a network environment. For example, the software can be executed by a computer embedded in or communicatively coupled to a printer, multiple purpose printing kiosk, display device, scanning apparatus, or other device or system with which the disclosed technology may operate.
- For clarity, only certain selected aspects of the software-based embodiments are described. Other details that are well known in the art are omitted. For example, it should be understood that the software-based embodiments are not limited to any specific computer language or program. For instance, embodiments of the disclosed technology can be implemented by software written in C++, Java, Perl, JavaScript, Adobe Flash, Python, JINI, .NET, Lua or any other suitable programming language. Likewise, embodiments of the disclosed technology are not limited to any particular computer or type of hardware. Details of suitable computers and hardware are well known and need not be set forth in detail in this disclosure.
- Furthermore, any of the software-based embodiments (comprising, for example, computer-executable instructions which when executed by a computer cause the computer to perform any of the disclosed methods) can be uploaded, downloaded, or remotely accessed through a suitable communication means. Such suitable communication means include, for example, the Internet, the World Wide Web, an intranet, software applications, cable (including fiber optic cable), magnetic communications, electromagnetic communications (including RF, microwave, and infrared communications), electronic communications, or other such communication means.
- The disclosed methods can also be implemented by specialized computing hardware that is configured to perform any of the disclosed methods. For example, the disclosed methods can be implemented by a computing device comprising an integrated circuit (e.g., an application specific integrated circuit (“ASIC”) or programmable logic device (“PLD”), such as a field programmable gate array (“FPGA”)). The integrated circuit or specialized computing hardware can be embedded in or directly coupled to a printer, multiple purpose printing kiosk, display device, scanning apparatus, actuator, sensor, or other device or system with which the disclosed technology may operate.
-
FIG. 1 illustrates a generalized example of a suitablecomputing hardware environment 100 for a computing device with which several of the described embodiments can be implemented. Thecomputing environment 100 is not intended to suggest any limitation as to the scope of use or functionality of the disclosed technology, as the techniques and tools described herein can be implemented in diverse general-purpose or special-purpose environments that have computing hardware. - With reference to
FIG. 1 , thecomputing environment 100 includes at least oneprocessing unit 110 andmemory 120. InFIG. 1 , this mostbasic configuration 130 is included within a dashed line. Theprocessing unit 110 executes computer-executable instructions. In a multi-processing system, multiple processing units execute computer-executable instructions to increase processing power. Thememory 120 may be volatile memory (e.g., registers, cache, RAM), non-volatile memory (e.g., ROM, EEPROM, flash memory), or some combination of the two. Thememory 120stores software 180 for implementing one or more of the described techniques for operating or using the disclosed systems. For example, thememory 120 can storesoftware 180 for implementing any of the disclosed peripheral management, use, or control examples or techniques. - The computing environment can have additional features. For example, the
computing environment 100 includesstorage 140, one ormore input devices 150, one ormore output devices 160, and one ormore communication connections 170. An interconnection mechanism (not shown) such as a bus, controller, or network interconnects the components of thecomputing environment 100. Typically, operating system software (not shown) provides an operating environment for other software executing in thecomputing environment 100, and coordinates activities of the components of thecomputing environment 100. - The
storage 140 can be removable or non-removable, and includes magnetic disks, magnetic tapes or cassettes, CD-ROMs, DVDs, or any other tangible non-transitory storage medium which can be used to store information and which can be accessed within thecomputing environment 100. Thestorage 140 can also store instructions for thesoftware 180 implementing any of the described techniques, systems, or environments. - The input device(s) 150 can be a touch input device such as a keyboard, mouse, touch screen, pen, or trackball, a voice input device, a scanning device, or another device that provides input to the
computing environment 100. The output device(s) 160 can be a display, touch screen, printer, speaker, or another device that provides output from thecomputing environment 100. - The communication connection(s) 170 enable communication over a communication medium to another computing entity. The communication medium conveys information such as computer-executable instructions or other data in a modulated data signal. A modulated data signal is a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal. By way of example, and not limitation, communication media include wired or wireless techniques implemented with an electrical, optical, RF, infrared, acoustic, or other carrier.
- The various methods, systems, and interfaces disclosed herein can be described in the general context of computer-executable instructions stored on one or more computer-readable media. Computer-readable media are any available media that can be accessed within or by a computing environment. Computer-readable media include tangible non-transitory computer-readable media, such as
memory 120 andstorage 140, and do not encompass transitory carrier waves or signals. - The various methods, systems, and interfaces disclosed herein can also be described in the general context of computer-executable instructions, such as those included in program modules, being executed in a computing environment on a target processor. Generally, program modules include routines, programs, libraries, objects, classes, components, data structures, and/or the like that perform particular tasks or implement particular abstract data types. The functionality of the program modules may be combined or split between program modules as desired in various embodiments. Computer-executable instructions for program modules may be executed within a local or distributed computing environment.
- Embodiments of the disclosed technology are designed to take advantage of three major trends in today's information technology: (i) cloud computing; (ii) the “internet of things”; and (iii) mobile applications. As shown in the diagram 200 of
FIG. 2 , embodiments of the disclosed technology lie in the convergence space (termed embedded cloud space 210) of themobile internet 220, the internet ofthings 222, and cloud computing andbig data 224. - Certain embodiments of the disclosed technology comprise a cloud-hosted central service platform that interfaces and enables access to both central and distributed resources and on-premises peripherals for connected mobile or web applications. For example, this platform allows service providers and application developers to create a large number of new classes of applications, leveraging web access to devices, sensors, and/or actuators of any kind. This platform can be applied to virtually any vertical segment including, but not limited to, automotive, telehealth care, home automation, retail, etc. Embodiments of the disclosed platform can also be used as the foundation of large scale systems controlled by a single operator, such as a government agency, a transportation consortium, a retail operator, a building operator, airport operator, and/or any single operator having some control over a plurality of distributed peripheral devices. Also, companies with large distributed, connected assets that can benefit from a centralized control point can utilize such a platform.
- Existing embedded cloud solutions are built for enabling the deployment of a single application or applications from a single service provider. By contrast, embodiments of the disclosed technology support multiple service providers for providing services and access to a large variety of consumer devices. In order to achieve this capability, certain implementations use a separation of software layers and the creation of a public and managed web services layer.
-
FIG. 3 is a block diagram showing oneillustrative architecture 300 for a cloud services platform (CSP) according to the disclosed technology. In particular, thearchitecture 300 provides access from a mobile device 310 (such as a smartphone or tablet) to a desired one or more peripherals (shown collectively as peripheral(s) 320), which are connected to aCSP edge node 340 through a web service layer 330 (which, in the illustrated embodiment, is implemented through a cloud-hosted backend 332). - As shown in the example of
FIG. 3 , proprietary hardware can be replaced by consumer/off-the-shelf peripherals (e.g., printers, scanners, monitors, card readers, sensors, actuators, and other such peripheral devices) shown at 320. Furthermore, in the illustrated implementations, a publicly availableweb service layer 330 serves as the bridge between the peripheral(s) 320 and the one or moremobile devices 310. - Also, with various implementations of the technology, the mobile device may execute one or more applications that can be (i) a native, connected application designed for the particular mobile device, (ii) a web application split between the client (rendering on the mobile equipment) and a server hosted on a network, such as the Internet, or (iii) some combination of both.
- Other illustrative details of the architecture are shown in
FIG. 3 itself. It should be noted that the particular configuration shown inFIG. 3 is for example purposes only and that any of the implementation details illustrated inFIG. 3 can be used alone or in any combination or subcombination with one another or substituted for other frontend or backend components. - Referring again to
FIG. 3 , at the first level of abstraction, theillustrative CSP architecture 300 comprises one or more of: (a) one or more central nodes designed to host the platform core and enabling services (e.g., hosted in the web service layer 330); (b) one or more edge nodes, such asedge node 340, designed to interface with on-premises peripherals; and (c) one or more mobile devices, such asmobile device 310, implementing the user experience of the services. Certain implementations of the architecture allow real-time and/or low-latency interactions with an application agent/interface loaded on the edge node (e.g., edge node 340) of the solution platform. - The
architecture 300 can use one or more mobile applications configured to be executed by mobile devices, such as the mobile phone ortablet 310.Example applications more applications mobile applications mobile applications mobile applications -
FIG. 4 is a schematic block diagram showing an example of anillustrative architecture 410 according to the disclosed technology compared to a moretraditional architecture 400. In particular,FIG. 4 shows amonolithic approach 400 for providing cloud-based application versus apublic approach 410 in which a common platform exists (operated by a platform operator) on which multiple service providers can create and implement a variety of different applications that can be downloaded or otherwise accessed by consumers and used to operate, use, and/or otherwise engage one or more consumer peripherals (e.g., any of the peripherals mentioned herein). The particular diagram inFIG. 4 does not feature load balancing and clustering for thepublic approach 410, although it should be understood that such features can be available in embodiments of the disclosed technology. -
FIG. 5 is a schematic block diagram showing anotherillustrative architecture 500 of a system according to one embodiment of the disclosed technology. Thearchitecture 500 includes a mobile end 510 (e.g., comprising one or moremobile devices 512 operated by an end user), a cloud-based back end 520 (e.g., comprising one or morecentral nodes 522 implemented using cloud-based hosted servers), and a front end 530 (e.g., comprising one ormore edge nodes 532 that are communicatively coupled to one or more peripherals and configured to control the functionality of the peripherals (for instance, to receive and/or send data from a printer, scanner, monitor, actuator, sensor, or any other such peripheral device). As seen in this figure, the illustrative architecture provides anouter communication loop 542 involving thebackend 520, and an inner communication loop 540 that substantially omits thebackend 520. By working within the inner loop 540, themobile end 510 and thefront end 530 may provide a direct, low latency, real-time interaction between a managed peripheral and the edge node of the solution end. - 3.3.1. Deployment Servers
- In certain embodiments, the one or more central nodes (e.g., hosted in
web service layer 330 and shown as central node 522) can be running on a public infrastructure (e.g., any publicly available cloud-based hosting service) and can implement any one or more of the following functionalities: - API Store
- Apps Store
- API Manager
- Identity Management
- Cloud to Device communication
- Message mediation
- Core and enabling services
- Web portals
- Web application hosting
- Billing and transaction reconciliation
- Central databases: meta data
-
FIG. 6 is a schematic block diagram showing oneillustrative architecture 600 for the components of the one or more central nodes. The illustrated embodiment should not be construed as limiting, however, as any one or more of the components can be implemented alone or in combination or subcombination with one or more of the other components. - Another embodiment of the one or more central nodes is illustrated in
architecture 5900 ofFIG. 59 . The components in thearchitecture 5900 are self-labeled and are not to be construed as limiting. Instead, the components can be used alone or in any combination or subcombination with one another. - 3.3.2. Data Model
- In particular embodiments, the central data server hosts a data model that implements any one or more of the following:
-
- The solution's actors credentials and attributes (e.g., one or more of Admin, Users, Service Providers, OEM, etc.);
- The embedded cloud topology description and peripheral attributes (e.g., one or more of edge nodes & peripherals attributes, relationships, etc.);
- The APIs and Applications attributes (e.g., one or more of their access credentials, business model and application/API relationships, etc.); and/or
- One or more peripheral request activity logs (e.g., binary inputs and outputs (as files, for instances) and other such events and data), which may be used for extracting utilization load per infrastructure's customer (e.g. application designer, service provider) in order to, e.g., generate billing information.
- Description and modeling of personalized and localized commercial content (e.g. advertisement, coupons, promotional communication) that can be distributed for example together with a printout (on a printer peripheral) or on a display (on a TV peripheral).
-
FIG. 60 is an entity-relation diagram showing oneillustrative relationship model 6000 for data in an embodiment of the disclosed technology. The relationships and particular data objects shown inFIG. 60 should not be construed as limiting, however, as other implementations can use any one or more of the data objects or any one or more of the illustrated relationship alone or in any combination with one another. -
FIGS. 61A and B are schematic block diagrams showing one illustrativephysical model FIGS. 61A and 61B should not be construed as limiting, however, as other implementations can use any one or more of the data objects or any one or more of the illustrated relationship alone or in any combination with one another. - 3.3.3. Service Views
- Various services can be provided using embodiments of the CSP according to the disclosed technology.
FIG. 7 is a block diagram 700 showing services that can be available according to one illustrative embodiment of the disclosed technology. The services and arrangement of services shown inFIG. 7 are by way of example only. Any one or more of the services can be offered alone or in any combination with one another. - The illustrative service view shown in
FIG. 7 provides a high-level description of the services that the CSP can provide to various actors, including, for example: -
- Enabling services to deal with the internal management of the platform (these include, but are not limited to, one or more of: identity management, application and APIs life cycle management, edge nodes remote configuration and management, billing, activity monitoring, and/or the like); and/or
- Core services dealing with CSP's customers (these include, for example, one or more of pay-per-use peripheral and data services, application hosting, and/or the like).
- 3.3.4. Edge Node Architecture & Design
- In certain embodiments of the disclosed technology, the CSP edge nodes implement any one or more of the following functionalities:
-
- Secured device-initiated connection to the CSP central nodes;
- On-premises peripheral controller (e.g., edge nodes receive and interpret CSP peripheral requests initiated by per-per-use or free web APIs invocation, and manage any state associated with peripheral requests; such as, for example, peripheral requests may be complex and may necessitate local interactions between the edge node software and the driven peripheral, as illustrated by the inner loop in
FIG. 5 ); and/or - Asynchronous and/or cyclic reporting of peripheral state change.
-
FIG. 8 is a schematic block diagram showing anillustrative architecture 800 for the software components that can be used to implement a CSP edge node according to one embodiment of the disclosed technology. In certain implementations, the edge node is implemented using Freescale i.MX6Q boards with one or more quad-core ARM processors running Mentor Graphics' embedded Linux. The edge node can be configured to manage and control the peripherals via one or more central APIs. To provide the connection to the peripherals, the edge node can comprise one or more connectors, including one or more of a USB port, HDMI port, Ethernet port, or any other port and associated driver hardware for connecting and controlling one or more peripherals. The illustrative embodiment shown inFIG. 8 should not be construed as limiting in any way, however, as any of the components can be used alone or in any combination or subcombination with one another. - In certain implementations, businesses (such as vertical businesses) may desire the edge node to have additional features. In such implementations, the edge node can have one or more additional features, including one or more of:
-
- Short range radio interface to aggregate data from one or more wireless sensors network (for example in home automation);
- Bluetooth support to connect to one or more wireless devices (such as weight scale or blood pressure monitor(s));
- A WiFi transceiver (e.g., an 802.11 compliant wireless transceiver) to so that the edge node can also serve as a WiFi access point and communicate directly with mobile devices in WiFi range of the edge node, thereby facilitating low-latency “inner loop” processing as more fully explained below; and/or
- A web browser to support web interface in the case the edge node is used for user's interface.
-
FIG. 9 is schematic block diagram of an illustrativeexample system architecture 900 comprising a backend 912 (which can be thecentral node 600 and further include one or more of the illustrated components), a frontend 910 (which can be one or more theedge nodes 800 and further include one or more of the illustrated components), andmobile devices 920, which can be operated by a user to interact with the one ormore peripherals 914. The communications between thebackend 912 and thefrontend 910 as well as the communications between thebackend 912 and themobile devices 920 can be facilitated, for example, via the internet or other public network. The illustrative embodiment shown inFIG. 9 should not be construed as limiting in any way, however, as any of the components can be used alone or in any combination or subcombination with one another. -
FIG. 10 is a schematic block diagram showing anotherexample system architecture 1000 showing both thecentral node 1012 and theedge node 1010 in communication with one another via anetwork 1020. Thenetwork 1020 can be, for example, the internet or other public network. The illustrative embodiment shown inFIG. 10 should not be construed as limiting in any way, however, as any of the components can be used alone or in any combination or subcombination with one another. - One example embodiment of the disclosed technology is a system comprising: one or more central servers configured to host a set of web services and applications; and one or more edge nodes in communication with the one or more central servers, each of the one or more edge nodes being further configured to drive two or more peripherals, wherein the web services and applications are configured to be accessed by a mobile device separate from the central servers and the edge nodes and to facilitate operation of at least one of the peripherals driven by an edge node at a location in common with the mobile device without the mobile device directly communicating with the at least one of the peripherals. The two or more peripherals can be non-internet-enabled electronic peripherals.
- Another example embodiment of the disclosed technology is a system, comprising: one or more central servers; and one or more edge nodes in communication with the one or more central servers, each of the one or more edge nodes comprising an edge node processor executing edge node software services including one or more of (a) a local web server/proxy request parser; (b) a local web browser configured to provide a local interface and execution client; and (c) one or more local device handlers or drivers, each of the one or more edge nodes being further configured to control one or more peripheral devices. The one or more peripherals can be non-internet-enabled electronic peripherals. The one or more peripheral devices can comprise two or more heterogeneous peripherals that operate using (a) different peripheral drivers;
- (b) different peripheral APIs; or (c) different operating systems. The one or more central servers can host one or more web services accessible via a mobile device application, at least one of the web services being configured to communicate with a respective edge node and drive a respective peripheral connected to the edge node in response to a request from a mobile device executing the mobile device application at a location coincident with the respective peripheral.
- Illustrative embodiments of the disclosed technology are configured with scalability in mind. For example, certain implementations of the disclosed technology are configured to handle a large number of recurrent transactions. To generate large number of transactions, implementations of the disclosed technology are designed to reach to people in strategic places of their day to day life such as their office, their car, or their home. Applications can be provided to such individuals through the use of their mobile devices. The mobile devices can leverage the peripheral environment that surrounds them. For example, smartphones are becoming so ubiquitous that it is desirable to provide one or more applications that can be distributed to these smartphones and allow the user to access peripherals that exist or can exist throughout the environments that the user occupies in the course of their lives.
- For example, any place with an identifiable set of peripherals can be targeted by the described technology, such as for example: hospital, mall, stadium, point of historical or sociological interest, and/or the like. In all such cases, a set of peripherals (e.g., a printer, scanner, monitor, actuator, sensor, or other such peripheral device) at the considered location can be used as the foundation of a system ecosystem (e.g., a system of interconnected peripheral devices) by collectively identifying all of the known peripheral devices within that system ecosystem.
- The disclosed technology can be deployed in a variety of environments. Example environments are disclosed below, but such environments should not be construed as limiting, as the number of the environments in which aspects of the disclosed technology can be used are not limited. Generally speaking, any number or variety of peripherals can be coupled to an edge node and used to create a customized deployment of the disclosed cloud-based service platform. The peripherals can include, for instance, one or more of: a multi-touch display, an image capture device (e.g., a camera), a microphone, a keypad, an RFID reader, a fingerprint reader, a Wi-Fi access point, a USB connector, a scanner (e.g., a barcode reader), a document scanner, a scale, a display device (e.g., a digital sign), a credit card reader, a smart card reader, a USB/phone charger, or other such electronic peripheral. A few example environments in which the disclosed cloud-services platform can be used are disclosed below:
- An office environment, comprising one or more office peripherals. The office peripherals can comprise office peripherals such as: one or more printers, scanners, copiers, scales, coffee machines, information displays, access control systems, or the like;
- A car environment, comprising one or more car peripherals The peripherals can comprise peripherals such as: one or more automotive built-in instrument controls (e.g., speed, acceleration, motor control, and/or the like), safety systems, navigation systems, user mobile phones on a dock, cameras, multimedia devices, driver assistance sensors, driver assistance actuators, or the like;
- A health care environment, comprising one or more health care peripherals. The peripherals can comprise peripherals such as: one or more connected weight scales, blood pressure monitors, oxygen meters, glucose meters, cameras, external body sensors, internal body sensors/actuators (e.g., pacemakers), or the like.
- A connected home environment, comprising one or more home peripherals. The home peripherals can comprise peripherals such as: printers, scanners, copiers, cameras, burglar alarms, electricity/gas meters, TVs, access systems, remote controls, or the like.
- There exist many business environments in which embodiments of the disclosed technology can be implemented. The exhibits attached to this disclosure, which are incorporated by reference herein, further illustrate sample environments in which the disclosed technology can be implemented. Of course, any one or more aspects of the environment can be implemented in any environment where the access, management, and/or connectivity offered by the disclosed technology is desirable.
- In particular embodiments, a platform operator can be used to administrate the central platform as described above and allow any one or more application developers or any one or more peripheral and/or service suppliers to participate in the advantages of embodiments of the disclosed architecture. For example, a “platform operator” can be formed to administrate the platform and collect operating revenues.
- In particular implementations, this operator can collect recurrent revenues as the platform is utilized by multiple applications and/or operated by multiple service providers. Since platform services are managed, multiple business models can be implemented and enforced. For example, the platform services can be offered according to one or more of the following business models:
- Pay-Per-Use;
- Subscription;
- Revenue sharing as a percentage of service provider's revenues; and/or
- Any combination of the above
- In certain embodiments, barriers to entry to use embodiments of the disclosed technology can be lowered, using for example any one or more of the following techniques:
- In certain embodiments, the managed APIs (e.g., via RESTful compliant HTTP or HTTPs web services) are given access to application developers. The APIs can be accessed and distributed through an “API store” web portal that presents peripheral and peripheral-related services in an intuitive way (similar to a mobile app store that is now a common experience). The web developer can then pick and choose the pay-per-use APIs he/she is interested in for a given application and subscribe to (or purchase) them. The application developer can then create any connected application (e.g., web application, native application or hybrid application) using/calling the APIs he/she has subscribed to.
- In other embodiments, an applications' metadata (or other description) is advertised to end users via a CSP-specific application store.
- For competitive platform providers, the barrier to entry is desirably high. According to embodiments of the disclosed technology, this is the case at many different levels. One or more of the following can be used to help secure a high barrier of entry for competitive platform providers:
-
- System architecture: Embodiments of the platform are made of a backend information system coupled with a large number of remote peripherals via edge nodes. The proper management of this large pool of peripherals and control devices of multiple natures is a complex task making the emergence of direct competition difficult. The edge nodes, which connect peripherals to the backend infrastructure and implement the device drivers, run a software stack that is not off the shelf, even though in certain implementations it can be assembled from general purpose components;
- Peripheral connections to the back end: The connection of the peripherals to the backend is partially proprietary, involving security and reliability elements that are not off the shelf. One element that can be used in this subsystem is the edge nodes hosting peripheral servers. Duplicating these solution components and managing them properly is also a complex task. It should be noted that managed peripherals do not require an Internet connection; for example, with various implementations of the technology, they can be of any kind (e.g., USB, serial, short range radio, wired, etc.);
- Proprietary peripherals: Proprietary peripherals or peripherals with proprietary interfaces can be operated over public yet protected Web APIs. The creation of such APIs is only possible under agreement of the one or more owners of such proprietary peripherals; and/or
- De facto standard: As the eco-system grows, more and more application developers will get used to the rules and behaviors of the services. The cost of changing platform provider will contribute to level up the barrier to entry.
- In certain embodiments, there exists the opportunity to set up a service operator business alongside the platform operations. This service operator can collect, for example, subscription revenue directly from the end users.
- Various implementations of the technology may be used to allow a variety of mobile computing devices to work with a variety of stationary or semi-stationary supported computing devices.
-
FIG. 11 is a block diagram of anexample network configuration 1100 for implementing embodiments of the technology. As seen in this figure, thenetwork configuration 1100 implementing various aspects of the technology can include a Web service layer host 1103, a plurality of mobile computing devices 1105, and a plurality of supported computing devices 1107. As will be explained in more detail below, thenetwork configuration 1100 also may include anedge node host 1109, adisplay device 1111, or some combination of both. - According to various implementations of the technology, a user will initially carry a mobile computing device 1105, such the
smartphone 1105A or atablet computing device 1105B, to a location having one or more supported computing devices 1107. In the example illustrated inFIG. 11 , the supported computing devices 1107 include aprinter 1107A and amultifunction device 1107B, but with alternate implementations of the technology the supported computing devices 1107 may be medical testing or evaluation devices, devices used for shipping (such as scales), resource tracking devices such as those used in retail stores or warehouses, or others. - Next, a recognition application is launched by the mobile computing device 1105. The recognition application can be manually launched by the user of the mobile computing device 1105. Alternately, the recognition application can be manually launched in response to some stimulus, such as a particular movement of the mobile computing device 1105, an electromagnetic or sonic signal, a trigger from a positioning application (e.g., a Global Positioning Satellite position indication application), etc. The user then employs the recognition application of the mobile computing device 1105 to obtain supported device identification information identifying at least one of the supported computing devices 1107. With some implementations of the technology, the recognition application may be used to scan an identification marker physically located on a supported computing device 1107, such as a Near Field Communication (NFC) marker or a Quick Response (QR) code marker. Of course, with alternate implementations of the technology the recognition application may use any known technique to identify a particular supported computing device 1107. Also, it should be appreciated that the supported device identification information may identify a particular known environment of multiple supported computing devices 1107.
- Once the recognition application has obtained the supported device identification information, the mobile computing device 1105 transmits the supported device identification information to the Web service layer host 1103. With the illustrated examples, the Web service layer host 1103 hosts a CSP backend as described in detail above. The mobile computing device 1105 can transmit the supported device identification information to the Web service layer host 1103 using any suitable communication medium, such as, for example, through a public or private electronic communication network (e.g., the internet).
- With various implementations of the technology, the mobile computing device 1105 can also transmit user identification information to the Web service layer host 1103. The user identification information will include information identifying the mobile computing device 1105, the user of the mobile computing device 1105, the particular known environment of multiple supported computing devices 1107, or some combination of both.
- In response to receiving the identification information, the Web service layer host 1103 conveys application information back to the mobile computing device 1105. More particularly, the Web service layer host 1103 provides the mobile computing device 1105 with application information corresponding to applications associated with the identification information. For example, if the identification information identified a supported computing device 1107 as a particular model of printer, then the application information may correspond to a printing application that allows the mobile computing device 1105 to print from that particular model of printer. Further, if the identification information identified the supported computing device 1107 as being at a particular retail location and identified the user as being a person with a purchase history at that retail location, then the application information may correspond to an application that provides coupons relevant to the user's purchase history and allows the mobile computing device 1105 to print the coupons from that particular model of printer. With various implementations of the technology, the application information may be a list of applications already resident on the mobile computing device 1105, the applications themselves for subsequent installation, or a link to the applications at another location for downloading or remote execution.
- With various implementations of the technology, the associated applications may convey data to the supported computing device 1107 through the Web service layer host 1103. For example, if an associated application is a photo application for printing photographs on a supported computing device 1107 that is a particular printer, the photograph data to be printed may be sent by the mobile computing device 1105 to the Web service layer host 1103. Alternately, the user may employ the mobile computing device 1105 to select photograph data stored at some remote location accessible to the Web service layer host 1103 (e.g., at a “cloud” storage location). The Web service layer host 1103 in turn will relay data from the associated application (e.g., the photograph data to be printed) to the supported computing device 1107 through any suitable communication medium, such as, for example, through a public or private electronic communication network (e.g., the Internet).
- The Web service layer host 1103 typically will relay data from the associated application to the supported computing device 1107 through an edge node, as discussed in detail above. In some implementations of the technology, the supported computing device 1107 will communicate with the Web service layer host 1103 through an edge node located in a separate edge node host 1109 (such as with the
multifunction device 1107B). Alternately, the supported computing device 1107 will communicate with the Web service layer host 1103 through an edge node located in the supported computing device 1107 itself (such as with theprinter 1107A). Of course, with still other implementations of the technology, the supported computing device 1107 may alternately or additionally send or exchange data with the supported computing device 1107 directly (either through the edge node or outside of the edge node). - According to some aspects of the technology, the Web service layer host 1103 may send additional data to the supported computing device 1107 or another associated device based upon the identification information. For example, the
network configuration 1100 includes adisplay monitor 1111 located near themultifunction device 1107B. If themultifunction device 1107B and thedisplay monitor 1111 are located at a retail location, they can be used to provide coupon or other sales-related information to the user of the mobile computing device 1105. Thus, if the identification information identifies the user as being a person with a purchase history at that retail location, then a service application at the Web service layer host 1103 (or at another related location) may generate or otherwise identify advertisement information relevant to the user's purchase history. The Web service layer host 1103 may then select the advertisement information for display to the user. For example, the Web service layer host 1103 may transmit generated advertisement information to thedisplay monitor 1111 for display via theedge node 1109. - If the advertisement information includes a coupon, the user may then use the
multifunction device 1107B to print the coupon. With various implementations of the technology, the user may print the coupon (or otherwise act upon the advertisement information) by interacting withdisplay monitor 1111, themultifunction device 1107B, mobile computing device 1105, or some combination thereof. With some implementations of the technology, the Web service layer host 1103 may employ the visual displays of two or more of thedisplay monitor 1111, themultifunction device 1107B, and the mobile computing device 1105 together to convey information to the user or to otherwise perform some function. Similarly, general advertisement information may be stored and displayed by the mobile computing device 1105 even before the identification information is sent, and subsequently updated and/or further displayed on thedisplay monitor 1111 or on a display of themultifunction device 1107B in response to the Web service layer host 1103 receiving the identification information. - Still further, various implementations of the technology may employ a variety of devices to perform a function. For example, the
network configuration 1100 may support the use of a greeting card generation application. The purchase of a greeting card may be presented to a user on thedisplay monitor 1111 in response to the Web service layer host 1103 receiving the identification information. The user may then purchase the card, format the card, take a photograph to add to the card, and sign the card using the mobile computing device 1105. Finally, the user may then print the card using themultifunction device 1107B. With some aspects of the technology, the mobile computing device 1105 may employ the processing resources of the supported computing device 1107, anedge node host 1109, or some combination of both. Thus, with this example, the mobile computing device 1105 may convey a photograph to themultifunction device 1107B through the Web service layer host 1103. For formatting the card, however, the mobile computing device 1105 may communicate directly with theedge node host 1109, and may further use processing power available from theedge node host 1109 to format the card prior to printing by themultifunction device 1107B. - With still other implementations of the technology, the recognition application may store identification information for previously recognized supported computing devices 1107, or alternately or additionally allow a user to remotely obtain identification information for supported computing devices 1107. With these embodiments, a user may employ various aspect of the technology to remotely employ supported computing devices 1107.
- Our day-to-day environment is surrounded by electronic devices that offer various targeted services to the end users. However, the traditional internet client/server model does not allow real time, low-latency interactions with such managed devices/peripheral since the transaction has to be carried out between a web client and an internet application server with an unknown number of internet servers in between, introducing latency patterns not compatible with real-time device/peripheral interfaces.
- Embodiments of the disclosed technology address this problem by using an edge node on the device/peripheral premises in order to enable a low latency, real-time capable “inner loop” between the managed devices/peripherals and the end user client side of the application. This “inner loop” operates in conjunction with the traditional internet “outer loop”.
-
FIG. 12 is a schematic block diagram that illustrates an example of a real-time inner loop for managed peripherals. InFIG. 12 ,edge node 1213 is hosting alocal process 1216 in charge of the real-time, low-latency part of the transaction that is taking place between aclient application 1210 and a device/peripheral 1214 over the outer loop. Thelocal process 1216 is actually a part of the device/peripheral service 1215 theclient 1210 has invoked. The introduction of this inner loop in the device/peripheral service path allows complex, real time transactions to take place over the control of a web interface. - In the illustrated embodiment, the
edge node 1213 is equipped with a WiFi transceiver to enable direct communication with theclient application 1210, which will typically be running on a mobile device such as a smartphone or tablet. By creating and using this direct connection, the “outer loop” invoking the internet can be avoided and low-latency processing in the “inner loop” between the edge node and theclient application 1210 can be facilitated. In this way, processing for theclient application 1210 can be distributed between the edge node and the central node. - One example embodiment for implementing the distributed processing of peripherals over the internet comprises: one or more central servers; and one or more edge nodes in communication with the one or more central servers via the internet, each of the one or more edge nodes comprising an edge node processor for executing edge node software services and a wireless transceiver, each of the one or more edge nodes being further coupled to and configured to control one or more peripheral devices, wherein a respective one of the edge nodes is configured to provide processing support to an application executing on a mobile device via a direct connection to the respective edge node through the wireless transceiver, thereby avoiding transactions using the internet, wherein the application executing on the mobile device interfaces with the one or more peripheral devices coupled to the respective edge node and uses the direct connection for transactions with the one or more peripheral devices. The transactions that are through the direct connection between the respective one of the edge nodes and the one or more peripheral devices can be substantially in real-time and not delayed by internet processing. The one or more central servers can also configured to communicate with the application executing on the mobile device and provide additional processing support to the application, the additional processing support being for processes that do not require real-time transactions with the one or more peripheral devices. The one or more peripheral devices can be non-internet-enabled electronic peripheral devices. The one or more central servers can also be configured to communicate with the application executing on the mobile device, and can be further configured to receive a request from the mobile device to use the one or more peripheral devices connected to the respective node and to transmit data indicative of the request to the respective edge node in order to facilitate the establishment of the direct connection between the mobile device and the respective edge node.
- In certain embodiments of the disclosed technology, devices and peripherals (e.g., TVs, printers, credit-card readers, etc.) are grouped into clusters that share a common higher-level purpose. Internet services for these clusters can then be published or otherwise made available for connected client applications. For example, the internet services can terminate on either a single device/peripheral cluster node, or a group of cluster nodes, hence abstracting the cluster into multi-form macro devices/peripherals. Notably, it is not necessary for one or more of the devices and peripherals of a given cluster to have networking capabilities, as the cluster arrangement aggregates heterogeneous devices and peripherals ranging from simple sensors to complex embedded devices and makes them accessible and controllable through the internet via an edge node.
-
FIG. 13 is a schematic block diagram illustrating an example arrangement by which clusters of devices and peripherals are exposed on the internet. InFIG. 13 , a series ofedge nodes central server 1312 over the internet. The example shown inFIG. 13 shows three examples of device/peripheral clusters: office, telehealthcare, or car. These particular clusters are for illustrative purposes only. Additional or alternative clusters may be included in the arrangement and adapted for any desired purpose or functionality. In the illustrated embodiment, the central server exposes/publishes internet versions of the cluster services. Published services are terminating either on a single device/peripheral cluster node or on a group of nodes. - In
FIG. 13 , the cluster services are integrated into one or more connected applications, which can be accessed and used by users 1311. In particular implementations, the applications can render on any web client, mobile or not.Central nodes 1312 can also route a service request to the proper edge node and log the activity for reconciliation and billing. In addition, thecentral nodes 1312 can accumulate utilization and profile information that feeds a large database used to provide fine grain data services pertaining to the device/peripheral cluster utilization and users. -
FIG. 18 , for example, illustrates another example of a system according to the disclosed technology in which heterogeneous clusters of peripherals are connected via a central node. The example shown inFIG. 18 shows three examples of device/peripheral clusters: office, telehealthcare, and connected home. - The edge nodes of any of the disclosed embodiments can also have additional features or capabilities, such as one or more of the following:
-
- Co-existence of multiple radio interfaces and protocols in a single embedded device. In particular, the edge node can seamlessly operate heterogeneous wireless sensor/actuator devices.
- Application partitioning between central processing and edge-node processing. In particular, and as noted in the previous section, low latency, real-time interactions between end-user and edge node, together with keeping a centralized control over managed web APIs can be performed and optimized. This can involve the introduction and management of macro commands, short session and transaction management, and appropriate software infrastructure on the edge nodes.
- Distributed computing using edge node servers. A full deployment of such an embedded cloud infrastructure implies hundreds of thousands of edge nodes with a very ‘bursty’ utilization. The dormant tera Hz and tera bytes of processing power and storage can be utilized in view to balance the load between the central and edge nodes.
- Virtualization & Domain isolation. Edge nodes are typically driving heterogeneous devices that may not all be supported by the same operating system. The system can use multi OS support on the edge node. In addition, it can isolate data and processing for security and confidentiality reasons. Domain isolation mechanisms can be used in some cases.
- Portable Edge Nodes. Edge nodes can be operated in a portable manner in some use cases (e.g., they can be detached temporarily from a base station). In this situation, the detached agent/portable unit can be battery operated and be capable of one or more of power optimization, temporary local data storage and data reconciliation.
- Adaptive Edge Nodes. The edge node can be configured to discover and connect to large number of peripherals automatically and dynamically. The solution is then able to cope with dynamic/evolving peripheral topologies. As part of this dynamic behavior, the edge node can (i) install/uninstall needed drivers, handle terminal software, (ii) recovery schemes and redundancy: use one peripheral instead of another, distribute load on equivalent peripherals, and/or (iii) route requests to different edge nodes if applicable.
- Our day-to-day environment is surrounded by electronic devices and equipment that offer various targeted services to the end users. These services are accessible over various interfaces, such as infrared remote command, serial cable, short range radio interface, Ethernet, and the like. Embodiments of the disclosed technology comprise an arrangement that creates an additional, centralized interface to access any such device/peripheral from the internet. The publication of these device/peripheral services on a managed internet server enables connected applications to access a large range of devices/peripherals on various premises.
-
FIG. 14 is a schematic block diagram illustrating an edge node arrangement configured to expose peripheral services on the internet. InFIG. 14 , a series ofedge nodes premise # 1 andpremise # 2. These edge nodes are used to integrate the various devices/peripherals (e.g., PO, drivers, and handlers (collectively shown asperipherals central server 1412 over the internet. Thecentral server 1412 exposes/publishes internet versions of the various device/peripheral services. - In the illustrated embodiment, the published services are integrated into one or more connected applications, which can be accessed and used by users 1411. Such connected applications can render on any web client, mobile or not. The
central nodes 1412 can help ensure that the service request is routed to the proper edge node and log the activity for reconciliation and billing. - One example embodiment for managing clusters of heterogeneous electronic peripherals on the internet and/or publishing and managing on-premises peripherals over the internet, comprises: one or more central servers; and one or more edge nodes in communication with the one or more central servers via the internet, each of the one or more edge nodes comprising an edge node processor for executing edge node software services, each of the one or more edge nodes being further coupled to and configured to control one or more peripheral devices, the one or more peripheral devices being non-internet-enabled peripheral devices, wherein the one or more central servers are configured to provide services over the internet to a mobile device, the services including an application that can be installed on the mobile device and that provides access to each of the one or more edge nodes and their associated peripheral devices, thereby providing internet access to non-internet-enabled peripheral devices. The one or more edge nodes can comprise a first edge node coupled two or more heterogeneous peripheral devices. For instance, the two or more heterogeneous peripheral devices can have heterogeneous operating systems, heterogeneous drivers, or heterogeneous APIs. The services can include a first application that can be installed on the mobile device providing access to a first set of multiple edge nodes and a second application that can be installed on the mobile device providing access to a second set of multiple edge nodes different from the first set. In certain implementations, each edge node in the first set of multiple edge nodes can be coupled to a first combination of peripheral device types, and each edge node in the second set of multiple edge nodes can be coupled to a second combination of peripheral device types different from the first combination of peripheral device types.
- In certain embodiments of the disclosed technology, a heterogeneous set of devices is grouped into a connected cluster to deliver services that leverage the different capabilities of each device. The existing user interface of each device in the cluster can vary dramatically from: none (e.g., a temperature sensor) to very simple (e.g., a 7-segment display) to more elaborated interfaces (e.g., an LCD or touch screen interface). Embodiments of the disclosed technology provide a unified user interface for controlling and using a heterogeneous cluster of devices. The unified user interface can be rendered onto the end user's personal mobile device.
- This user interface can provide any one or more of the following advantages: (i) devices without display or with rudimentary user interface can interact with the end user via modern, high resolution screens with touch panels used in now ubiquitous smartphones and tablets; (ii) the user interface deals with the cluster of devices in a unified manner, guiding the user in his individual device interactions in a service-centric manner, as opposed to a traditional, device-centric user set of interfaces; (iii) the end user experience can be improved by using the typical set of peripherals on board smart phones and tablets (e.g., camera, microphone, virtual or real keyboard, NFC tags, RFID reader, and/or other such peripherals).
-
FIG. 15 is a schematic block diagram illustrating an example arrangement for how a unified UI can be used with a connected cluster of heterogeneous devices. InFIG. 15 , a series of one ormore edge nodes 1513 are used to aggregate a set of peripheral onto a cluster. Theseedge nodes 1513 are connected to acentral server 1512 over the internet. In the illustrated example embodiment, theedge nodes 1513 embed Local Device Handlers (LDH) that expose Central Device Controllers (CDC) hosted on an internet server. In particular implementations, there is one set of CDC services for one set of LDH services, though other arrangements are possible. In the illustrated example embodiment, the end user mobile device (smartphone or tablet) is connected to the internet either via a cellular data connection or a WiFi access point on the local premises. The end user mobile client connects to a web application (e.g., a downloadable application or web-based application), which then provides a user interface. The user interface invokes the CDC service(s) to interact with the devices, based on the end user inputs originated from the mobile device. In this way, a single unified user interface can be used to interact with two or more heterogeneous devices, which may themselves have little or no user interface capability. - One example embodiment for a mobile user interface for a heterogeneous cluster of devices comprises: one or more central servers; and one or more edge nodes in communication with the one or more central servers via the internet, each of the one or more edge nodes comprising an edge node processor for executing edge node software services, each of the one or more edge nodes being further coupled to and configured to control two or more peripheral devices, wherein the one or more central servers are configured to provide services over the internet to a mobile device, the services including a web-based or downloadable application that can be accessed by the mobile device and that provides a single unified user interface on the mobile device operative to control the two or more peripheral devices. The two or more peripheral devices can be non-internet-enabled electronic peripheral devices. The two or more peripheral devices can be heterogeneous peripheral devices. In some implementations, at least one of the peripheral devices has no separate user interface. In certain implementations, the single unified user interface comprises a user interface rendered on a touchscreen of the mobile device that includes a first set of one or more user-selectable regions for controlling a first peripheral and a second set of one or more user-selectable regions for controlling a second peripheral. In this implementation, the first set and second set of user-selectable regions are simultaneously displayed to the user via the single unified user interface. The application can be a first application, and the one or more central servers can be configured to provide a second application that can be accessed by the mobile device and that provides a single unified user interface on the mobile device operative to control a different set of two or more peripheral devices controlled by a different edge node.
- A variety of specialized devices exist on our day-to-day environment. These specialized devices carry out specific functions, are usually costly, require physical connections, and have interoperability challenges. Mobile-based technology is forecasted to slowly and quietly replace the need for specialized equipment along with connectivity hassles that they bring.
- Embodiments of the disclosed technology can be used to connect a user's mobile device to a specialized device in a unique manner. In particular, exemplary arrangements of the disclosed technology allow a user to print artifacts or other materials from mobile devices to TV screens that are registered in an embedded cloud. Embodiments of the disclosed technology can also facilitate the user to control the screen display remotely via the mobile device. These embodiments can be used to eliminate the need for specialized devices and physical connections that were previously necessary to connect a mobile device user to such devices.
- Embodiments of the disclosed technology can provide any one or more of the following advantages: (i) allowing the user to display mobile device artifacts on the fly; (ii) eliminating the need for physical connections and interfaces; (iii) eliminating the need for specialized equipment, and thereby allowing the user to access services using only their mobile device and internet access; (iv) improving the user experience as the user currently only needs to access a mobile device application to spool his mobile device artifact to a screen that is registered on the cloud; (v) allowing the mobile device to be used to edit the artifact using the touch panel/stylus of the mobile equipment; (vi) allowing edits to be committed to the original document; and/or (vii) allowing mobile equipment to control the display of the document, such as the number of pages, magnification, etc.
-
FIG. 16 is a schematic block diagram illustrating an exemplary arrangement of the disclosed technology that allows a mobile device to be mirrored on a TV screen screen over the internet. In the illustrated embodiment,edge nodes 1613 are used to connect TV screens to acentral server 1612 over the internet. Theedge nodes 1613 embed Local Device Handlers (LDH) that expose Central Device Controllers (CDC) hosted on an internet server. The end user mobile device (smartphone or tablet) is connected to the internet either via a cellular data connection or a WiFi access point on the local premises. The end user mobile client connects to a web application. The user interface of this web application invokes the CDC service to interact with the identified TV screen, based on the end user inputs originated from the mobile device. For example, the user interface on the user's mobile device can include the option to “print to screen”, whereby a document stored on the cloud (or sent to the cloud from the mobile device) can be rendered by the cloud server and then displayed on the screen (e.g. because the TV has a video input coupled directly to the edge node). In some implementations, the document or files is rendered by the edge node itself. Similarly, and using the edge node, the user interface on the user's device can have a “mobile-screen to TV-screen link” operation or a “white board” operation for displaying the screen on the mobile device on the TV screen. - Other operations that can also be implemented include a security services using a camera (e.g., a camera installed on or used with the TV) or room energy-saving features (e.g., cooling, lighting, etc.).
-
FIG. 62 is aflowchart 6200 illustrating method acts performed by an application executed on a user's mobile device for implementing an exemplary print-to-TV flow using a cloud service platform.FIG. 63 is aflowchart 6300 illustrating method acts performed by a central server for implementing an exemplary print-to-TV flow using a cloud service platform. The illustrated method acts are not to be construed as limiting, as they can be used alone or in any combination or subcombination with one another or with other methods. - At 6210, an identification of a display device on which a user desires to display digital media is received (e.g., input, buffered, or otherwise prepared for further processing). In some embodiments, the receiving can comprise performing a scanning operation of a machine-readable code associated with the display device (e.g., a tag with a QR code on or near the display device) or performing a near-field communication (NFC) scanning operation on a NFC tag associated with the display device (e.g., an NFC tag on or near the display device). In other embodiments, a Bluetooth, RFID, or other wireless connection can be established with display device, thereby providing the display device identification to the mobile device. Still further, the display device may have an identification number displayed on it that the user can input manually via the application on the mobile device. The display device identification can be an identification number assigned to the display device or some other form of unique identifier (e.g., a UUID, MAC address, or other such identification means).
- At 6212, an identification of the digital media that the user desires to display is received. The digital media can be any suitable data file for display, such as a Word document, Power Point presentation, PDF, image data (e.g., JPEG), video data (e.g., MPEG, h.264, HEVC, or other such video file), or other such displayable media file.
- At 6214, the identification of the display device along with either the identification of the digital media or data for the digital media is wirelessly transmitted to a central server separate from the display device.
- In some embodiments, user-selected display parameters affecting how the digital media will be displayed are received by an application on the mobile device. The display parameters can include, for example, rotation, cropping, zooming field, color, resolution, and/or other such display parameters. The identified display parameters can then be transmit to the central server.
- In some embodiments, the identification of the document received comprises an indication of digital media stored on a cloud storage provider. In such instances, the digital media can be retrieved from the cloud storage provider for display (e.g., using previously stored user credentials or using credentials that the user inputs as part of this particular print-to-TV request).
- Turning to
FIG. 63 , at 6310, an identification of a selected display device on which a user of the mobile device desires to display a digital media is received from a mobile device. As noted, in some instance, the identification of the video monitor on which the user desires to display digital is generated by the user using the mobile device to perform a scanning operation of a machine-readable code associated with the display device or to perform a near-field communication (NFC) scanning operation on a NFC tag associated with the display device. - At 6312, the digital media data for display is received. For example, an identification of the digital media data can be received by the mobile device, wherein the identification indicates that the digital media data is stored on a cloud storage provider. In such instances, the act of receiving the digital media data can comprise retrieving the digital media data from the cloud storage provider. In other examples, the digital media data itself is received directly from the mobile device.
- At 6314, the digital media data for display is rendered. For instance, the digital media data can be converted (e.g., decompressed according to a codec and rendered) into a format suitable for display on the display device.
- At 6316, the rendered digital media data is transmitted to an edge node remote from the central server and coupled to the selected display device.
- In some embodiments, a user selection of display parameters affecting how the digital media will be displayed is also received and the rendering is performed in accordance with the display parameters. In certain embodiments, the edge node is separate from the video monitor and is configured to provide a video signal to the video monitor that is compatible with the video monitor. In further embodiments, as the digital media data is being displayed, a request from the user for modifications to the digital media data can be received, a modified version of the digital media data can be rendered based on the received request, and the rendered modified version of the digital media data is transmitted to the edge node. For instance, the request from the user for modifications to the digital media data can indicate that a different page of a document is to be displayed or a different slide of a presentation, or can indicate new material to be added to the digital media data and displayed (e.g., edits to a document or additional mark-ups to a displayed image using a “whiteboard” feature).
- Certain embodiments of the disclosed technology comprise a distributed print service that delivers localized and profiled commercial content to end users, in addition to the requested printout. The additional commercial content (e.g., an advertisement or coupon) can come in the form on an extra page preceding or succeeding the actual printout payload or merged with the payload (e.g., top of page, bottom of page, overlay, watermark, etc.). In some implementations, a cloud-hosted distributed print service also implements localized advertisement services that correlates location-based information with end user profile data and other contextual information or analytics in order to deliver highly profiled and targeted commercial content to the print service user, in addition to his/her requested printout.
- Certain implementations leverage the existence of on-premises edge nodes that are part of the cloud infrastructure of the print service. The edge nodes and print service infrastructure can be any of the configurations or arrangements disclosed herein. For example, and referring to the schematic block diagram of
FIG. 17 , the fact that theedge nodes - The fact that the
edge nodes - By delivering commercial content, in addition to the end user requested printout, embodiments of the disclosed technology can: (i) offset the cost of the service, making it more affordable for endusers; (ii) introduce additional services to the end use; and/or (iii) create innovative business collaboration between service operator, advertisement company, and local (to the edge node) businesses.
-
FIG. 17 is a schematic block diagram illustrating an exemplary arrangement for providing profiled commercial content on a cloud-based printer infrastructure. In particular,FIG. 17 illustrates an arrangement for delivering localized and profiled commercial content together with the end user printout. - One example embodiment for delivering localized and profiled commercial content on paper media according to the disclosed technology is a system, comprising: one or more central servers; and one or more edge nodes in communication with the one or more central servers via the internet, each of the one or more edge nodes comprising an edge node processor for executing edge node software services, each of the one or more edge nodes being further coupled to and configured to control one or more peripheral devices, a respective one of the edge nodes being coupled to and configured to control a printer, wherein the one or more central servers are configured to provide services over the internet to a mobile device, the services including an application that can be installed on or accessed by the mobile device and that facilitates a transaction with a user of the mobile device that causes a document to be printed at the printer controlled by the respective one of the edge nodes, wherein the one or more central servers are further configured to select commercial material targeted for the user and to cause the targeted commercial material to be printed at the printer with the document. The commercial material can comprise a coupon or advertisement. The one or more central servers can be configured to select the commercial material based on a known and previously stored location of the printer. The commercial material can comprise a coupon or advertisement for a business and the one or more central servers can be configured to select the commercial material by identifying one or more businesses that are in a geographic range of the printer and selecting the commercial material for one or more of the business identified as being within the geographic range. The one or more central servers can be configured to select the commercial material based on profile data for the user stored with the one or more central servers. The one or more central servers can be configured to select the commercial material based on analytics generated using transaction data from previous transaction between the user and the one or more central servers. The one or more central servers can be configured to select the commercial material based on information gathered from an additional peripheral device coupled to and controlled by the respective one of the edge nodes. In this implementation, the additional peripheral device can be a camera configured to capture an image of the user, and the one or more central servers can be configured to perform a facial recognition process on the image and to select the commercial material based on the facial recognition data.
- In certain example embodiments of the cloud services platform, the platform is used to provide printing services at various locations by allowing users to identify a local printer using their mobile device (e.g., a smartphone), upload document data and print identification data to the cloud-based server, and receive a printed copy of the document at the identified printer. Further, in some embodiments, the cloud-based central server can perform file manipulation and/or file conversion.
-
FIG. 19 is a block diagram 1900 illustrating various components of the printing solution and method acts that can be performed.FIG. 20 is a high-level flow chart illustrating the various actions performed according to one exemplary printing flow.FIGS. 21-30 further illustrate the various actions identified inFIG. 20 and also show example screen shots that may be appear to the user on their mobile device (e.g., via an app that is downloaded or accessed by a web browser to implement the printing process). The illustrated method acts are not to be construed as limiting, as they can be used alone or in any combination or subcombination with one another or with other methods. -
FIG. 64 is aflowchart 6400 illustrating method acts performed by an application executed on a user's mobile device for implementing an exemplary printing flow using a cloud service platform.FIG. 65 is aflowchart 6500 illustrating method acts performed by a central server for implementing an exemplary printing flow using a cloud-based platform. The illustrated method acts are not to be construed as limiting, as they can be used alone or in any combination or subcombination with one another or with other methods. - In
FIG. 64 , at 6410, a user login for his or her mobile printing account managed by a cloud-based central server is received. An example login screen is shown inFIG. 21 . The user may login with a user name and password, and may optionally select a location. The location may also be determined by GPS coordinates of the mobile device or be absent from the login screen. - At 6412, an identification of a printer on which a user desires to print a document is received (e.g., input, buffered, or otherwise prepared for further processing). In some embodiments, the receiving can comprise performing a scanning operation of a machine-readable code associated with the printer (as shown in
FIGS. 22-23 ) or performing a near-field communication (NFC) scanning operation on a NFC tag associated with the printer (as shown inFIGS. 24-25 ). In other embodiments, a Bluetooth, RFID, or other wireless connection can be established with printer, thereby providing the printer identification to the mobile device. Still further, the printer may have an identification number displayed on it that the user can input manually via the application on the mobile device. The printer identification can be an identification number assigned to the printer or some other form of unique identifier (e.g., a UUID, MAC address, or other such identification means). - At 6414, an identification of the document that the user desires to print can be received (as shown in
FIG. 26 ). In this discussion, the term “document” encompasses multiple file formats that stored digital media that might desirably be printed, such as a Word document, Power Point presentation, PDF, JPEG, or other such printable media file. The document can be stored locally at the device or be a file stored in a cloud-hosted storage service (e.g., administered by a third party). - At 6416, the identification of the printer along with either the identification of the document (when the document is stored in a cloud-hosted storage service) or data for the document itself (e.g., data for a document, presentation, picture, or any file desirably printed) is wirelessly transmitted to a central server (e.g., to a central node of the cloud service platform). When the document is stored in a cloud-hosted storage service, the digital media can be retrieved from the cloud storage provider for printing (e.g., using previously stored user credentials or using credentials that the user inputs as part of this particular print request).
- In some embodiments, user-selected printing parameters affecting how the document will be printed are also received by the application on the mobile device (as shown in
FIG. 28 ). The printing parameters can include, for example, paper size, orientation, color, number of copies, double sided, print range, and/or other such print parameters. The printing parameters can then be sent to the central server for use in processing and preparing the document for printing. In certain embodiments, a user selection indicating that the user desires to receive coupons for local services when printing the document is received by the application on the mobile device (as shown inFIG. 29 ). The user selection indicating that the user desires to receive coupons can then be transmitted to the central server. The selection to receive one or more coupons may allow a reduction in any printing price that is charged (e.g., the printing may be free or at least partially subsidized by the user's selection to receive coupons). Or, the user may simply desire to receive coupons for local businesses. The coupons to be printed with the selected document can be selected based on the location of the identified printer (e.g., local businesses) and/or user preferences. The content for the coupons can be maintained on the central server, the edge node itself, or accessed from a third-party server upon request by the central server. - Turning to
FIG. 65 , at 6510, an identification of a selected printer on which a user of the mobile device desires to print a document is received from a mobile device. As noted with respect toFIG. 64 , the identification can be obtained, for example, by the user performing a scanning operation of a machine-readable code associated with the selected printer or performing a near-field communication (NFC) scanning operation on an NFC tag associated with the selected printer. - At 6512, data for the document is received. For example, an identification of the document can be received by the mobile device, wherein the identification indicates that the document is stored on a cloud storage provider. In such instances, the act of receiving the data for the document can comprise retrieving the document from the cloud storage provider. In other examples, the document data itself is received from the mobile device.
- At 6514, document printing data is transmitted to an edge node remote from the central server and associated with the selected printer. The document printing data is data that causes the document to be printed at the selected printer in accordance with any selected printing parameters.
- In certain embodiments, a user selection of printing parameters affecting how the document will be printed is also received, and the document printing data is generated based at least in part on the printing parameters (e.g., to apply the printing parameters). In some embodiments, a user selection indicating that the user desires to receive coupons for local services when printing the document is received, coupon data associated with the location of the selected printer is received (e.g., accessed locally or accessed from another server), and the document printing data is supplemented with the coupon data so that one or more coupons are printed at the selected printer along with the document. In certain embodiments, the edge node is separate from the printer and is configured to communicate with the printer using printer drivers designed for the printer.
-
FIGS. 31-32 are block diagrams illustrating an example in which a cloud service platform is used to display digital media on a digital display or digital sign. The digital display can be connected to a central server via an edge node as disclosed herein. The edge node can also be connected one or more additional peripherals, such as a printer or image capture device as shown inFIGS. 31 and 32 . The cloud-based central server can be used to manage and update digital media data on the display device. The cloud-based central server can, in some embodiments, also perform one or more of the processing tasks associated with rendering the digital media for display (e.g., by performing encoding or decoding operations). Further, in some embodiments, the cloud-based central server can perform file manipulation and/or file conversion (e.g., conversion from Power Point to PDF). The digital display can be used to present any type of desired information at the digital display, such as corporate information, stock information, weather, news, promotions, and the like (as shown inFIG. 31 ), or emergency instructions in the event of an emergency. Any of the information displayed can be supplemented by one or more advertisements, which can be maintained at the central server or accessed from a third-party server storing the advertisements. - In certain example embodiments of the cloud services platform, the platform is used to provide visitor check-in services at a portal in a building, establishment, or other area.
-
FIGS. 33-41 illustrate various actions associated with the performance of one exemplary method. The illustrated method acts are not to be construed as limiting, as they can be used alone or in any combination or subcombination with one another or with other methods. -
FIGS. 66 and 67 are flow charts that illustrate an example implementation of the method introduced byFIGS. 33-41 .FIG. 66 is aflowchart 6600 illustrating method acts performed by an edge node and associated peripherals (e.g., a video display device, a scanner, an imaging device, and/or a printer) for implementing an exemplary check-in method using a cloud service platform.FIG. 67 is aflowchart 6700 illustrating method acts performed by a central server in communication with the edge node for implementing an exemplary check-in method using a cloud service platform. The illustrated method acts are not to be construed as limiting, as they can be used alone or in any combination or subcombination with one another or with other methods. - As shown in
FIG. 33 , a passkey can be provided to the user by the user pre-scheduling the visit to the managed area. The passkey can be, for example, a one-time password, number, or code. The passkey can be either provided directly to the user via a website that manages the scheduling or by an authorized host (e.g., a resident in the managed building or employee of a company in the restricted area). - As shown in
FIG. 34 , the edge node and its associated peripherals can also be used to display check-in instructions. For instance, instructions for performing any one or more of the operations below can be displayed to the user during the check-in process. - In
FIG. 66 , at 6610, a visitor is authenticated by (a) receiving a visitor passkey input from the visitor, transmitting the passkey to a central server, and receiving an indication from the central server that the visitor is authenticated; or (b) receiving a visitor passkey transmitted from the central server, receiving a visitor passkey input from the visitor, and authenticating the visitor if the visitor passkey from the central server matches the visitor passkey input from the visitor. In some embodiments, the user may not have a passkey and can instead check-in as a guest and optionally provide the name of his or her contact person. This authentication operation is also shown inFIG. 35 . - At 6612, an identification document of the guest is scanned via a scanner controlled by the edge node (as further shown in
FIG. 36 ). The identification document can be, for instance, a driver's license, passport, or other identity card. In certain implementations, there may be legal terms or safety instructions concerning the visit that can be printed out for the visitor at this point or at any other point during the check-in operation. - At 6614 (and as further shown in
FIG. 36 ), a digital image of the guest is captured via an image capture device controlled by the edge node. - In some embodiments, and as shown in
FIG. 37 , a signature or other information about the visitor can be requested and obtained (e.g., a thumbprint, an email address, a mailing address, a social security number, or other such information). - In certain embodiments, a personalized tag to be worn by the visitor can be generated and printed. For example, the tag can be a personalized tag with the visitor's name, picture, date, access rights, access restrictions, and/or other such data. In particular implementations, the personalized tag can be created when the visit is pre-scheduled, and when the visit is not pre-scheduled, the host can be prompted to authenticate the visitor. In some instances, a digital image of the host can also be taken.
- At any point during the check-in operation, the host can be notified of the visitor's arrival. For instance, the host can be automatically notified via a SMS message, email message, and/or voice mail message.
- At 6616, a record of the visitor is generated. The record can comprise at least the identification document and digital image.
- At 6618, the record is transmitted to the central server. As shown in
FIG. 39 , for example, the record can be stored by the central server for any period of time (e.g., days, months, or years). - In some embodiments, and as shown in
FIG. 40 , the authentication process can further comprise using the digital image to perform a facial recognition process. For instance, the facial recognition process can be performed by the central server. - As shown in
FIG. 41 , a printer controlled by the edge node can be used to print a parking pass for the visitor. - Turning now to
FIG. 67 , which illustrates an exemplary process performed by the central server to implement the check-in process, at 6710, a scheduling request from a visitor or host for a visitor-managed area is received. - At 6712, a visitor passkey is generated and transmitted to the visitor.
- At 6714, the authentication of the visitor at the visitor-managed area is facilitated by (a) receiving a visitor passkey transmitted from an edge node coupled to two or more peripherals, comparing the visitor passkey transmitted from the edge node with the visitor passkey transmitted to the visitor, and transmitting an authentication confirmation if the visitor passkey transmitted from the edge node matches the visitor passkey transmitted to the visitor; or (b) transmitting the visitor passkey previously transmitted to the visitor to the edge node coupled to two or more peripherals.
- At 6716, a record of the visitor at the visitor-managed area is received and stored. The record can comprise at least a scanned image of an identification document for the visitor and a digital image of the visitor. The scanned image can be obtained by a scanner coupled to the edge node, and the digital image of the visitor can be obtained by an image capture device at the edge node.
- In certain embodiments, a facial recognition process is performed on the digital image of the visitor, and the act of facilitating the authentication of the visitor at the visitor-managed area comprises transmitting an authentication confirmation based on the facial recognition process to the edge node.
- In certain example embodiments of the cloud services platform, the platform is used to facilitate an automated notarization process for documents. Although the term “notarization” is used, it should be understood that the term is used in a broad sense to encompass authentication processes by which a document is assigned a unique identification and a record is created for the document evidencing the date, time, and user who input the document. Such information can be used for various authentication purposes as well as document control and storage purposes.
-
FIGS. 42-50 illustrate various actions associated with the performance of one exemplary method. The illustrated notary method can be performed by an edge node and associated peripherals (e.g., a video display device, a scanner, a fingerprint scanner, an imaging device, and/or a printer). Furthermore, instructions for performing the notarization process can be displayed to the user via the display device as the user interacts with the edge-peripherals. The illustrated method acts are not to be construed as limiting, as they can be used alone or in any combination or subcombination with one another or with other methods. - In
FIG. 42 , a user is authenticated. For instance, the user can be authenticated using a mobile wallet app, a username and password, NFC card/tag, or RFID card/tag. InFIG. 43 , the user's fingerprint is taken (e.g., via a fingerprint scanner controlled by an edge node). InFIG. 44 , the document desired to be notarized is scanned (e.g., via a scanner controlled by the edge node). InFIG. 45 , an identification of the user is scanned (e.g., a driver's license, passport, or other official form of identification). InFIG. 46 , an image of the user is obtained. InFIG. 47 , payment information for the transaction is received from the user, potentially along with the user's electronic or other signature. InFIG. 48 , a copy of the document with watermarks and/or a unique ID indicating the notarization (or authenticating the document as having been presented on the day and time stored) is printed for the user. The copy can also or alternatively be sent to the user via email (e.g., at a fee). InFIG. 49 , the document and the identification information of the user is transmitted to the central server and stored for any desired amount of time (e.g., days, months, or years). The user may later desired to access the document and the authentication of the date and time at which it was scanned for authentication purposes. Thus, atFIG. 50 , the user can access and re-print and/or re-send the authenticated document. - In certain example embodiments of the cloud services platform, the platform is used to facilitate an automated kiosk for shipping packages.
-
FIGS. 51-58 illustrate various actions associated with the performance of one exemplary method. The illustrated method acts are not to be construed as limiting, as they can be used alone or in any combination or subcombination with one another or with other methods. -
FIGS. 68 and 69 are flow charts that illustrate an example implementation of the method introduced byFIGS. 51-58 .FIG. 68 is aflowchart 6800 illustrating method acts performed by an edge node and associated peripherals (e.g., a video display device, a scale, and/or a printer) for implementing an exemplary shipping method using a cloud service platform.FIG. 69 is aflowchart 6900 illustrating method acts performed by a central server in communication with the edge node for implementing an exemplary shipping method using a cloud service platform. The illustrated method acts are not to be construed as limiting, as they can be used alone or in any combination or subcombination with one another or with other methods. - At 6810, and in some embodiments, a weight of the package is received from the scale. For instance, and as illustrated in
FIG. 51 , the package can be placed on a scale peripheral connected to the edge node (e.g., via a prompt from the display device). - At 6812, an indication of a destination for the package is received from the user. For instance (and as shown in
FIG. 52 ), the user can be requested to enter destination information via a display device and a user input device (e.g., a touchpad, keyboard, or touch screen). - At 6814, the indication of the destination for the package (and, in some embodiments, the weight) is transmitted to the central server. For instance, as shown in
FIG. 53 , this information can be used by a central server to request real-time bids from multiple shipping service providers. - At 6816, an indication of multiple shipping bids for the package is received from the central server. One or more of the shipping bids can indicate a cost of shipping the package and a delivery time for the package.
- At 6818, one or more of the multiple shipping bids are displayed to the user via the video display device. For instance, as shown in
FIG. 54 , the multiple bids can be displayed in the form of cost and/or delivery time. - At 6820, an indication of a selected one of the shipping bids is received from the user. For instance (as shown in
FIG. 55 ), the user can then select a desired bid. - At 6822, payment information for the selected one of the shipping bids is received from the user.
- At 6824, the indication of the selected one of the shipping bids and the payment information is transmitted to the central server.
- At 6826, acceptance of the payment information is received from the central server.
- At 6828, a shipping label is printed via the printer upon acceptance of the payment information.
- In certain embodiments, a notification is transmitted to a shipping company responsible for the selected one of the shipping bids of the package and the payment information.
- Turning to
FIG. 69 , at 6910, an indication of a destination for a package (and, in some embodiments, a weight of the package) is received from an edge node coupled to two or more peripherals separate from the edge node, the two or more peripherals including at least a video display device and a printer. - At 6912, two or more shipping bids for the package are generated by transmitting shipping bid requests that include the destination for the package (and, in some embodiments, the weight) to two or more shipping companies.
- At 6914, the two or more shipping bids for the package are transmitted to the edge node.
- At 6916, an indication of the selected one of the shipping bids and payment information are received from the edge node.
- At 6918, an acceptance of the payment information for the selected one of the shipping bids is received (e.g., from the selected shipping company or a payment card provider transacting the payment).
- At 6920, the acceptance of the payment information is transmitted to the edge node.
- The central server can also transmit a notification to a shipping company responsible for the selected one of the shipping bids of the package and the payment information.
- Further details for exemplary non-limiting embodiments of the disclosed cloud-based platform are shown in U.S. Provisional Application No. 61/801,857, filed on Mar. 15, 2013, and entitled “CLOUD SERVICES PLATFORM”, and U.S. Provisional Application No. 61/889,525, filed on Oct. 10, 2013, and entitled “CLOUD SERVICES PLATFORM”, both of which are hereby incorporated herein by reference. Any one or more of the features, aspects, and/or functions described in any of the appendices of these provisional applications or above can be used alone or in any combination or sub-combination with one another.
- Having illustrated and described the principles of the disclosed technology, it will be apparent to those skilled in the art that the disclosed embodiments can be modified in arrangement and detail without departing from such principles. For example, any one or more aspects of the disclosed technology can be applied in other embodiments. In view of the many possible embodiments to which the principles of the disclosed technologies can be applied, it should be recognized that the illustrated embodiments are only preferred examples of the technologies and should not be taken as limiting the scope of the invention.
Claims (13)
1. (canceled)
2. (canceled)
3. A method, comprising:
by computing hardware in a mobile device,
receiving an identification of a printer on which a user desires to print a document, the receiving comprising performing a scanning operation of a machine-readable code associated with the printer or performing a near-field communication (NFC) scanning operation on a NFC tag associated with the printer;
receiving an identification of the document that the user desires to print;
wirelessly transmitting to a central server the identification of the printer along with either the identification of the document or data for the document.
4. The method of claim 3 , further comprising:
receiving a user selection of printing parameters affecting how the document will be printed; and
transmitting the printing parameters to the central server.
5. The method of claim 3 , further comprising:
receiving a user selection indicating that the user desires to receive coupons for local services when printing the document; and
transmitting the user selection indicating that the user desires to receive coupons to the central server.
6. The method of claim 3 , wherein the receiving the identification of the document comprises receiving an indication of a document stored on a cloud storage provider.
7. One or more non-transitory computer-readable media storing computer-executable instructions when executed by a computer cause the computer to perform the method of claim 3 .
8. A method, comprising:
by computing hardware in a central server,
receiving from a mobile device an identification of a selected printer on which a user of the mobile device desires to print a document, the identification having been obtained by the user performing a scanning operation of a machine-readable code associated with the selected printer or performing a near-field communication (NFC) scanning operation on a NFC tag associated with the selected printer;
receiving data for the document; and
transmitting document printing data to an edge node remote from the central server and associated with the selected printer, the document printing data causing the document to be printed at the selected printer.
9. The method of claim 8 , further comprising:
receiving a user selection of printing parameters affecting how the document will be printed; and
generating the document printing data based at least in part on the printing parameters.
10. The method of claim 8 , further comprising:
receiving a user selection indicating that the user desires to receive coupons for local services when printing the document;
retrieving coupon data associated with the location of the selected printer; and
supplementing the document printing data with the coupon data so that one or more coupons are printed at the selected printer along with the document.
11. The method of claim 8 , wherein the method further comprises receiving from the mobile device an identification of the document, wherein the identification indicates that document is stored on a cloud storage provider; and wherein the receiving data for the document comprises retrieving the document from the cloud storage provider.
12. The method of claim 8 , wherein the edge node is separate from the printer and is configured to communicate with the printer using printer drivers designed for the printer.
13. One or more non-transitory computer-readable media storing computer-executable instructions when executed by a computer cause the computer to perform the method of claim 8 .
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/216,967 US20140313542A1 (en) | 2013-03-15 | 2014-03-17 | Cloud services platform |
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201361801857P | 2013-03-15 | 2013-03-15 | |
US201361889525P | 2013-10-10 | 2013-10-10 | |
US14/216,967 US20140313542A1 (en) | 2013-03-15 | 2014-03-17 | Cloud services platform |
Publications (1)
Publication Number | Publication Date |
---|---|
US20140313542A1 true US20140313542A1 (en) | 2014-10-23 |
Family
ID=51538558
Family Applications (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/216,967 Abandoned US20140313542A1 (en) | 2013-03-15 | 2014-03-17 | Cloud services platform |
US14/216,954 Active US9887884B2 (en) | 2013-03-15 | 2014-03-17 | Cloud services platform |
US15/858,735 Abandoned US20180123908A1 (en) | 2013-03-15 | 2017-12-29 | Cloud services platform |
Family Applications After (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/216,954 Active US9887884B2 (en) | 2013-03-15 | 2014-03-17 | Cloud services platform |
US15/858,735 Abandoned US20180123908A1 (en) | 2013-03-15 | 2017-12-29 | Cloud services platform |
Country Status (6)
Country | Link |
---|---|
US (3) | US20140313542A1 (en) |
EP (1) | EP2972758A4 (en) |
JP (1) | JP2016519812A (en) |
KR (1) | KR20150132499A (en) |
CN (1) | CN105144077A (en) |
WO (1) | WO2014145877A2 (en) |
Cited By (37)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20160057207A1 (en) * | 2014-08-20 | 2016-02-25 | Futurewei Technologies, Inc. | AUTOMATING CLIENT DEVELOPMENT FOR NETWORK APIs |
US20160259609A1 (en) * | 2015-03-05 | 2016-09-08 | Seiko Epson Corporation | Display apparatus, display system, and control method for display apparatus |
CN106355780A (en) * | 2016-08-29 | 2017-01-25 | 合肥菲力姆数码科技有限公司 | Image self-service machine based on RFID (radio frequency identification) technology |
CN106355779A (en) * | 2016-08-29 | 2017-01-25 | 合肥菲力姆数码科技有限公司 | Multifunctional self-service printing work station for medical use |
CN106355781A (en) * | 2016-08-29 | 2017-01-25 | 合肥菲力姆数码科技有限公司 | Self-service double-sided graphic-report printing system |
CN106373286A (en) * | 2016-08-29 | 2017-02-01 | 合肥菲力姆数码科技有限公司 | Self-service type medical paper film printing system |
CN106384452A (en) * | 2016-08-29 | 2017-02-08 | 合肥菲力姆数码科技有限公司 | Medical intelligent film taking machine |
CN106384449A (en) * | 2016-08-29 | 2017-02-08 | 合肥菲力姆数码科技有限公司 | Medical image ink-jet printing system based on DICOM |
CN106384448A (en) * | 2016-08-29 | 2017-02-08 | 合肥菲力姆数码科技有限公司 | Medical image digital printing system |
CN106408782A (en) * | 2016-08-29 | 2017-02-15 | 合肥菲力姆数码科技有限公司 | Medical shooting image comprehensive working station |
US20170078434A1 (en) * | 2015-09-11 | 2017-03-16 | Amazon Technologies, Inc. | Read-only data store replication to edge locations |
CN106610797A (en) * | 2015-10-23 | 2017-05-03 | 鼎翰科技股份有限公司 | Intelligent type mobile tag printer, printing system and tag printing method |
US20170300732A1 (en) * | 2015-09-16 | 2017-10-19 | CloudMondo, Inc. | Cloud-based authentication of user devices for onboarding to a wi-fi network |
JP2017208077A (en) * | 2016-03-31 | 2017-11-24 | 京セラドキュメントソリューションズ株式会社 | Printing system and method, and mobile client computing device |
US9984727B2 (en) | 2015-12-23 | 2018-05-29 | Bryant E. Walters | System for playing files associated with tagged interest items |
US20180277123A1 (en) * | 2017-03-22 | 2018-09-27 | Bragi GmbH | Gesture controlled multi-peripheral management |
US10172173B2 (en) * | 2014-09-18 | 2019-01-01 | Seiko Epson Corporation | Information processing system and display device |
US20190035241A1 (en) * | 2014-07-07 | 2019-01-31 | Google Llc | Methods and systems for camera-side cropping of a video feed |
US10380429B2 (en) | 2016-07-11 | 2019-08-13 | Google Llc | Methods and systems for person detection in a video feed |
US10412566B2 (en) * | 2014-06-25 | 2019-09-10 | Canon Kabushiki Kaisha | Information processing apparatus, method of controlling the same, and storage medium |
US10452921B2 (en) | 2014-07-07 | 2019-10-22 | Google Llc | Methods and systems for displaying video streams |
US10664688B2 (en) | 2017-09-20 | 2020-05-26 | Google Llc | Systems and methods of detecting and responding to a visitor to a smart home environment |
US10685257B2 (en) | 2017-05-30 | 2020-06-16 | Google Llc | Systems and methods of person recognition in video streams |
USD893508S1 (en) | 2014-10-07 | 2020-08-18 | Google Llc | Display screen or portion thereof with graphical user interface |
US10848582B2 (en) | 2015-09-11 | 2020-11-24 | Amazon Technologies, Inc. | Customizable event-triggered computation at edge locations |
US20200371782A1 (en) * | 2018-01-15 | 2020-11-26 | Siemens Aktiengesellschaft | Artifact lifecycle management on a cloud computing system |
WO2021050080A1 (en) * | 2019-09-13 | 2021-03-18 | Hewlett-Packard Development Company, L.P. | Presentation transcripts |
US10957171B2 (en) | 2016-07-11 | 2021-03-23 | Google Llc | Methods and systems for providing event alerts |
US11082701B2 (en) | 2016-05-27 | 2021-08-03 | Google Llc | Methods and devices for dynamic adaptation of encoding bitrate for video streaming |
US20210365627A1 (en) * | 2015-07-11 | 2021-11-25 | Thinxtream Technologies Ptd. Ltd. | System And Method For Contextual Service Delivery Via Mobile Communication Devices |
US20210390246A1 (en) * | 2015-07-11 | 2021-12-16 | Thinxtream Technologies Ptd. Ltd. | System and method for contextual service delivery via mobile communication devices |
US11356643B2 (en) | 2017-09-20 | 2022-06-07 | Google Llc | Systems and methods of presenting appropriate actions for responding to a visitor to a smart home environment |
US11539581B2 (en) | 2018-08-27 | 2022-12-27 | At&T Intellectual Property I, L.P. | Autonomous cloud design and control |
US11599259B2 (en) | 2015-06-14 | 2023-03-07 | Google Llc | Methods and systems for presenting alert event indicators |
US11783010B2 (en) | 2017-05-30 | 2023-10-10 | Google Llc | Systems and methods of person recognition in video streams |
US11893795B2 (en) | 2019-12-09 | 2024-02-06 | Google Llc | Interacting with visitors of a connected home environment |
US12021917B2 (en) * | 2014-12-19 | 2024-06-25 | Zebra Technologies Corporation | Method for enabling communication between a user device browser and a local device |
Families Citing this family (32)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10691397B1 (en) * | 2014-04-22 | 2020-06-23 | sigmund lindsay clements | Mobile computing device used to operate different external devices |
JP6224635B2 (en) * | 2015-01-30 | 2017-11-01 | 東芝テック株式会社 | Information output control system |
US9582225B2 (en) | 2015-03-27 | 2017-02-28 | Kyocera Document Solutions Inc. | Document solution management platform in a decentralized environment |
US10231084B2 (en) | 2015-08-14 | 2019-03-12 | Aeris Communications, Inc. | System and method for monitoring devices relative to a learned geographic area |
US9774994B2 (en) | 2015-08-14 | 2017-09-26 | Aeris Communications, Inc. | System and method for monitoring devices relative to a user defined geographic area |
US10648823B2 (en) | 2017-06-22 | 2020-05-12 | Aeris Communications, Inc. | Learning common routes and automatic geofencing in fleet management |
US10437575B2 (en) | 2015-08-14 | 2019-10-08 | Aeris Communications, Inc. | Aercloud application express and aercloud application express launcher |
US9832802B2 (en) | 2015-12-15 | 2017-11-28 | At&T Intellectual Property I, L.P. | Facilitating communications via a mobile internet-enabled connection interface |
CN105791430A (en) * | 2016-04-27 | 2016-07-20 | 北京大有中城科技有限公司 | Novel terminal networking system |
CN105978942A (en) * | 2016-04-27 | 2016-09-28 | 北京大有中城科技有限公司 | Fragmented CDN network |
US10606522B2 (en) | 2016-07-15 | 2020-03-31 | Hewlett-Packard Development Company, L.P. | Printable content provision capabilities messages |
CN106292604A (en) * | 2016-09-09 | 2017-01-04 | 深圳市智物联网络有限公司 | A kind of control terminal being applied to industry Internet of Things |
US10560532B2 (en) * | 2016-09-23 | 2020-02-11 | Apple Inc. | Quick relay session management protocol |
US11627195B2 (en) | 2017-06-22 | 2023-04-11 | Aeris Communications, Inc. | Issuing alerts for IoT devices |
US10735904B2 (en) | 2017-06-22 | 2020-08-04 | Aeris Communications, Inc. | System and method for monitoring location and activity of devices |
US11132636B2 (en) | 2017-06-22 | 2021-09-28 | Aeris Communications, Inc. | System and method for monitoring and sharing location and activity of devices |
US11823067B2 (en) | 2017-06-27 | 2023-11-21 | Hcl Technologies Limited | System and method for tuning and deploying an analytical model over a target eco-system |
US10142491B1 (en) | 2017-07-05 | 2018-11-27 | International Business Machines Corporation | Support system for cellular based resource sharing service |
JP6499729B2 (en) | 2017-07-19 | 2019-04-10 | ファナック株式会社 | Application sales management server system |
EP3662641B1 (en) | 2017-07-31 | 2022-09-07 | Ricoh Company, Ltd. | Communication system, distributed processing system, distributed processing method, and recording medium |
US10915777B2 (en) | 2017-09-11 | 2021-02-09 | Ricoh Company, Ltd. | Communication terminal, communication system, and image processing method |
US10931836B2 (en) | 2018-03-29 | 2021-02-23 | Ricoh Company, Ltd. | Communication system, image processing method, and recording medium |
US11245707B2 (en) | 2018-03-31 | 2022-02-08 | Ricoh Company, Ltd. | Communication terminal, communication system, communication control method, and recording medium |
IT201800007439A1 (en) * | 2018-07-23 | 2020-01-23 | Innovative system for the control of advanced printing processes | |
US11323684B2 (en) | 2018-11-30 | 2022-05-03 | Ricoh Company, Ltd. | Apparatus, system, and method of processing image data to be relayed |
CN109976684A (en) * | 2019-02-28 | 2019-07-05 | 苏州博瑞凯德信息技术有限公司 | A kind of adapter distribution print system, method and device |
JP7466156B2 (en) | 2019-04-05 | 2024-04-12 | ミミック・テクノロジー・インコーポレイテッド | Method and system for distributed edge cloud computing |
EP4049413A4 (en) * | 2019-10-26 | 2023-07-05 | Mimik Technology Inc. | Method and system for distributed edge cloud computing |
CN110851090A (en) * | 2019-11-12 | 2020-02-28 | 中国科学院计算机网络信息中心 | Cloud printing method and system based on edge computing technology |
CN113259878B (en) * | 2020-02-11 | 2022-06-10 | 中移智行网络科技有限公司 | Call bill settlement method, system, electronic device and computer readable storage medium |
CN111313551B (en) * | 2020-03-05 | 2021-11-30 | 广东电网有限责任公司计量中心 | Multi-user-friendly interactive power utilization system based on intelligent power utilization network |
WO2024094272A1 (en) * | 2022-10-31 | 2024-05-10 | Telefonaktiebolaget Lm Ericsson (Publ) | Method and devices for selection of input/output devices in a wireless communication system |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8189225B1 (en) * | 2011-10-04 | 2012-05-29 | Google Inc. | Printing to a cloud printer via NFC |
US8451473B2 (en) * | 2011-07-18 | 2013-05-28 | Ricoh Company, Ltd. | Printer identification and mobile printing |
US20140085663A1 (en) * | 2012-09-26 | 2014-03-27 | Hewlett-Packard Development Company, L.P. | Mobile device printing through print service provider |
Family Cites Families (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6658459B1 (en) * | 1998-02-27 | 2003-12-02 | Adaptec, Inc. | System for sharing peripheral devices over a network and method for implementing the same |
US20020083143A1 (en) * | 2000-12-13 | 2002-06-27 | Philips Electronics North America Corporation | UPnP architecture for heterogeneous networks of slave devices |
US20020078161A1 (en) * | 2000-12-19 | 2002-06-20 | Philips Electronics North America Corporation | UPnP enabling device for heterogeneous networks of slave devices |
US7873028B2 (en) * | 2002-01-25 | 2011-01-18 | Quanta Computer, Inc. | Method and apparatus for a flexible peripheral access router |
US20060271695A1 (en) * | 2005-05-16 | 2006-11-30 | Electronics Line 3000 Ltd. | System for remote secured operation, monitoring and control of security and other types of events |
US7657255B2 (en) * | 2005-06-23 | 2010-02-02 | Microsoft Corporation | Provisioning of wireless connectivity for devices using NFC |
US20070211734A1 (en) * | 2006-03-10 | 2007-09-13 | Kuo-Long Yang | Digital living network alliance gateway having integrated website server for remote access and method thereof |
US7792491B2 (en) * | 2006-10-18 | 2010-09-07 | Matthew Robert Whitten | Wireless printing using a mobile computing device |
US8937930B2 (en) * | 2009-11-19 | 2015-01-20 | Qualcomm, Incorporated | Virtual peripheral hub device and system |
US9240923B2 (en) * | 2010-03-23 | 2016-01-19 | Juniper Networks, Inc. | Methods and apparatus for automatically provisioning resources within a distributed control plane of a switch |
US8608067B2 (en) * | 2010-04-02 | 2013-12-17 | Xerox Corporation | Web service for enabling network access to hardware peripherals |
GB201016198D0 (en) * | 2010-09-27 | 2010-11-10 | Canon Europa Nv | Image-processing system and image-processing method |
JP5799512B2 (en) * | 2011-01-31 | 2015-10-28 | ソニー株式会社 | Information processing apparatus, information processing method, and program |
US8990390B2 (en) * | 2011-12-12 | 2015-03-24 | Cisco Technology, Inc. | Remote monitoring and controlling of network utilization |
-
2014
- 2014-03-17 US US14/216,967 patent/US20140313542A1/en not_active Abandoned
- 2014-03-17 WO PCT/US2014/030717 patent/WO2014145877A2/en active Application Filing
- 2014-03-17 CN CN201480022522.XA patent/CN105144077A/en active Pending
- 2014-03-17 US US14/216,954 patent/US9887884B2/en active Active
- 2014-03-17 KR KR1020157029729A patent/KR20150132499A/en not_active Application Discontinuation
- 2014-03-17 JP JP2016503450A patent/JP2016519812A/en active Pending
- 2014-03-17 EP EP14764086.6A patent/EP2972758A4/en not_active Withdrawn
-
2017
- 2017-12-29 US US15/858,735 patent/US20180123908A1/en not_active Abandoned
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8451473B2 (en) * | 2011-07-18 | 2013-05-28 | Ricoh Company, Ltd. | Printer identification and mobile printing |
US8189225B1 (en) * | 2011-10-04 | 2012-05-29 | Google Inc. | Printing to a cloud printer via NFC |
US20140085663A1 (en) * | 2012-09-26 | 2014-03-27 | Hewlett-Packard Development Company, L.P. | Mobile device printing through print service provider |
Cited By (57)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10412566B2 (en) * | 2014-06-25 | 2019-09-10 | Canon Kabushiki Kaisha | Information processing apparatus, method of controlling the same, and storage medium |
US11197141B2 (en) * | 2014-06-25 | 2021-12-07 | Canon Kabushiki Kaisha | Information processing apparatus, method of controlling the same, and storage medium |
US20190357030A1 (en) * | 2014-06-25 | 2019-11-21 | Canon Kabushiki Kaisha | Information processing apparatus, method of controlling the same, and storage medium |
US10452921B2 (en) | 2014-07-07 | 2019-10-22 | Google Llc | Methods and systems for displaying video streams |
US10977918B2 (en) | 2014-07-07 | 2021-04-13 | Google Llc | Method and system for generating a smart time-lapse video clip |
US20190035241A1 (en) * | 2014-07-07 | 2019-01-31 | Google Llc | Methods and systems for camera-side cropping of a video feed |
US10467872B2 (en) | 2014-07-07 | 2019-11-05 | Google Llc | Methods and systems for updating an event timeline with event indicators |
US10789821B2 (en) * | 2014-07-07 | 2020-09-29 | Google Llc | Methods and systems for camera-side cropping of a video feed |
US11062580B2 (en) | 2014-07-07 | 2021-07-13 | Google Llc | Methods and systems for updating an event timeline with event indicators |
US10867496B2 (en) | 2014-07-07 | 2020-12-15 | Google Llc | Methods and systems for presenting video feeds |
US11011035B2 (en) | 2014-07-07 | 2021-05-18 | Google Llc | Methods and systems for detecting persons in a smart home environment |
US9398081B2 (en) * | 2014-08-20 | 2016-07-19 | Futurewei Technologies, Inc. | Automating client development for network APIs |
US20160057207A1 (en) * | 2014-08-20 | 2016-02-25 | Futurewei Technologies, Inc. | AUTOMATING CLIENT DEVELOPMENT FOR NETWORK APIs |
US10172173B2 (en) * | 2014-09-18 | 2019-01-01 | Seiko Epson Corporation | Information processing system and display device |
USD893508S1 (en) | 2014-10-07 | 2020-08-18 | Google Llc | Display screen or portion thereof with graphical user interface |
US12021917B2 (en) * | 2014-12-19 | 2024-06-25 | Zebra Technologies Corporation | Method for enabling communication between a user device browser and a local device |
US10191707B2 (en) * | 2015-03-05 | 2019-01-29 | Seiko Epson Corporation | Display apparatus, display system, and control method for display apparatus |
US20160259609A1 (en) * | 2015-03-05 | 2016-09-08 | Seiko Epson Corporation | Display apparatus, display system, and control method for display apparatus |
US11599259B2 (en) | 2015-06-14 | 2023-03-07 | Google Llc | Methods and systems for presenting alert event indicators |
US20210365627A1 (en) * | 2015-07-11 | 2021-11-25 | Thinxtream Technologies Ptd. Ltd. | System And Method For Contextual Service Delivery Via Mobile Communication Devices |
US20210390246A1 (en) * | 2015-07-11 | 2021-12-16 | Thinxtream Technologies Ptd. Ltd. | System and method for contextual service delivery via mobile communication devices |
US20170078434A1 (en) * | 2015-09-11 | 2017-03-16 | Amazon Technologies, Inc. | Read-only data store replication to edge locations |
US10848582B2 (en) | 2015-09-11 | 2020-11-24 | Amazon Technologies, Inc. | Customizable event-triggered computation at edge locations |
US11895212B2 (en) * | 2015-09-11 | 2024-02-06 | Amazon Technologies, Inc. | Read-only data store replication to edge locations |
US12069147B2 (en) | 2015-09-11 | 2024-08-20 | Amazon Technologies, Inc. | Customizable event-triggered computation at edge locations |
US9922225B2 (en) * | 2015-09-16 | 2018-03-20 | CloudMondo, Inc. | Cloud-based authentication of user devices for onboarding to a Wi-Fi network |
US20170300732A1 (en) * | 2015-09-16 | 2017-10-19 | CloudMondo, Inc. | Cloud-based authentication of user devices for onboarding to a wi-fi network |
CN106610797A (en) * | 2015-10-23 | 2017-05-03 | 鼎翰科技股份有限公司 | Intelligent type mobile tag printer, printing system and tag printing method |
US9984727B2 (en) | 2015-12-23 | 2018-05-29 | Bryant E. Walters | System for playing files associated with tagged interest items |
JP2017208077A (en) * | 2016-03-31 | 2017-11-24 | 京セラドキュメントソリューションズ株式会社 | Printing system and method, and mobile client computing device |
US11082701B2 (en) | 2016-05-27 | 2021-08-03 | Google Llc | Methods and devices for dynamic adaptation of encoding bitrate for video streaming |
US11587320B2 (en) | 2016-07-11 | 2023-02-21 | Google Llc | Methods and systems for person detection in a video feed |
US10957171B2 (en) | 2016-07-11 | 2021-03-23 | Google Llc | Methods and systems for providing event alerts |
US10657382B2 (en) | 2016-07-11 | 2020-05-19 | Google Llc | Methods and systems for person detection in a video feed |
US10380429B2 (en) | 2016-07-11 | 2019-08-13 | Google Llc | Methods and systems for person detection in a video feed |
CN106408782A (en) * | 2016-08-29 | 2017-02-15 | 合肥菲力姆数码科技有限公司 | Medical shooting image comprehensive working station |
CN106355780A (en) * | 2016-08-29 | 2017-01-25 | 合肥菲力姆数码科技有限公司 | Image self-service machine based on RFID (radio frequency identification) technology |
CN106355779A (en) * | 2016-08-29 | 2017-01-25 | 合肥菲力姆数码科技有限公司 | Multifunctional self-service printing work station for medical use |
CN106384448A (en) * | 2016-08-29 | 2017-02-08 | 合肥菲力姆数码科技有限公司 | Medical image digital printing system |
CN106384449A (en) * | 2016-08-29 | 2017-02-08 | 合肥菲力姆数码科技有限公司 | Medical image ink-jet printing system based on DICOM |
CN106384452A (en) * | 2016-08-29 | 2017-02-08 | 合肥菲力姆数码科技有限公司 | Medical intelligent film taking machine |
CN106355781A (en) * | 2016-08-29 | 2017-01-25 | 合肥菲力姆数码科技有限公司 | Self-service double-sided graphic-report printing system |
CN106373286A (en) * | 2016-08-29 | 2017-02-01 | 合肥菲力姆数码科技有限公司 | Self-service type medical paper film printing system |
US20180277123A1 (en) * | 2017-03-22 | 2018-09-27 | Bragi GmbH | Gesture controlled multi-peripheral management |
US10685257B2 (en) | 2017-05-30 | 2020-06-16 | Google Llc | Systems and methods of person recognition in video streams |
US11783010B2 (en) | 2017-05-30 | 2023-10-10 | Google Llc | Systems and methods of person recognition in video streams |
US11386285B2 (en) | 2017-05-30 | 2022-07-12 | Google Llc | Systems and methods of person recognition in video streams |
US11356643B2 (en) | 2017-09-20 | 2022-06-07 | Google Llc | Systems and methods of presenting appropriate actions for responding to a visitor to a smart home environment |
US11710387B2 (en) | 2017-09-20 | 2023-07-25 | Google Llc | Systems and methods of detecting and responding to a visitor to a smart home environment |
US11256908B2 (en) | 2017-09-20 | 2022-02-22 | Google Llc | Systems and methods of detecting and responding to a visitor to a smart home environment |
US10664688B2 (en) | 2017-09-20 | 2020-05-26 | Google Llc | Systems and methods of detecting and responding to a visitor to a smart home environment |
US12125369B2 (en) | 2017-09-20 | 2024-10-22 | Google Llc | Systems and methods of detecting and responding to a visitor to a smart home environment |
US11652641B2 (en) * | 2018-01-15 | 2023-05-16 | Siemens Aktiengesellschaft | Artifact lifecycle management on a cloud computing system |
US20200371782A1 (en) * | 2018-01-15 | 2020-11-26 | Siemens Aktiengesellschaft | Artifact lifecycle management on a cloud computing system |
US11539581B2 (en) | 2018-08-27 | 2022-12-27 | At&T Intellectual Property I, L.P. | Autonomous cloud design and control |
WO2021050080A1 (en) * | 2019-09-13 | 2021-03-18 | Hewlett-Packard Development Company, L.P. | Presentation transcripts |
US11893795B2 (en) | 2019-12-09 | 2024-02-06 | Google Llc | Interacting with visitors of a connected home environment |
Also Published As
Publication number | Publication date |
---|---|
WO2014145877A3 (en) | 2014-12-24 |
WO2014145877A2 (en) | 2014-09-18 |
EP2972758A2 (en) | 2016-01-20 |
EP2972758A4 (en) | 2016-11-09 |
US9887884B2 (en) | 2018-02-06 |
KR20150132499A (en) | 2015-11-25 |
CN105144077A (en) | 2015-12-09 |
US20140325048A1 (en) | 2014-10-30 |
JP2016519812A (en) | 2016-07-07 |
US20180123908A1 (en) | 2018-05-03 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20180123908A1 (en) | Cloud services platform | |
US11423205B2 (en) | Font personalization | |
US7774504B2 (en) | Policy-driven mobile forms applications | |
CN105917627B (en) | Method and system for customizing execution environment by cloud service | |
CN105900397B (en) | Home agent for mobile cloud services | |
CN109074265B (en) | Preformed instructions for mobile cloud services | |
JP2014525092A (en) | Methods for associating third-party content with online document signatures | |
US20150092233A1 (en) | System and method for providing cloud printing service | |
US20130043302A1 (en) | Social media platforms | |
JP2016519812A5 (en) | ||
CN105264554A (en) | Mobile expense capture and reporting | |
US10028086B2 (en) | Techniques for implementing location based device services | |
US8988716B1 (en) | Customized printer identifier with embedded access rights | |
CN106575340A (en) | Hierarchical privacy settings for comments and markups in a shared document | |
KR20210011122A (en) | System for managing electric contract and method thereof | |
CN106990927A (en) | Image processing system, Cloud Server, image formation system and connection method to set up | |
CN104011710A (en) | Mobile solution for importing and signing third-party electronic signature documents | |
US10476944B2 (en) | Backend service integration | |
US9753675B2 (en) | Providing promotional content for printers | |
US20140220961A1 (en) | Mobile device configuration utilizing physical display | |
US20210334057A1 (en) | Display system and display device | |
CN111367571A (en) | Equipment assembling method and device | |
US11736536B2 (en) | Information processing system, system, and information processing method | |
JP6044107B2 (en) | Information management server, information upload system, information upload method, and information upload program | |
JP7136836B2 (en) | Information processing method, information processing device and program |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: MENTOR GRAPHICS CORPORATION, OREGON Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:BENCHORIN, SHAY;LEEF, SERGE;PETIT, EMMANUEL;SIGNING DATES FROM 20140710 TO 20140718;REEL/FRAME:033809/0829 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |