US20190324592A1 - Pressure sensing touch systems and methods - Google Patents
Pressure sensing touch systems and methods Download PDFInfo
- Publication number
- US20190324592A1 US20190324592A1 US16/298,538 US201916298538A US2019324592A1 US 20190324592 A1 US20190324592 A1 US 20190324592A1 US 201916298538 A US201916298538 A US 201916298538A US 2019324592 A1 US2019324592 A1 US 2019324592A1
- Authority
- US
- United States
- Prior art keywords
- waveguide
- light
- detector
- pressure
- output
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
- G06F3/0421—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means by interrupting or reflecting a light beam, e.g. optical touch-screen
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/044—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/045—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means using resistive elements, e.g. a single continuous surface or two parallel surfaces put in contact
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/041—Indexing scheme relating to G06F3/041 - G06F3/045
- G06F2203/04109—FTIR in optical digitiser, i.e. touch detection by frustrating the total internal reflection within an optical waveguide due to changes of optical properties or deformation at the touch location
Definitions
- the present disclosure relates to touch-sensitive devices, and in particular to touch systems and methods capable of sensing a touch event at a touch location based on applied pressure at the touch location.
- touch-sensing techniques have been developed to enable displays and other devices to have touch functionality.
- Touch-sensing functionality is gaining wider use in mobile device applications, such as smart phones, e-book readers, laptop computers, tablet computers and like devices.
- Touch systems in the form of touch screens have been developed that respond to a variety of types of touches, such as single touches, multiple touches, swiping, finger touches and stylus touches. Some of these systems rely on light-scattering and/or light attenuation. While effective, there remains a need for alternative optics-based approaches to touch-sensing that can sense a touch event based on the pressure applied at the touch location.
- the present disclosure relates to touch-sensitive devices, and in particular to touch systems that detect a touch event based pressure applied at the touch location of the touch event. Aspects of the systems and methods take advantage of the deflection, steering or other alternation of light traveling within a waveguide when pressure is applied to the waveguide.
- the alterations of the light beam include changing the beam path, splitting the beam into multiple beams, creating interference between multiple beams, creating multiple output light beams, and changing the polarization state of the input light beam.
- the touch system includes a light-source system and a detector system operably disposed adjacent respective input and output edges of a waveguide in the form of a transparent sheet.
- the waveguide can also include just a portion of the transparent sheet, e.g., an ion-exchanged or thin waveguide layer adjacent the upper surface of the transparent sheet.
- Pressure at a touch location on the waveguide that gives rise to a touch event causes the waveguide to bend or flex.
- the waveguide bending causes a change in the optical paths of FTIR light traveling in the waveguide. This in turn causes the light distribution in the output light to change.
- the changes in the light distribution are detected and are used to determine whether a touch event occurred, as well as the time-evolution of the touch event.
- the changes can include polarization changes caused by birefringence induced in the waveguide by the pressure applied at the touch location.
- aspects of the disclosure include various detector configurations are disclosed for sensing the location and pressure of a touch event, such as by detecting the movement of fringes past the detector. Also, detecting outputted light at different detectors can be employed to measure the time difference between detector signals for a given touch event, and then using the time difference to determine the touch location of the touch event. Various detector configurations and detector signal processing techniques are disclosed that determine an amount of pressure at the touch event, as well as the time evolution of the applied pressure.
- FIG. 1A is a face-on view of an example touch system according to the disclosure.
- FIG. 1B is a face-on view of a portion of the touch system of FIG. 1A illustrating an example of multiple light source systems and multiple detector systems operably disposed about respective opposite edges of the waveguide;
- FIGS. 2A and 2B are top-down views of an example light source that includes multiple light-source elements ( FIG. 2A ) and an example detector that includes multiple detector elements ( FIG. 2B );
- FIG. 3 is a cross-sectional view of an example embodiment of the touch system of FIG. 1A ;
- FIGS. 4A through 4D are cross-sectional views of different example embodiments of the touch system of FIG. 1A ;
- FIGS. 5A through 5C are near-field images of the output light at the output edge of the waveguide for different amounts of bending of the waveguide, with FIG. 5A illustrating the case of no bending;
- FIGS. 6A and 6B are schematic side views of the waveguide that illustrate how bending the waveguide causes the light traveling in the waveguide to traverse a longer optical path;
- FIGS. 6C and 6D are close-up view of the input edge portion of the waveguide showing how otherwise collimated light traveling with no bounces ( FIG. 6A ) in an unbent waveguide can travel with bounces ( FIG. 6B ) in a bent waveguide;
- FIG. 6E is a close-up view of the output edge portion of the waveguide showing how output light from a bent waveguide exits the output edge and has a non-uniform (inhomogeneous) distribution;
- FIG. 6F show the intensity distribution of the output light at the output edge of the waveguide and illustrates the changes that occur in the intensity distribution of the output light as the amount of waveguide flexing (bending) increases;
- FIG. 6G shows a sequence of images of output light 104 -O taken at the output edge of an example waveguide, with the images showing the changes in the intensity distribution as well as a shift in the intensity pattern with increased waveguide bending.
- FIG. 7A is a schematic cross-sectional diagram of an example waveguide with a finger poised to create a touch event TE a central touch location;
- FIG. 7B shows waveguide of FIG. 7A with the touch event caused by the finger exerting downward pressure on waveguide on the upper surface, thereby causing the waveguide to flex;
- FIG. 7C is similar to FIG. 7B , except that the touch event occurs at a touch location that is closer to output edge;
- FIG. 8 is a plot of the measured power P M (in microwatts, ⁇ W) of the output light at a given output edge location versus the applied touching force F T (in Newtons, N) for a center location (squares) and an edge location (diamonds), illustrating how the change in power is less for an edge location than for a center location;
- FIG. 9A and FIG. 9B are simulated and measured far-field images of the output light emitted at the output edge of an example flexed waveguide two directions (positions) of the output light;
- FIG. 9C is a plot of the % of Power vs. glass deformation (mm) for the two light directions (positions) as determined by photodetectors arranged at the locations of the light spots.
- FIG. 10 is plot of the voltage versus time for one of the two far-field light spots when applying an instantaneous force of 1 Newton to an example waveguide made of glass having a thickness TH of 1.2 mm, wherein the voltage represents the measured power;
- FIGS. 11A and 11B are close-up, cross-sectional views of the output edge portion of an example waveguide showing simulate ray traces for different amounts of waveguide bending, and illustrating embodiments where the detectors are arranged on the lower surface ( FIG. 11B ) and both the upper and lower surfaces ( FIG. 11B );
- FIGS. 12A through 12C are schematic diagrams of an example waveguide showing simulated light rays for examples where the input light partially fills the waveguide ( FIG. 12A ), mostly fills the waveguide ( FIG. 12B ) and substantially completely fills the waveguide ( FIG. 12C );
- FIG. 13 is similar to FIG. 11B and illustrates an example detector configuration where the two detectors are arranged so that the detector signals are out of phase;
- FIG. 14 shows a series of simulated images of output light beams obtained by summing electric fields of the output light rather than the intensity
- FIG. 15 is a schematic partially exploded side view of an example waveguide that includes upper and lower cladding layers that enhance the waveguiding ability, and also showing a display unit that interfaces with the lower surface of the cladded waveguide;
- FIG. 16 is a schematic diagram of an example embodiment of touch system 10 that relies on polarization effects for touch sensing
- FIG. 17 is a plot of the detector signals SD from two detectors (det A, det B), illustrating how two detectors can be used to provide enhanced signal detection and measurement sensitivity;
- FIGS. 18A-18E are images of the output light as detected by the touch system of FIG. 16 , showing how the amount of detected output light changes with increased bending of the waveguide due to the induced stress birefringence imparted to the waveguide at the touch location;
- FIGS. 19A-19C are schematic side views of example embodiments of the touch system of FIG. 16 , with FIGS. 19B and 19C illustrating an example ion-exchanged waveguide;
- FIG. 20 is a schematic side view of an example touch system similar to that shown in FIG. 3 and FIG. 4A , but wherein the waveguiding region is formed as a thin layer adjacent the upper surface of a glass substrate;
- FIG. 21 plots the collected power (nanowatts) vs. the applied force (Newtons) for center and edge touch locations for the example touch system of FIG. 20 ;
- FIGS. 22 and 23 are top-down schematic views of example configurations for touch system 10 wherein channel waveguide regions are formed on a glass sheet;
- FIG. 24 is a plot of detector signal amplitude versus time for two different touch event locations, illustrating how there is a measurable time lag between the detector signals for the different touch locations, thereby providing a means for determining the touch event location;
- FIG. 25A is an elevated view of an example pressure-sensing display system that shows the touch system disclosed herein interfaced with a display unit;
- FIG. 25B is a cross-sectional view of the pressure-sensing display system of FIG. 16A ;
- FIG. 26A is a cross-sectional view of the detector end of an example touch system that includes a sloped attenuator disposed adjacent the detector;
- FIG. 26B is an example plot of the normalized transmission T vs. attenuation filter height, showing an example filter attenuation profile
- FIGS. 27A through 27D are plots of the detector signal versus frame number (#) for four different detector configurations used to detect fringes in the output signal to determine the amount of pressure being applied at the touch location;
- FIGS. 28A through 28C provide supplemental information to the polarization-based embodiments described herein.
- Cartesian coordinates are shown in certain of the Figures for the sake of reference and are not intended as limiting with respect to direction or orientation.
- the sub-group of A-E, B-F, and C-E are specifically contemplated and should be considered disclosed from disclosure of A, B, and/or C; D, E, and/or F; and the example combination A-D.
- This concept applies to all aspects of this disclosure including, but not limited to any components of the compositions and steps in methods of making and using the disclosed compositions.
- additional steps that can be performed it is understood that each of these additional steps can be performed with any specific embodiment or combination of embodiments of the disclosed methods, and that each such combination is specifically contemplated and should be considered disclosed.
- FIG. 1A is a schematic diagram of an example pressure-sensing touch system (“touch system”) 10 according to the disclosure.
- the touch system 10 may be used in a variety of consumer electronic articles, for example, in conjunction with displays for cell-phones, keyboards, touch screens and other electronic devices such as those capable of wireless communication, music players, notebook computers, mobile devices, game controllers, computer “mice,” electronic book readers and the like.
- the example touch system 10 of FIG. 1A includes a generally planar light-guiding assembly (“assembly”) 20 , the details of which are described below.
- Assembly 20 includes a waveguide 22 , with at least one light source 100 and at least one detector 200 are disposed adjacent a perimeter P of the waveguide. The at least one light source 100 and the at least one detector 200 and are optically coupled through the waveguide as explained in greater detail below.
- Perimeter P includes an edge (end) 23 adjacent light source 100 and an edge (end) 24 adjacent detector 200 .
- Perimeter P can have any reasonable shape and is shown as being rectangular by way of example.
- Assembly 20 can be generally rectangular and in the example shown waveguide 22 has a dimension (length) LX in the X-direction and a length LY in the Y-direction.
- FIG. 1B illustrates an example embodiment of system 10 wherein multiple light-sources 100 are used (or equivalently, a light source with multiple light-source elements can be used), and multiple detectors 200 are used (or equivalently, a detector with multiple detector elements.
- This configuration of system 10 is especially useful when the location of one or more touch events TE needs to be determined.
- one or more light sources 100 and one or more detectors 200 can be operably disposed in the assembly to ensure that the entire (or substantially the entire) assembly can be used to sense the pressure of a touch event. This may include, for example, cycling the activation of sets (e.g., pairs) of light sources 100 and/or detectors 200 to ensure that all possible locations for touch events are covered. In an example, the cycling can be done at a rate that is much faster than the typical duration of a touch event that applies pressure to elicit a response from touch system 10 .
- Example detectors 200 include photodiodes and the various types of photosensors.
- Example light sources 100 include LEDs, laser diodes, optical-fiber-based lasers, extended light sources, and the like.
- light source 100 can comprise one or more light-source elements 102 that are operably mounted on flex-circuit boards (“flex circuits”) 110 , which in turn are mounted to printed circuit boards (PCB) 112 arranged adjacent an edge 26 of transparent sheet 20 .
- flex circuits flex-circuit boards
- PCB printed circuit boards
- light source 100 can thus mean a light source having one or more light-source elements 102 .
- detector 200 can include a detector that has one more detector elements 202 .
- Output light 104 AB is shown incident upon one of detector elements 202 .
- detector 200 can be a pixelated detector where detector elements 202 constitute detector pixels.
- An example pixelated detector 200 is a CMOS or CCD array detector.
- an amount of pressure (e.g., a relative amount of pressure) is applied to planar waveguide at touch location TL associated with a touch event TE.
- aspects of the disclosure are directed to sensing the occurrence of a touch event TE, while other aspects include the additional function of determining the touch location TL of the touch event.
- Other aspects of the disclosure include sensing an amount of pressure applied at the touch event TE.
- touch system 10 includes an optional cover 40 that serves to cover light source 100 and 200 so that they cannot be seen from above assembly 20 by a viewer (see, e.g., viewer 500 , FIG. 15B ).
- cover 40 serves the role of a bezel.
- cover 40 can be any type of light-blocking member, film, paint, glass, component, material, texture, structure, etc. that serves to block at least visible light and that is configured to keep some portion of touch system 10 from being viewed by a user, or that blocks one wavelength of light while transmitting another.
- FIG. 3 only light sources 100 , detectors 200 and waveguide 22 are shown for ease of illustration.
- cover 40 can reside anywhere relative to assembly 20 that serves to block a viewer from seeing light source 100 or detector 200 .
- Cover 40 need not be contiguous and can be made of sections or segments.
- cover 40 can be used to shield detector 200 from receiving light other than light 104 from light source 100 , such as for sunlight rejection.
- cover can be substantially opaque at one wavelength (e.g., a visible wavelength) and substantially transparent at another wavelength (e.g., an infrared wavelength for light 104 from light source 100 ).
- cover 40 is in the form of a film that is opaque at least at visible wavelengths and that optionally transmits at IR wavelengths.
- An example film for cover 40 comprises a black paint that absorbs light over a wide range of wavelengths including the visible and IR wavelengths.
- touch system 10 may include a controller 300 that is operably connected (e.g., via a bus 301 ) to the one or more light sources 100 and the one or more detectors 200 .
- Controller 300 is configured to control the operation of touch system 10 .
- the controller 300 includes a processor 302 , a device driver 304 and interface circuit 306 , all operably arranged. Controller controls light source 100 via a light-source signal SL and also receives and processes a detector signal SD from detector 200 .
- light source 100 is wavelength modulated via processor 302 of controller 300 via light source control signal SL.
- This causes a change in output light beam 104 -O by changing the optical paths OPn of light beam 104 in a select manner.
- This select change manifests itself in detector signal SD, which is processed (filtered) by controller 300 to bring out the laser modulation frequency. This can be accomplished, for example, by a lock-in amplifier.
- controller 300 comprises a microcontroller or a computer that executes instructions stored in firmware and/or software (not shown). Controller 300 is programmable to perform functions described herein, including the operation of the touch system and any signal processing that is required to measure, for example, relative amounts of pressure, as well as the location of a touch event, or multiple touch events and multiple pressures.
- the term computer is not limited to just those integrated circuits referred to in the art as computers, but broadly refers to computers, processors, microcontrollers, microcomputers, programmable logic controllers, application-specific integrated circuits, and other programmable circuits, and these terms are used interchangeably herein.
- Software may implement or aid in performing the pressure-sensing functions and operations disclosed herein.
- the software may be operably installed in controller 300 or processor 302 .
- Software functionalities may involve programming, including executable code, and such functionalities may be used to implement the methods disclosed herein.
- Such software code is executable by the general-purpose computer or by the processor unit described below.
- the code and possibly the associated data records are stored within a general-purpose computer platform, within the processor unit, or in local memory.
- the software may be stored at other locations and/or transported for loading into the appropriate general-purpose computer systems.
- the embodiments discussed herein involve one or more software products in the form of one or more modules of code carried by at least one machine-readable medium. Execution of such code by a processor of the computer system or by the processor unit enables the platform to implement the catalog and/or software downloading functions, in essentially the manner performed in the embodiments discussed and illustrated herein.
- the computer and/or processor as discussed below may each employ a computer-readable medium or machine-readable medium, which refers to any medium that participates in providing instructions to a processor for execution, including for example, determining an amount of pressure associated with a touch event, as explained below.
- Any memory discussed below constitutes a computer-readable medium.
- Such a medium may take many forms, including but not limited to, non-volatile media, volatile media, and transmission media.
- Non-volatile media include, for example, optical or magnetic disks, such as any of the storage devices in any computer(s) operating as one of the server platforms, discussed above.
- Volatile media include dynamic memory, such as main memory of such a computer platform.
- Physical transmission media include coaxial cables; copper wire and fiber optics, including the wires that comprise a bus within a computer system.
- Common forms of computer-readable media therefore include, for example: a floppy disk, a flexible disk, hard disk, magnetic tape, any other magnetic medium, a CD-ROM, DVD, any other optical medium, less commonly used media such as punch cards, paper tape, any other physical medium with patterns of holes, a RAM, a PROM, and EPROM, a FLASH-EPROM, any other memory chip or cartridge, a carrier wave transporting data or instructions, cables or links transporting such a carrier wave, or any other medium from which a computer can read programming code and/or data. Many of these forms of computer readable media may be involved in carrying one or more sequences of one or more instructions to a processor for execution.
- FIG. 3 is a cross-sectional view of example system 10 .
- System 10 has a waveguide 22 that in an example is in the form of a thin, transparent sheet.
- Waveguide 22 has an input edge 23 and an output edge 24 .
- Light source 100 is arranged adjacent input edge 23 while detector is arranged adjacent output edge 24 .
- Waveguide 22 has a body 25 that is substantially transparent to the wavelength ⁇ of light 104 (“the operating wavelength”) emitted by light source 100 .
- Waveguides 22 has an upper surface 26 and a lower surface 27 separated by a thickness TH.
- Waveguide 22 has a central plane PC that is parallel to upper and lower surfaces and midway therebetween.
- Light source 100 and detector 200 lie along a central axis AC that lights in central plane PC.
- materials other than glass can be used for waveguide 22 , such as polymers, plastics and other non-glass materials that are substantially transparent at the operating wavelength ⁇ .
- System 10 includes an input optical system 123 operably arranged between light source 100 and input edge 23 .
- Input optical system 123 is configured to receive (coherent) light 104 and direct it into waveguide 22 .
- System 10 also includes an output optical system 124 operably arranged between light source 100 and output edge 24 .
- Output optical system 124 is configured to receive output light 104 -O and either direct it or allow it to pass to detector 200 .
- output optical system 124 includes a diaphragm (stop) as shown.
- Output optical system 124 can also include other light-directing or light-conditioning elements or components, such as lens elements, mirrors, etc.
- the combination of light source 100 and input optical system 123 defines a light source system 103 while the combination of detector 200 and output optical system 124 defines a detector system 204 .
- Light source system 103 , detector system 204 and waveguide 22 constitute a touch-screen assembly 20 .
- FIG. 3 illustrates an example embodiment where detector system 204 is aperture limited so that detector 200 only detects a limited portion of light 104 -O that exits output edge 24 (i.e., output light 104 -O). This allows detector 200 to detect a local change in the variation of intensity in output light 104 -O, as opposed to collecting essentially all of the light and obtaining an integrated measurement that will not substantially change. This is because the perturbation of waveguide 22 generally results on a redistribution of light within the waveguide.
- the size of the aperture 124 needs to be smaller than the thickness TH of the waveguide 20 . This can be achieved by either using an aperture 124 in conjunction with a detector larger than the waveguide thickness, or by using only a detector having a size smaller than the waveguide thickness.
- Aperture 124 can be circular, but can be rectangular to optimize the power collection efficiency.
- detector 200 is pixelated so that a measurement of a large portion of output light 104 -O includes being able to sense the distribution of light in the interference pattern (i.e., the light and dark fringes) so that changes in the pattern can be detected when touch events TE occur.
- the interference pattern i.e., the light and dark fringes
- one or more portions of output edge 24 are imaged onto detector 200 , which includes the case of placing detectors 200 at different locations right up against the output edge.
- Detector 200 can also have a photosensing surface that has a dimension smaller than the waveguide thickness TH
- System 10 is configured so that light beam 104 travels through waveguide 22 from input edge 23 to output edge 24 over multiple optical paths OPn associated with light rays 104 - n , where n is an integer and equal to or greater than 2.
- two of optical paths OPn are represented by two light rays 104 - 1 and 104 - 2 of light rays 104 - n by way of illustration.
- the number n of different optical paths correspond to the number n of light rays that undergo a different number of total-internal reflections (“bounces”) when traveling between input and output edges 23 and 24 .
- Light rays 104 - n are used to represent the different TIR guided modes for ease of illustration, and the terms “light rays” and “guided modes” can be used interchangeably.
- output optical system 124 is configured to receive n light rays 104 - n that exit output edge 24 and combine the light rays (guided modes) so that they interfere, thereby forming an output light beam 104 -O.
- the output light beam 104 -O is directed to detector 200 , which detects the output light beam.
- the total electrical field E can be represented by:
- E n and ⁇ n are the electrical field distribution and propagation constant of mode n respectively.
- the light intensity is given by:
- ⁇ is the propagation constant difference between modes n and m.
- Eq. (2) shows that interference will arise at output edge 24 of waveguide 22 .
- the phase difference is very sensitive to external perturbations to waveguide 22 , such as bending, pressure etc. This effect can be used in system 10 to enable force-sensitive or pressure-sensitive touch applications.
- At least one of light rays 104 - n represent the lowest-order mode of waveguide 22 , while the other light rays represent higher-order modes.
- the lowest-order mode of waveguide 22 travels directly along central axis A 1 without undergoing any bounces.
- input and output optical systems 123 and 124 can also be referred to as mode conditioners, since they are respectively used to excite guided moves and detect interfered guided modes.
- the configuration of touch-screen assembly (“assembly”) 20 defines an interferometer wherein light rays 104 - n travel over the aforementioned different optical paths OPn and interfere. The optical paths OPn overlap within body 25 of waveguide 22 .
- Waveguide 22 may generally be made of any suitably transparent material that can be formed into a thin planar sheet, such as plastic, acrylic, glass, etc., and that supports the transmission of light beam 104 - n without substantial loss due to scattering or absorption.
- waveguide thickness TH such that the waveguide can flex without breaking when pressure is locally applied at upper surface 22 at touch location TL.
- An exemplary range for thickness TH is from 0.3 mm to 1.5 mm. Other thickness can be employed consistent with the particular application for touch system 10 .
- top waveguide 22 A has a thickness that allows it to flex
- bottom waveguide 22 B is sufficiently thick or is otherwise rigid that it retains its generally planer configuration even when the top waveguide is subject to a flexing force due to a touch event TE.
- waveguide 20 may be formed from a chemically strengthened glass, such as a soda-lime-type glass.
- a chemically strengthened glass such as a soda-lime-type glass.
- An example glass s an alkali aluminosilicate glass hardened through ion exchange. These types of glass can comprise Na 2 O (soda), CaO (lime) and SiO 2 (silica), but can also include oxides such as MgO, Li 2 O, K 2 O, ZnO, and ZrO 2 . Once hardened through ion exchange, these types of glass exhibit certain characteristics that make them desirable for touch screen applications, as well as other applications (e.g., as a cover glass).
- soda-lime-type glass suitable for use as waveguiding sheets may be found in one or more of U.S. patent application Ser. No. 11/888,213 filed Jul. 31, 2007; U.S. patent application Ser. No. 12/537,393 filed Aug. 7, 2009; U.S. patent application Ser. No. 12/545,475 filed Aug. 21, 2009; and U.S. patent application Ser. No. 12/392,577 filed Feb. 25, 2009.
- An exemplary glass for use herein is Gorilla® glass, from Corning, Incorporated, Corning, N.Y.
- an exemplary glass, such as low-iron Gorilla® glass or other low-iron ion-exchanged glass is transparent to an infrared operating wavelength ⁇ .
- FIG. 4A is an example embodiment of assembly 20 based on that of FIG. 3A but wherein light-source system 103 includes a single-mode optical fiber as input optical system 123 , and where detector system 204 includes either a single-mode or multimode optical fiber as output optical system 124 .
- the single or multimode optical fiber 124 serves as an aperture-limited optical system that allows for a localized measurement of output light 104 -O to be made.
- multiple optical fibers 124 can be used to compare intensities at different locations at output edge 24 . This includes, for example, utilizing an optical fiber bundle.
- FIG. 4B is another example embodiment of assembly 20 based on that of FIG. 3A , but wherein light-source system 103 includes a grating as input optical system 123 , and where detector system 204 includes a grating as output optical system 124 .
- an aperture can be used adjacent detector 200 to make the detection process aperture limited and thus directed to a local intensity measurement.
- FIG. 4C is another example embodiment of assembly 20 similar to that of FIG. 4B but wherein light-source system 103 includes a prism arranged on lower surface 27 as a component of input optical system 123 , and where detector system 204 includes a prism also arranged on lower surface 27 as a component of output optical system 124 .
- an aperture can be used adjacent detector 200 to make the detection process aperture limited and thus directed to a local intensity measurement.
- FIG. 4D is another example embodiment of assembly 20 similar to that of FIG. 4C but wherein input and output edges 23 and 24 are angled to define TIR surfaces that serve to internally reflect light 104 .
- Light 104 from light source 100 enters waveguide 22 at lower surface 27 over a range of angles, and is internally reflected at angled edge 23 . The internal reflection directs light 104 to be guided over optical paths OPn.
- light 104 traveling as light rays 104 - n reflects from angled edge 24 and is directed to exit waveguide 22 at lower surface 27 , where the output light 104 -O is detected at detector 200 .
- Angled edge 23 thus defines a component of input optical system 123 and angled edge 24 defines a component of output optical system 124 .
- an aperture can be used adjacent detector 200 to make the detection process aperture limited and thus directed to a local intensity measurement.
- FIG. 5A is a photograph of a near-field interference pattern from output light 104 -O at output edge 24 of waveguide 22 when there is no touch event TE occurring.
- FIG. 5B is a photograph of the near-field interference pattern from output light 104 -O for the system 10 associated with FIG. 5A , but with a touch event TE applied with a moderate amount of pressure. It can be seen that the light distribution of the near-field interference pattern has changed from the no-touch-event condition of FIG. 5A .
- FIG. 5C is a photograph of the near-field interference pattern from output light 104 -O for the system 10 associated with FIGS. 5A and 5B , but with a touch event TE applied with a strong pressure. It can be seen that the light distribution of the near-field interference pattern has changed from the moderate-pressure touch-event condition of FIG. 5B .
- the change in the light distribution in output light 104 -O arises because pressure from the touch event TE causes waveguide 22 to bend, which causes a change in the relative optical path differences for the light rays 104 - n . Said differently the waveguide bending affects each optical path OPn differently, so that changes in the existing optical path differences arise and give rise to a changed set of optical paths OP′n.
- the output light 104 -O thus defines a multimode interference pattern, and this pattern changes when the differences between the optical paths OPn changes.
- FIG. 6A is a cross-sectional view of waveguide 22 with light 104 traveling over a first optical path OP 1 that the lowest-order mode, i.e., travels straight through the waveguide along central axis AC.
- first optical path OP 1 and central axis AC are the same in this case.
- FIG. 6B is the same waveguide 22 as in FIG. 6A but where upper surface 26 is subject to a touch event TE at a touch event location TL in the middle and that bends the waveguide. It is assumed that waveguide 22 has a length L when no touch event TE is occurring. When a touch event TE occurs at touch location TL, waveguide 22 bends with a radius of curvature R measured relative to central axis AC.
- the new optical path OP 1 ′ associated with the flexed waveguide of FIG. 6B is longer than the optical path OP 1 of the unflexed top waveguide of FIG. 6A .
- the optical path difference between the optical paths OP 1 and OP 1 ′ due to bending of waveguide 22 due to a touch event is about ⁇ r. If ⁇ r is for example about 2.5 microns, that would be roughly equal to two wavelengths of infrared light of wavelength of 800 microns or so.
- This amount of optical path difference would manifest itself as a change in the output light 104 -O, e.g., a change in the amount of optical power at a given point at output edge 24 due to shifting fringes in the detected portion of the resulting interference pattern. This is what is shown in FIGS. 5A through 5C .
- the changes in the optical paths other than the lowest-order optical path change in a similar manner.
- Modal decomposition and the attendant multimode interference is one way to describe the way that light 104 gets re-distributed in waveguide 20 .
- output light 104 -O can be thought of as having changing pattern due to changing interference effects.
- another way to represent the redistribution of light 104 is to use a geometrical model based on ray tracing. Indeed, with a waveguide thickness TH in the order of 1 mm, diffraction effects can be neglected.
- different components (rays) of output light 104 -O are re-directed by the deflection of waveguide 20 , and the re-direction changes the character of the output light, e.g., the intensity pattern, the location of the intensity centroid, the division of a generally single output beam into multiple output beams, etc.
- substantially collimated light 104 When injecting substantially collimated light 104 into a planar waveguide 20 such as a transparent glass sheet (see, e.g., FIG. 6C ), the light travels therethrough without being reflected.
- the resulting energy distribution as defined by output light 104 -O at the output edge 24 of waveguide 20 has a substantially homogeneous distribution.
- some bending is introduced (see FIG. 6D )
- a portion of light 104 is reflected off of the upper and lower surfaces 26 and 27 . This modifies the energy distribution of output light 104 -O.
- FIG. 6F shows example images output light 104 -O as determined using a ray tracing model for different amounts of waveguide bending.
- the energy distribution starts out substantially homogeneous for waveguide 20 without any bending (top left image).
- the energy distribution then becomes assymetric and ends up substantially homogeneous again when the amount of bending is close to half of the waveguide thickness.
- an aperture 124 at the output, one can expect obtain a quasi-sinusoidal detector signal SD as a function of the waveguide bending amplitude.
- FIG. 6F does not include any interference effects since all the rays that propagate are added in intensity.
- FIG. 14 shows images akin to those of FIG. 6F but that are the result of the same model, except that rays are added in electric field. As can be seen, higher-frequency fringes appear due to interference effects between the two beams exiting output edge 24 of waveguide 20 at two different angles.
- System 10 can be operated in two different modes.
- the first mode the nearly collimated light 104 is injected at some angle with respect to waveguide 20 , resulting in creating the very high-frequency fringes, which are visible in FIGS. 6G and 5B .
- the detection process becomes insensitive to the fringes and is only sensitive to the motion of the envelope predicted by FIG. 6F .
- the second mode light 104 is injected nearly parallel to waveguide 20 and aperture 214 is significantly smaller than the fringe period. In this case, the detection process is sensitive to the motion of the fringes, which can improve the detection sensitivity
- FIGS. 6C and 6D are close-up views of the input edge portion of waveguide 22 of FIG. 6B .
- FIG. 6C shows parallel (collimated) input light 104 traveling in the lowest-order mode straight down the waveguide without any bounces when there is no flexing of the waveguide.
- FIG. 6D shows a flexed (bent) waveguide where the inputted collimated light 104 ends up bouncing off of the upper and lower surfaces. This means that the optical path of light 104 in the bent waveguide is even longer than if it traveled straight down the curved central axis AC. So the bending or flexing of waveguide 22 can turn collimated (lowest-order-mode) light into higher-order-mode light. This results in a greater amount of optical path change, which translates into a greater amount of change in the distribution of output light 104 -O at output edge 24 .
- FIG. 6E is a close-up, cross-sectional view of the output edge portion of waveguide 22 , showing light rays 104 - n based on the results of ray tracing modeling when the waveguide is flexed, as shown in FIG. 6C .
- Light rays 104 - n are inhomogeneously distributed due to the flexed waveguide 22 .
- FIG. 6F show the intensity distribution of output light 104 -O at output edge 24 , and illustrates the change in the intensity distribution as the amount of flexing (bending) increases.
- FIG. 6G shows a sequence of images of output light 104 -O at output edge 24 of waveguide 22 .
- the thickness TH is indicated in each of the images.
- the approximate locations of the upper and lower surfaces are indicated by white dotted lines.
- the light distribution in output light 104 -O light starts moving to the right, reaches a point where most of the light is concentrated at the edge of the sheet and then comes back to the center. If we keep bending, light keeps moving right-left and left-right a periodic way. The bending that is needed to make the light moving from being centered on the sheet to be centered again is nearly equal to half the thickness of the sheet which is in good agreement with the model.
- FIG. 7A is a schematic cross-sectional diagram of waveguide 22 with a finger 50 poised to create a touch event TE a central touch location.
- FIG. 7B shows the touch event caused by finger 50 exerting downward pressure on waveguide 22 on upper surface 26 , thereby causing waveguide 22 to flex.
- FIG. 7C is similar to FIG. 7B , except that the touch event TE occurs at a touch location TL that is closer to output edge 24 , i.e., the touch location is off-center of waveguide 22 .
- aspects of the disclosure include determining the time evolution of the touch event TE. This can be used for example to determine a relative amount of pressure that is applied to upper surface 26 of waveguide 22 by, for example, a finger, a stylus, the eraser-end of a pencil, or like implement. It is noted here that the pressure applied to assembly 30 at top waveguide 22 A may be through another surface that resides upper surface 26 A, such as a coating layer.
- the time evolution of the processed detector signal SD is used to characterize the time evolution of touch event TE.
- an object e.g., finger 50 , stylus, etc.
- a small amount of flexing of the transparent sheet occurs as an object (e.g., finger 50 , stylus, etc.) initially contacts surface 26 of waveguide 22 .
- the amount of flexing of the top waveguide changes, so that optical path lengths OPn continuously changes.
- the changing optical paths show up as a continuous change in the output light 104 -O and thus the processed detector signal SD.
- the continuous change in the optical paths changes the angular and spatial distribution at the output light 104 -O. This includes interference patterns due to changes in optical paths and the polarization state of light 104 due to the light passing difference regions of fabrication-induced and stress induced birefringence.
- the processed detector signal SD stops changing. At this point, the amount of time that the processed detector signal SD remains constant can be measured.
- This information can be used, for example, to carry out a function by requiring the touch event TE to have associated therewith not only a certain amount of pressure but a select duration as well. Further in the example embodiment, it can be required that the touch event have a select time evolution in pressure that is consistent with say a finger or stylus used to intentionally cause a touch event, as opposed to say an arbitrary object pressing down on upper surface 26 of waveguide 22 and inadvertently triggering a touch event.
- FIG. 8 is a plot of the measured optical power P M in microwatts ( ⁇ W) versus the applied touching force F T in Newtons (N) for an example system 10 having multiple light sources 100 and multiple detectors 200 .
- the plot includes data from a touch event TE that has a touch location at the center of waveguide 22 , as indicated by squares in the plot and as shown in FIG. 7B .
- the plot also includes data from a touch event near the edge as indicated by diamonds in the plot and as shown in FIG. 7C .
- the plot indicates that a touch event TE near the edge of waveguide 22 do not give rise to as large a change in the measured power at detector 200 as does a touch event near the center.
- This data can be used to establish the general location of a touch event, i.e., whether it is closer to the center than to the edge of the waveguide.
- Light source 100 was in the form of a laser having an operating wavelength of 6328 nm.
- Laser 100 was pigtailed to a single-mode fiber 123 .
- a collimating lens was used launched into a 4′′ ⁇ 4′′ Gorilla® glass substrate as waveguide 22 .
- a multimode fiber 124 was butt-coupled to the glass substrate at output edge 24 to collect a portion of output light 104 -O and relay it to detector 200 .
- FIGS. 5A through 5C shows the near field image of bright and dark interference pattern taken at the edge of the glass by a detector 200 in the form of a CCD camera. Significant pattern changes can be seen, with the center interference intensity maximum shifted from the being near the upper surface 26 to being near the lower surface 37 .
- the change in detected power can be used to indicate the magnitude of the applied force associated with the touch event.
- system 10 detects output light in the “near field,” i.e., close to output edge 24
- the system detects the output light in the “far field,” i.e., away from output edge 24
- Near-field detection can be accomplished by placing a small aperture 214 (i.e., smaller than the thickness TH of waveguide 22 ) in front of detector 200 .
- ray-trace modeling of system 10 indicates that the detected signal SD is a periodic function as the waveguide is flexed, with the period being close to the thickness TH of waveguide 22 .
- Far-field detection can be accomplished by injecting substantially collimated light 104 into input edge 23 of waveguide 22 and observing in the far field the output light 104 -O, which is expected to be concentrated about two directions.
- the two directions correspond to light 104 undergoing an even number and an odd number of reflections, respectively.
- Changing the amount of bending in waveguide 22 changes the distribution of optical power in the two directions.
- the two directions translate into two locations, depending on the distance at which output light 104 -O is detected.
- FIG. 9A is a simulation of output light 104 -O as measured in the far-field for a flexed waveguide, showing the two directions (positions) of the output light.
- FIG. 9B shows the measurement results for an actual flexed waveguide 22 , with the far-field distribution of intensity of output light 104 -O closely resembling the modeled results of FIG. 9A .
- FIG. 9C is a plot of the % of Power P vs. glass deformation D (mm) for the two light directions as determined by first and second photodetectors (curves A and B in the plot) arranged at the locations of the light spots. As can be seem from the plot, the amount of power in the spots is periodic, with the two periods being out of phase by 180 degrees.
- FIG. 10 is plot of voltage V versus time in one of the two far-field light spots when applying an instantaneous force of 1 Newton to an example waveguide 22 made of glass having a thickness TH of 1.2 mm.
- the voltage represents the detected optical power.
- the plot indicates a steep transition, which means that the detection of the touch event can be based on the transfer of optical power between the different directions of the far-field output light 104 -O.
- System 10 can also be configured for detecting output light 104 -O at one or both of upper and lower surfaces 26 and 27 . Since bending waveguide 22 changes the way light 104 bounces from the upper and lower surfaces 26 and 27 , this change can be used to measure waveguide bending if the light can be accessed and detected.
- FIGS. 11A and 11B depict ray trace simulations based on injecting light 104 into a waveguide 22 having a thickness TH of 1.2 mm.
- the light 104 is injected at an angle of 10 degrees so that the light bounces off of upper and lower surfaces 26 and 27 .
- FIG. 11A shows no waveguide bending while FIG. 11B shows a bending of 0.3 mm.
- Detector 200 is shown disposed adjacent upper surface 26 of waveguide 22 .
- the detector signal SD changes as the degree of bending of waveguide 22 changes since the location of the light bounces (and in some cases, the number of bounces) changes. According to the model, the detector signal SD is periodic with a period equal to half the waveguide thickness TH.
- FIGS. 12A through 12C show ray-trace simulations of light 104 traveling in a waveguide 22 having a thickness TH of 1.2 mm and having an axial length of 240 mm.
- Input edge 23 was illuminated with homogeneous illumination having divergence (full) angles of 0 degrees ( FIG. 12A ), 0.3 degrees ( FIG. 12B ) and 0.6 degrees ( FIG. 12C ).
- FIG. 12A the entire waveguide is filled with light 104 so that the signal modulation induced by waveguide bending disappears.
- the maximum beam divergence 6 when the input beam 104 overfills waveguide thickness TH is approximately given by ⁇ 2 ⁇ TH/L, where L is the propagation length.
- the expectation is that the signal will be periodic (independent of the detection scheme). So, as long the system is operated close to the zero of the periodic function, the signal will be substantially linear. However, the phase of the response function depends on many parameters such as the glass length, the glass thickness, the angle of injection, and the like. In an example embodiment, active alignment can be used to ensure that system 10 operates close to the zero of the periodic function.
- FIG. 13 illustrates an example embodiment of system 10 that employs two detectors 200 ( 200 U, 200 L) disposed adjacent upper and lower surfaces 26 and 27 .
- Detectors 200 U and 200 L are arranged so that they detect signals SD that are out of phase by a quarter of period. In that case, we end up with a cosine and a sine function which allows one to back calculate the pressure.
- the distance Dx denotes the period of the bouncing, by locating two detectors shifted by Dx/4+n Dx (n integer), the expectation is that the signal modulation versus the applied force will be out of phase by one quarter of the signal period.
- two or more detectors 200 can be employed on one or both of upper and lower surfaces 26 and 27 .
- three detectors 200 are used. Two of the three detectors 200 can be disposed on upper and lower surfaces 26 and 27 adjacent output edge 26 while the third can be arranged at or near the middle of waveguide 22 on either the upper or lower surface. Simulations indicate that such a configuration allows for the detection of three periodic detector signals SD that are out of phase, and with the relative phases changing as a function of the amount of bending in waveguide 22 .
- light rays 104 - n are launched into waveguide 22 and the output irradiance profile is measured based on output light 104 -O, which can be outputted from one or more of output end 24 and upper and lower surfaces 26 and 27 .
- output light 104 -O can be outputted from one or more of output end 24 and upper and lower surfaces 26 and 27 .
- interference effects are not fully taken into account.
- collimated beams 104 are propagating at two different angles, they can interfere and create high-frequency fringes. These fringes are visible when using a high magnification to image the output beam on a CCD camera.
- output light 104 -O can define fringes having relatively high frequencies.
- the aperture 214 use to filter the output light 104 -O is generally much larger than the fringe period. In this case, the detection is only sensitive to the motion of the envelope of the output light beam.
- the input light beam 104 can be aligned precisely with central axis AC of waveguide 22 , low frequency fringes will arise, and the pinhole will filter the fringes. So, on top of detecting the motion of the beam envelope, the system will also start detecting the lower-frequency fringes.
- FIG. 14 shows a series of simulated images of output light beams 104 -O obtained by summing electric fields of the light rather than the intensity.
- FIG. 15 illustrates an example embodiment of system 10 that includes at least one of upper and a lower cladding layers 26 C and 27 C, respectively.
- Cladding layers 26 C and 27 C have a refractive index slightly lower than the index of waveguide 22 , thereby serving to enhance the waveguiding properties of the waveguide. This allows for an adhesive layer (e.g., epoxy bond) to be applied to one or both of the cladding layers, or to add an anti-glare layer or other such performance-enhancing layer or layers on the upper or lower sides of waveguide 22 without disturbing the propagation of light 104 therein.
- an adhesive layer e.g., epoxy bond
- the touch system 10 can be improved by the additional use of polarization optics configured to a detect polarization effects, such as a change in the polarization state of output beam 104 -O. This is made possible by changes in the birefringence in waveguide body 25 and thus along the optical path of light 104 as it traverses the waveguide.
- Birefringence is the optical property of a material wherein the material refractive index depends on the polarization and propagation direction of light. Birefringence is also known as photoelasticity. Certain birefringent optical materials such as glass are optically anisotropic due to mechanical stress, while many crystals are birefringent due to their crystal structure. In the case of single-axis mechanical stress, the value of birefringence is the difference of the refractive index for light oscillating in the parallel direction of the stress and that oscillating in the perpendicular direction.
- the difference in the optical path between light oscillating in two orthogonal directions is known as the retardation (Ret) of the beam. If a beam is linearly polarized and aligned so that the oscillation is in the direction of the stress, or perpendicular to the stress, then no retardation is detected since only one index is observed.
- the amount of retardation is proportional to the mechanical stress and the stress optical coefficients (K).
- K stress optical coefficient
- the amount of retardation Ret can be calculated by the relation:
- Ret is the retardance in waves
- n is the refractive index relative to the stress direction
- d is the optical path length
- ⁇ is wavelength
- a is the mechanical stress (which is positive for tensile stress and negative for compressive stress)
- K is the optical stress coefficient.
- the units of a is N/mm 2 , or MPa (mega-Pascals).
- the units of K are mm 2 /N.
- the common glass type BK7 has a K of ⁇ 2.8 ⁇ 10 ⁇ 6 , and the table below is an example of the calculation of retardance due to stress birefringence over path lengths (distance) and pressures for a near infrared (IR) wavelength.
- FIG. 16 A simple implementation of polarization detection is shown in FIG. 16 .
- Finger 50 is shown giving rise to a touch event that create pressure 550 in waveguide body 25 at and around touch location TL.
- a first polarizer 501 is disposed between light source 100 and input edge 24 .
- Polarizer 501 is configured to linearly polarize light 104 in a direction 45° to the prominent direction of pressure 550 , which is perpendicular to upper surface 22 of waveguide 20 .
- light 104 is substantially collimated to travel parallel to central axis AC.
- System 10 also includes a second polarizer 511 (also called an “analyzer”) disposed between output edge 24 and detector 200 , e.g., immediately adjacent detector 200 .
- Detector 200 can be considered in some embodiments to consist of two detectors, denoted 200 -A and 200 -B.
- second polarizer 511 is arranged in the same 45° at the first polarizer 501 so that in the absence of any polarization rotation of light 104 , the detector signal is maximum.
- second polarizer 511 can have any polarization orientation.
- second (detector) polarizer 511 is oriented at +45° to the y-axis and is parallel to the first (source) polarizer 501 , then the detector signal SD as normalized to the maximum signal prior the application of pressure 550 will be equal to 1.
- the aforementioned second detector 200 -B is employed and includes its own detector polarizer 512 that is orientated at ⁇ 45° to the y-axis and 90° to polarizer 511 , then the detector signal SD B from detector 200 B will be zero while no pressure 550 is being applied. This assumes that under no additional pressure from the mounting of the glass, and that the glass is birefringent free in fabrication, which will be discussed later.
- FIG. 17 plots the detector signals SD A and SD B of detectors 200 -A (“det A) and 200 -B (“det B”) versus the induced stress retardance along the optical path due to compression by the pressure 550 .
- the linearly polarized light 104 that enters input edge 23 becomes more elliptically polarized as the retardance along the optical path OP increases from zero, and becomes circular when the retardance reaches a quarter of a wave.
- the transmission of the two orthogonal polarizers 511 and 512 is the same.
- An advantage of having two detectors 200 -A and 200 -B that detect orthogonal polarizations is that the summation and difference of the two detector signals SD A and SD B can be employed.
- One detector can determine the magnitude of the retardance Ret from the pressure, but the summation of the two detector signals provides the total intensity of the incident light on the detectors. This allows the information of the retardance change and the steering of the beam off of or onto the detectors to isolate the position (touch location TL) and the amount of pressure 550 associated with touch event TE.
- the difference of the detector signals SD A and SD B is more sensitive to changes in retardance and also assists in the isolation of beam steering and retardance components of the detector signal.
- FIG. 18A-18E are images that show the measured results of energy profiles imaged through an analyzer (polarizer 511 ) as a glass waveguide 20 undergoes bending.
- the beam moves as the waveguide is bent.
- the shape and power are also changing, which indicates that the polarization of light 104 is changing due to the birefringence along the optical path OP.
- the first image 18 A is with no pressure 550 , with the subsequent images 18 B- 18 E taken with increasing pressure.
- the image strength (which corresponds to the detector signal SD) is greatly reduced at the amount of pressure applied in FIG. 18E , indicating that around a half-wave of retardance was introduced by the stress birefringence.
- system 10 optionally includes a quarter-wave waveplate 503 (shown in phantom) disposed between source polarizer 501 and input edge 23 of waveguide 20 . If waveplate 503 is arranged with its fast axis oriented at 45° to the source polarizer axis, then circular polarized light 104 will be injected into waveguide 20 . This allows for greater sensitivity to birefringence changes near zero retardance.
- the detector signals SD A and SD B associated with detectors 200 -A and 200 -B can be described by the plot of FIG. 17 if the horizontal axis is shifted by 0.25 ⁇ , so that zero retardance location is moved to where the detector signals SD A and SD B are equal.
- the difference of the two detector signals SD A and SD B is at the location of highest slope so that the ratio of the two detector signals provide even higher sensitivity.
- the slope of the ratio of the normalized detector signals for detectors 200 -A and 200 -B is 4n.
- the difference between the two linear orthogonal polarizations is defined by one of the four Stokes parameters for characterizing the state of polarization.
- An example touch system 10 includes four detectors with quarter-wave plates (not shown) placed just downstream of detector polarizers 511 and 512 , with their fast axes oriented 45° to the linear polarizers (“circular analyzers”). In this configuration, one of the detectors 200 detects right-handed circularly polarized light and the other detects left-handed circularly polarized light. The difference in the signals between the two detectors defines another one of the Stokes parameters.
- These different polarizers and quarter-wave plates can be placed in front of the four sections of a quad-cell detector 200 .
- Measuring two Stokes parameters provides not only information on the retardance of the beam 104 , but also the mean rotation of the stress vectors along the optical path as projected in the plane perpendicular to the optical path.
- the additional information provided by the two added detectors can be used in isolating touch locations TL and the amounts of pressure 550 applied at the touch locations during a touch event TE.
- An example embodiment of system 10 of FIG. 16 includes at least one support member 520 operably arranged and configured to support waveguide 20 .
- An embodiment of a support member 520 covers the entire lower surface 24 of waveguide 20 and is relatively inflexible.
- Support member 520 serves to constrain the motion of waveguide 20 so that pressure 550 produces compressive stress at the touch location TL where the pressure is applied, as well as in a surrounding portion of waveguide body 25 .
- Support member 520 can also be in the form of a frame or have another configuration other than that of a plenum, as long as the support member enhances the compressive stress produces by pressure 550 as compared to having no support member.
- FIG. 19A is a schematic cross-sectional view of system 10 , wherein two frame-line support members 520 are operably arranged on the upper and lower surfaces 26 and 27 of waveguide 20 near perimeter P (see FIG. 1 ).
- the pressure 550 from any touch event TE will predominantly bend waveguide 20 and will lead to compressive and tensile stress over the whole waveguide body 25 .
- the set of vectors 551 shown along optical path OP are representative of the direction of the stress and how it varies over waveguide body 25 due to pressure 550 .
- the retardance from the optical path differences is additive and so tensile and compressive regions will compensate each other.
- the compressive stress near the touch location TL will add as vectors to the broader compressive or tensile pressure of the bending of waveguide 20 .
- the relative weighting of the vector summation of the two sources of stress will depend on the constraints provide by the at least one support member 520 .
- the additive nature of the retardance experienced by light beam 104 as it travels over optical path OP produces a continuous change in retardance versus touch pressure.
- Glass under no mounting constraints or external pressure will typically have some amount of birefringence from the fabrication of the glass. Localized stress regions can be formed in the process of cooling down the glass into a solid state. Glass used in high-performance imaging systems often requires weeks of annealing to obtain the high degree of homogeneity of index that is needed and resultant the low stress birefringence, which is typically ⁇ 2 nm/cm. In the near IR, this amount of stress produces 1/100th of a wavelength per 50 mm of path length.
- stress regions 552 are formed on both the upper and lower sides of a glass plate 20 that is chemically harden by ion exchange. Instead of illustrating the stress distribution by vectors as in FIG. 19A , the darkness of the shading represents the magnitude of the stress, with the darker color indicating greater stress.
- FIGS. 19A and 19B The difference between FIGS. 19A and 19B is that pressure 550 bends the glass ( FIG. 19C ), and alters the path of light 104 through a region of higher fabrication-induced stress birefringence.
- the fabrication-induced stress of regions 552 add by the nature of vectors to the near region compressive stress and the bending stresses. The additive nature of the retardance of beam of light will produce a continuous change in retardance versus touch pressure.
- FIGS. 28A through 28C provide supplemental information for the polarization-based embodiments described herein.
- FIG. 20 is a schematic side view of an example touch system 10 wherein waveguide 20 is now in the form of a glass sheet that includes a relatively thin waveguide region 29 adjacent upper surface 22 .
- Waveguide region 29 serves as a relatively thin optical waveguide as compared to the entire bulk of body 25 serving as the waveguide as described in various example embodiment above.
- Waveguide region 29 can be formed using ion-exchange or a laminated fusion draw process or any other technique known in the art for forming thin waveguide structures on a substrate.
- light source 100 is optically coupled to waveguide region 29 via a section of optical fiber 123 that has one end butt-coupled to the waveguide input end at input edge 23 (hereinafter, waveguide input end 23 ).
- Detector 200 is optically coupled with or is otherwise in optical communication with waveguide region 29 at output edge 24 (hereinafter, waveguide output end 24 ).
- waveguide region 29 As guided light and it outputted from waveguide output end 24 at output light 104 -O. Since waveguide region 29 is much thinner than the bulk waveguide body 25 , the light-guiding is best described using electromagnetic theory rather than a geometric light ray approach that ignores diffraction and like effects.
- a pigtailed laser diode as used as light source 100 .
- Gorilla® glass was used for glass sheet 20 and an ion-exchange process was used to form waveguide region 29 . Since the refractive index of the waveguide region is higher than that of body 25 , light is guided within waveguide region 29 , which defines a thin slab waveguide.
- Waveguide region 29 had a thickness of about 50 ⁇ m, which is much thinner than glass sheet. Thus, waveguide region 29 supports multiple modes, though far fewer modes than when the entirety of the glass sheet is used as a waveguide.
- FIG. 22 is a top-down view of an alternate configuration for waveguide regions 29 as formed on glass sheet 20 .
- waveguide regions 29 can be configured as channel waveguides, as shown.
- the channel waveguide regions 29 can be configured sculptured within the glass or atop the glass.
- FIG. 23 also shows an alternative embodiment for channel waveguide regions 29 that shows two branching networks (fan-outs) associated with two pairs of light sources 100 and detectors 200 . It is noted the spacing of the channel waveguide regions 29 need not be uniform and can be concentrated in certain locations that are generally associated with where touch events TE are either more likely to occur or that are designated to occur.
- different light sources 100 and detectors 200 can be employed to detect an applied force and the (x, y) touch location TL.
- An aspect of the disclosure is utilizing the time response of two or more detectors 200 to identify the touch location TL of a touch event TE.
- This technique can be used because the deformation of waveguide/glass sheet 20 proceeds outward from the touch location as a function of time. This in turn has a different impact on different optical paths that light rays 104 take through the waveguide. The result is a delay in the detector signals of the two detectors.
- FIG. 24 plots the amplitude AMP of the detector signal (arbitrary units) vs. time t for two different detectors (A and B in the plot) for two different touch events TE at different locations on the waveguide/glass sheet 20 .
- the time lag between the A and B signals can be correlated with different locations on waveguide/glass sheet 20 .
- the optical path closest to the touch event location TL responds first, giving rise to the time lag in detector signals.
- controller 300 includes information about various time lags associated with detector signals for various detectors 200 as a function of possible touch locations TL.
- controller 300 is configured to calculate the touch location TL based on the information in one or more detector signals.
- FIG. 25A is a schematic elevated view of an example pressure-sensing display 400 formed by operably arranging touch system 10 adjacent and above (e.g., atop) a conventional display unit 410 , such as a liquid crystal display, which display may have conventional position-based sensing capability.
- Touch system 10 can be any of the embodiments described herein.
- FIG. 25B is a schematic cross-sectional, partial exploded view of an example touch-sensitive display 400 illustrating an example of how to integrate touch system 10 with conventional display unit 410 .
- the conventional display unit 410 is shown in the form of a liquid crystal display that includes a backlighting unit 414 that emits light 416 , a thin-film transistor (TFT) glass layer 420 , a liquid crystal layer 430 , a color filter glass layer 450 with a upper surface 452 , and a top polarizer layer 460 with a upper surface 462 , all arranged as shown.
- a frame 470 is disposed around the edge of color filter glass layer 450 .
- Light source 100 is shown by way of example as being operably supported within frame 470 . This forms an integrated display assembly 480 having a top side 482 .
- assembly 20 is added to integrated display assembly 480 of conventional display unit 410 by operably disposing the assembly on top side 482 .
- the assembly 20 can include the aforementioned cover 40 in the form of an IR-transparent but visibly opaque layer disposed adjacent light source 100 and detector 200 .
- various indicia or indicium such as a keyboard (not shown) may be presented to user 500 on or through upper surface 26 to guide the user to interact with touch system 10 .
- the indicium may include areas on upper surface 26 of waveguide 22 that are set aside for indicating user choices, software execution, etc., or to indicate a region where the user should create touch event TE. Such region, for example, might be required where light 104 does not reach certain portions of upper surface 26 .
- the at least one detector 200 may not respond uniformly (smoothly) to the intensity changes in output light 104 -O. Accordingly, aspects of the disclosure are directed to estimating the applied force in such cases using various embodiments and configurations for the detection of output light 104 -O.
- touch system 10 can include a sloped attenuation filter (attenuator) 125 in front of detector 200 .
- Sloped attenuator 125 can be formed from glass configured with an attenuation that changes uniformly from the bottom edge to top edge.
- FIG. 26B is an example plot of the transmission T vs. height of attenuator 125 . Since the overall power hitting the light-sensitive area of the detector 200 is substantially constant, the sloped attenuation will cause that detector signal SD to change with the vertical “center of mass” of output light 104 -O. This allows for the detector signal SD to be correlated with applied pressure.
- the detector response to the applied pressure at the touch location may not be completely monotonic.
- the image can move in one direction until the pressure reaches certain amount and then jump to the other edge of glass (detector). Since the monotonic range is not too small and touch force does not change instantly, an aspect of the disclosure includes performing a method to “unwrap” the measurements.
- the method assumes that the detector signal SD is sampled sufficiently fast, e.g., 60 Hz or faster and the force is reasonably large (e.g., 100 g) and applied monotonically vs. impulsively. Also:
- Another aspect of the disclosure employs fringe-motion detection. Since the fringes in output light 104 -O tend to move uniformly with pressure, one can employ a vertical stripe (linear array) of CMOS or CCD cells. It would be sufficient to use few tens of cells.
- a typical 2D array pixel-based detector 200 has thousands of cells.
- the linear array detector 200 can provide a vertical intensity profile of output light 104 -O. The intensity profile has two components: One is slow changing that typically has one or two peaks, while the second represents fast changing fringes.
- a filter is used to eliminate the slow-changing component.
- the remaining fast-changing component shows peaks corresponding to fringes. If the fringe profile is sampled fast enough (e.g., 60 Hz), the difference in phase between consecutive frames can be computed. Integrating the differences yields a detector signal SD that is representative (e.g., proportional) to the applied pressure at the touch location TL.
- example detector measurement configurations and methods include the following performed during a touch event where pressure is being applied at a touch location TL:
- FIG. 27A is a plot of the detector signal SD (arbitrary units) vs. frame # F for the total integrated power, i.e., TOTAL signal (blue) and an integrated power of a small area in the middle of the detector, i.e., PINHOLE 1 signal (orange).
- FIG. 27B is a plot of the detector signal SD (arbitrary units) vs. frame # for the total integrated power, i.e., TOTAL signal (blue) and an integrated power of a small area just above the middle of the detector, i.e., PINHOLE 2 signal (orange).
- FIG. 27C is a plot of the detector signal SD (arbitrary units) vs. frame # for the total integrated power, i.e., TOTAL signal (blue) and signal with linear attenuation filter (high attenuation at top of image), i.e., SLOPE 1 (orange).
- FIG. 27D is a plot of the detector signal SD (arbitrary units) vs. frame # for the total integrated power, i.e., TOTAL signal (blue) and signal with linear attenuation filter (high attenuation at bottom of image), i.e., SLOPE 1 (orange).
- SLOPE2 and then PINHOLE1 are suitable candidates for use in assessing amounts of applied pressure at the touch location.
- the PINHOLE signals are location sensitive and so can be used to determine the position of the touch location TL.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Position Input By Displaying (AREA)
- Optical Integrated Circuits (AREA)
- Length Measuring Devices By Optical Means (AREA)
Abstract
Pressure-sensing touch systems and methods are disclosed for sensing the occurrence of a touch event based on pressure applied at a touch location. The touch system includes a light-source system and a detector system operably adjacent respective input and output edges of a waveguide. Pressure at a touch location on the waveguide gives rise to a touch event causes the waveguide to bend or flex. The waveguide bending causes a change in the optical paths of light traveling by FTIR, causing the light distribution in the output light to change. The changes are detected and are used to determine whether a touch event occurred, as well as the time-evolution of the touch event. The changes in the output light can include polarization changes caused by birefringence induced in the waveguide by the applied pressure applied. Various detector configurations are disclosed for sensing the location and pressure of a touch event.
Description
- This application is a continuation of U.S. patent application Ser. No. 15/591,528 filed on May 10, 2017 which is a continuation of U.S. patent application Ser. No. 14/043,158 filed Oct. 1, 2013, which claims the benefit of priority under 35 U.S.C. § 119 of U.S. Provisional Application Ser. No. 61/744,877, filed on Oct. 4, 2012, the content of which is relied upon and incorporated herein by reference in its entirety.
- The present disclosure relates to touch-sensitive devices, and in particular to touch systems and methods capable of sensing a touch event at a touch location based on applied pressure at the touch location.
- The market for displays and other devices (e.g., keyboards) having non-mechanical touch functionality is rapidly growing. As a result, touch-sensing techniques have been developed to enable displays and other devices to have touch functionality. Touch-sensing functionality is gaining wider use in mobile device applications, such as smart phones, e-book readers, laptop computers, tablet computers and like devices.
- Touch systems in the form of touch screens have been developed that respond to a variety of types of touches, such as single touches, multiple touches, swiping, finger touches and stylus touches. Some of these systems rely on light-scattering and/or light attenuation. While effective, there remains a need for alternative optics-based approaches to touch-sensing that can sense a touch event based on the pressure applied at the touch location.
- The present disclosure relates to touch-sensitive devices, and in particular to touch systems that detect a touch event based pressure applied at the touch location of the touch event. Aspects of the systems and methods take advantage of the deflection, steering or other alternation of light traveling within a waveguide when pressure is applied to the waveguide. The alterations of the light beam include changing the beam path, splitting the beam into multiple beams, creating interference between multiple beams, creating multiple output light beams, and changing the polarization state of the input light beam.
- Aspects of the disclosure include a touch system that employs light-bending effects and light-polarization effects. The touch system includes a light-source system and a detector system operably disposed adjacent respective input and output edges of a waveguide in the form of a transparent sheet. The waveguide can also include just a portion of the transparent sheet, e.g., an ion-exchanged or thin waveguide layer adjacent the upper surface of the transparent sheet. Pressure at a touch location on the waveguide that gives rise to a touch event causes the waveguide to bend or flex. The waveguide bending causes a change in the optical paths of FTIR light traveling in the waveguide. This in turn causes the light distribution in the output light to change. The changes in the light distribution are detected and are used to determine whether a touch event occurred, as well as the time-evolution of the touch event. The changes can include polarization changes caused by birefringence induced in the waveguide by the pressure applied at the touch location.
- Aspects of the disclosure include various detector configurations are disclosed for sensing the location and pressure of a touch event, such as by detecting the movement of fringes past the detector. Also, detecting outputted light at different detectors can be employed to measure the time difference between detector signals for a given touch event, and then using the time difference to determine the touch location of the touch event. Various detector configurations and detector signal processing techniques are disclosed that determine an amount of pressure at the touch event, as well as the time evolution of the applied pressure.
- Additional features and advantages of the disclosure are set forth in the detailed description that follows, and in part will be readily apparent to those skilled in the art from that description or recognized by practicing the disclosure as described herein, including the detailed description that follows, the claims, and the appended drawings.
- The claims as well as the Abstract are incorporated into and constitute part of the Detailed Description set forth below.
- All publications, articles, patents, published patent applications and the like cited herein are incorporated by reference herein in their entirety, including U.S. Patent Application Publication No. 2011/0122091 and U.S. Provisional Patent Applications Nos. 61/564,003, 61/564,024 and 61/640,605.
-
FIG. 1A is a face-on view of an example touch system according to the disclosure; -
FIG. 1B is a face-on view of a portion of the touch system ofFIG. 1A illustrating an example of multiple light source systems and multiple detector systems operably disposed about respective opposite edges of the waveguide; -
FIGS. 2A and 2B are top-down views of an example light source that includes multiple light-source elements (FIG. 2A ) and an example detector that includes multiple detector elements (FIG. 2B ); -
FIG. 3 is a cross-sectional view of an example embodiment of the touch system ofFIG. 1A ; -
FIGS. 4A through 4D are cross-sectional views of different example embodiments of the touch system ofFIG. 1A ; -
FIGS. 5A through 5C are near-field images of the output light at the output edge of the waveguide for different amounts of bending of the waveguide, withFIG. 5A illustrating the case of no bending; -
FIGS. 6A and 6B are schematic side views of the waveguide that illustrate how bending the waveguide causes the light traveling in the waveguide to traverse a longer optical path; -
FIGS. 6C and 6D are close-up view of the input edge portion of the waveguide showing how otherwise collimated light traveling with no bounces (FIG. 6A ) in an unbent waveguide can travel with bounces (FIG. 6B ) in a bent waveguide; -
FIG. 6E is a close-up view of the output edge portion of the waveguide showing how output light from a bent waveguide exits the output edge and has a non-uniform (inhomogeneous) distribution; -
FIG. 6F show the intensity distribution of the output light at the output edge of the waveguide and illustrates the changes that occur in the intensity distribution of the output light as the amount of waveguide flexing (bending) increases; -
FIG. 6G shows a sequence of images of output light 104-O taken at the output edge of an example waveguide, with the images showing the changes in the intensity distribution as well as a shift in the intensity pattern with increased waveguide bending. -
FIG. 7A is a schematic cross-sectional diagram of an example waveguide with a finger poised to create a touch event TE a central touch location; -
FIG. 7B shows waveguide ofFIG. 7A with the touch event caused by the finger exerting downward pressure on waveguide on the upper surface, thereby causing the waveguide to flex; -
FIG. 7C is similar toFIG. 7B , except that the touch event occurs at a touch location that is closer to output edge; -
FIG. 8 is a plot of the measured power PM (in microwatts, μW) of the output light at a given output edge location versus the applied touching force FT (in Newtons, N) for a center location (squares) and an edge location (diamonds), illustrating how the change in power is less for an edge location than for a center location; -
FIG. 9A andFIG. 9B are simulated and measured far-field images of the output light emitted at the output edge of an example flexed waveguide two directions (positions) of the output light; -
FIG. 9C is a plot of the % of Power vs. glass deformation (mm) for the two light directions (positions) as determined by photodetectors arranged at the locations of the light spots. -
FIG. 10 is plot of the voltage versus time for one of the two far-field light spots when applying an instantaneous force of 1 Newton to an example waveguide made of glass having a thickness TH of 1.2 mm, wherein the voltage represents the measured power; -
FIGS. 11A and 11B are close-up, cross-sectional views of the output edge portion of an example waveguide showing simulate ray traces for different amounts of waveguide bending, and illustrating embodiments where the detectors are arranged on the lower surface (FIG. 11B ) and both the upper and lower surfaces (FIG. 11B ); -
FIGS. 12A through 12C are schematic diagrams of an example waveguide showing simulated light rays for examples where the input light partially fills the waveguide (FIG. 12A ), mostly fills the waveguide (FIG. 12B ) and substantially completely fills the waveguide (FIG. 12C ); -
FIG. 13 is similar toFIG. 11B and illustrates an example detector configuration where the two detectors are arranged so that the detector signals are out of phase; -
FIG. 14 shows a series of simulated images of output light beams obtained by summing electric fields of the output light rather than the intensity; -
FIG. 15 is a schematic partially exploded side view of an example waveguide that includes upper and lower cladding layers that enhance the waveguiding ability, and also showing a display unit that interfaces with the lower surface of the cladded waveguide; -
FIG. 16 is a schematic diagram of an example embodiment oftouch system 10 that relies on polarization effects for touch sensing; -
FIG. 17 is a plot of the detector signals SD from two detectors (det A, det B), illustrating how two detectors can be used to provide enhanced signal detection and measurement sensitivity; -
FIGS. 18A-18E are images of the output light as detected by the touch system ofFIG. 16 , showing how the amount of detected output light changes with increased bending of the waveguide due to the induced stress birefringence imparted to the waveguide at the touch location; -
FIGS. 19A-19C are schematic side views of example embodiments of the touch system ofFIG. 16 , withFIGS. 19B and 19C illustrating an example ion-exchanged waveguide; -
FIG. 20 is a schematic side view of an example touch system similar to that shown inFIG. 3 andFIG. 4A , but wherein the waveguiding region is formed as a thin layer adjacent the upper surface of a glass substrate; -
FIG. 21 plots the collected power (nanowatts) vs. the applied force (Newtons) for center and edge touch locations for the example touch system ofFIG. 20 ; -
FIGS. 22 and 23 are top-down schematic views of example configurations fortouch system 10 wherein channel waveguide regions are formed on a glass sheet; -
FIG. 24 is a plot of detector signal amplitude versus time for two different touch event locations, illustrating how there is a measurable time lag between the detector signals for the different touch locations, thereby providing a means for determining the touch event location; -
FIG. 25A is an elevated view of an example pressure-sensing display system that shows the touch system disclosed herein interfaced with a display unit; -
FIG. 25B is a cross-sectional view of the pressure-sensing display system ofFIG. 16A ; -
FIG. 26A is a cross-sectional view of the detector end of an example touch system that includes a sloped attenuator disposed adjacent the detector; -
FIG. 26B is an example plot of the normalized transmission T vs. attenuation filter height, showing an example filter attenuation profile; -
FIGS. 27A through 27D are plots of the detector signal versus frame number (#) for four different detector configurations used to detect fringes in the output signal to determine the amount of pressure being applied at the touch location; and -
FIGS. 28A through 28C provide supplemental information to the polarization-based embodiments described herein. - Cartesian coordinates are shown in certain of the Figures for the sake of reference and are not intended as limiting with respect to direction or orientation.
- The present disclosure can be understood more readily by reference to the following detailed description, drawings, examples, and claims, and their previous and following description. However, before the present compositions, articles, devices, and methods are disclosed and described, it is to be understood that this disclosure is not limited to the specific compositions, articles, devices, and methods disclosed unless otherwise specified, as such can, of course, vary. It is also to be understood that the terminology used herein is for the purpose of describing particular aspects only and is not intended to be limiting.
- The following description of the disclosure is provided as an enabling teaching of the disclosure in its currently known embodiments. To this end, those skilled in the relevant art will recognize and appreciate that many changes can be made to the various aspects of the disclosure described herein, while still obtaining the beneficial results of the present disclosure. It will also be apparent that some of the desired benefits of the present disclosure can be obtained by selecting some of the features of the present disclosure without utilizing other features. Accordingly, those who work in the art will recognize that many modifications and adaptations to the present disclosure are possible and can even be desirable in certain circumstances and are a part of the present disclosure. Thus, the following description is provided as illustrative of the principles of the present disclosure and not in limitation thereof.
- Disclosed are materials, compounds, compositions, and components that can be used for, can be used in conjunction with, can be used in preparation for, or are embodiments of the disclosed method and compositions. These and other materials are disclosed herein, and it is understood that when combinations, subsets, interactions, groups, etc. of these materials are disclosed that while specific reference of each various individual and collective combinations and permutation of these compounds may not be explicitly disclosed, each is specifically contemplated and described herein.
- Thus, if a class of substituents A, B, and C are disclosed as well as a class of substituents D, E, and F, and an example of a combination embodiment, A-D is disclosed, then each is individually and collectively contemplated. Thus, in this example, each of the combinations A-E, A-F, B-D, B-E, B-F, C-D, C-E, and C-F are specifically contemplated and should be considered disclosed from disclosure of A, B, and/or C; D, E, and/or F; and the example combination A-D. Likewise, any subset or combination of these is also specifically contemplated and disclosed. Thus, for example, the sub-group of A-E, B-F, and C-E are specifically contemplated and should be considered disclosed from disclosure of A, B, and/or C; D, E, and/or F; and the example combination A-D. This concept applies to all aspects of this disclosure including, but not limited to any components of the compositions and steps in methods of making and using the disclosed compositions. Thus, if there are a variety of additional steps that can be performed it is understood that each of these additional steps can be performed with any specific embodiment or combination of embodiments of the disclosed methods, and that each such combination is specifically contemplated and should be considered disclosed.
-
FIG. 1A is a schematic diagram of an example pressure-sensing touch system (“touch system”) 10 according to the disclosure. Thetouch system 10 may be used in a variety of consumer electronic articles, for example, in conjunction with displays for cell-phones, keyboards, touch screens and other electronic devices such as those capable of wireless communication, music players, notebook computers, mobile devices, game controllers, computer “mice,” electronic book readers and the like. - The
example touch system 10 ofFIG. 1A includes a generally planar light-guiding assembly (“assembly”) 20, the details of which are described below.Assembly 20 includes awaveguide 22, with at least onelight source 100 and at least onedetector 200 are disposed adjacent a perimeter P of the waveguide. The at least onelight source 100 and the at least onedetector 200 and are optically coupled through the waveguide as explained in greater detail below. - One
light source 100 and onedetector 200 are shown inassembly 20 by way of example. Perimeter P includes an edge (end) 23 adjacentlight source 100 and an edge (end) 24adjacent detector 200. Perimeter P can have any reasonable shape and is shown as being rectangular by way of example.Assembly 20 can be generally rectangular and in the example shownwaveguide 22 has a dimension (length) LX in the X-direction and a length LY in the Y-direction. -
FIG. 1B illustrates an example embodiment ofsystem 10 wherein multiple light-sources 100 are used (or equivalently, a light source with multiple light-source elements can be used), andmultiple detectors 200 are used (or equivalently, a detector with multiple detector elements. This configuration ofsystem 10 is especially useful when the location of one or more touch events TE needs to be determined. In addition, one or morelight sources 100 and one ormore detectors 200 can be operably disposed in the assembly to ensure that the entire (or substantially the entire) assembly can be used to sense the pressure of a touch event. This may include, for example, cycling the activation of sets (e.g., pairs) oflight sources 100 and/ordetectors 200 to ensure that all possible locations for touch events are covered. In an example, the cycling can be done at a rate that is much faster than the typical duration of a touch event that applies pressure to elicit a response fromtouch system 10. -
Example detectors 200 include photodiodes and the various types of photosensors. Examplelight sources 100 include LEDs, laser diodes, optical-fiber-based lasers, extended light sources, and the like. - With reference to
FIG. 2A ,light source 100 can comprise one or more light-source elements 102 that are operably mounted on flex-circuit boards (“flex circuits”) 110, which in turn are mounted to printed circuit boards (PCB) 112 arranged adjacent anedge 26 oftransparent sheet 20. In the discussion herein,light source 100 can thus mean a light source having one or more light-source elements 102. Likewise, with reference toFIG. 2B ,detector 200 can include a detector that has onemore detector elements 202. Output light 104AB is shown incident upon one ofdetector elements 202. In an example,detector 200 can be a pixelated detector wheredetector elements 202 constitute detector pixels. An example pixelateddetector 200 is a CMOS or CCD array detector. - In example embodiments of the disclosure, an amount of pressure (e.g., a relative amount of pressure) is applied to planar waveguide at touch location TL associated with a touch event TE. Aspects of the disclosure are directed to sensing the occurrence of a touch event TE, while other aspects include the additional function of determining the touch location TL of the touch event. Other aspects of the disclosure include sensing an amount of pressure applied at the touch event TE.
- In an example,
touch system 10 includes anoptional cover 40 that serves to coverlight source assembly 20 by a viewer (see, e.g.,viewer 500,FIG. 15B ). In an example, cover 40 serves the role of a bezel. In an example, cover 40 can be any type of light-blocking member, film, paint, glass, component, material, texture, structure, etc. that serves to block at least visible light and that is configured to keep some portion oftouch system 10 from being viewed by a user, or that blocks one wavelength of light while transmitting another. InFIG. 3 , onlylight sources 100,detectors 200 andwaveguide 22 are shown for ease of illustration. - In example embodiments, cover 40 can reside anywhere relative to
assembly 20 that serves to block a viewer from seeinglight source 100 ordetector 200.Cover 40 need not be contiguous and can be made of sections or segments. Further, cover 40 can be used to shielddetector 200 from receiving light other than light 104 fromlight source 100, such as for sunlight rejection. Thus, in an example, cover can be substantially opaque at one wavelength (e.g., a visible wavelength) and substantially transparent at another wavelength (e.g., an infrared wavelength for light 104 from light source 100). - In an example, cover 40 is in the form of a film that is opaque at least at visible wavelengths and that optionally transmits at IR wavelengths. An example film for
cover 40 comprises a black paint that absorbs light over a wide range of wavelengths including the visible and IR wavelengths. - With continuing reference to
FIG. 1 ,touch system 10 may include acontroller 300 that is operably connected (e.g., via a bus 301) to the one or morelight sources 100 and the one ormore detectors 200.Controller 300 is configured to control the operation oftouch system 10. In some embodiments, thecontroller 300 includes aprocessor 302, adevice driver 304 andinterface circuit 306, all operably arranged. Controller controlslight source 100 via a light-source signal SL and also receives and processes a detector signal SD fromdetector 200. - In an example embodiment,
light source 100 is wavelength modulated viaprocessor 302 ofcontroller 300 via light source control signal SL. This causes a change in output light beam 104-O by changing the optical paths OPn oflight beam 104 in a select manner. This select change manifests itself in detector signal SD, which is processed (filtered) bycontroller 300 to bring out the laser modulation frequency. This can be accomplished, for example, by a lock-in amplifier. - In an example,
controller 300 comprises a microcontroller or a computer that executes instructions stored in firmware and/or software (not shown).Controller 300 is programmable to perform functions described herein, including the operation of the touch system and any signal processing that is required to measure, for example, relative amounts of pressure, as well as the location of a touch event, or multiple touch events and multiple pressures. As used herein, the term computer is not limited to just those integrated circuits referred to in the art as computers, but broadly refers to computers, processors, microcontrollers, microcomputers, programmable logic controllers, application-specific integrated circuits, and other programmable circuits, and these terms are used interchangeably herein. - Software may implement or aid in performing the pressure-sensing functions and operations disclosed herein. The software may be operably installed in
controller 300 orprocessor 302. Software functionalities may involve programming, including executable code, and such functionalities may be used to implement the methods disclosed herein. Such software code is executable by the general-purpose computer or by the processor unit described below. - In operation, the code and possibly the associated data records are stored within a general-purpose computer platform, within the processor unit, or in local memory. At other times, however, the software may be stored at other locations and/or transported for loading into the appropriate general-purpose computer systems. Hence, the embodiments discussed herein involve one or more software products in the form of one or more modules of code carried by at least one machine-readable medium. Execution of such code by a processor of the computer system or by the processor unit enables the platform to implement the catalog and/or software downloading functions, in essentially the manner performed in the embodiments discussed and illustrated herein.
- The computer and/or processor as discussed below may each employ a computer-readable medium or machine-readable medium, which refers to any medium that participates in providing instructions to a processor for execution, including for example, determining an amount of pressure associated with a touch event, as explained below. Any memory discussed below constitutes a computer-readable medium. Such a medium may take many forms, including but not limited to, non-volatile media, volatile media, and transmission media. Non-volatile media include, for example, optical or magnetic disks, such as any of the storage devices in any computer(s) operating as one of the server platforms, discussed above. Volatile media include dynamic memory, such as main memory of such a computer platform. Physical transmission media include coaxial cables; copper wire and fiber optics, including the wires that comprise a bus within a computer system.
- Common forms of computer-readable media therefore include, for example: a floppy disk, a flexible disk, hard disk, magnetic tape, any other magnetic medium, a CD-ROM, DVD, any other optical medium, less commonly used media such as punch cards, paper tape, any other physical medium with patterns of holes, a RAM, a PROM, and EPROM, a FLASH-EPROM, any other memory chip or cartridge, a carrier wave transporting data or instructions, cables or links transporting such a carrier wave, or any other medium from which a computer can read programming code and/or data. Many of these forms of computer readable media may be involved in carrying one or more sequences of one or more instructions to a processor for execution.
-
FIG. 3 is a cross-sectional view ofexample system 10.System 10 has awaveguide 22 that in an example is in the form of a thin, transparent sheet.Waveguide 22 has aninput edge 23 and anoutput edge 24.Light source 100 is arrangedadjacent input edge 23 while detector is arrangedadjacent output edge 24.Waveguide 22 has abody 25 that is substantially transparent to the wavelength λ of light 104 (“the operating wavelength”) emitted bylight source 100.Waveguides 22 has anupper surface 26 and alower surface 27 separated by a thickness TH.Waveguide 22 has a central plane PC that is parallel to upper and lower surfaces and midway therebetween.Light source 100 anddetector 200 lie along a central axis AC that lights in central plane PC. - In other embodiments, materials other than glass can be used for
waveguide 22, such as polymers, plastics and other non-glass materials that are substantially transparent at the operating wavelength λ. -
System 10 includes an inputoptical system 123 operably arranged betweenlight source 100 andinput edge 23. Inputoptical system 123 is configured to receive (coherent) light 104 and direct it intowaveguide 22.System 10 also includes an outputoptical system 124 operably arranged betweenlight source 100 andoutput edge 24. Outputoptical system 124 is configured to receive output light 104-O and either direct it or allow it to pass todetector 200. In an example, outputoptical system 124 includes a diaphragm (stop) as shown. Outputoptical system 124 can also include other light-directing or light-conditioning elements or components, such as lens elements, mirrors, etc. - The combination of
light source 100 and inputoptical system 123 defines alight source system 103 while the combination ofdetector 200 and outputoptical system 124 defines adetector system 204.Light source system 103,detector system 204 andwaveguide 22 constitute a touch-screen assembly 20. -
FIG. 3 illustrates an example embodiment wheredetector system 204 is aperture limited so thatdetector 200 only detects a limited portion of light 104-O that exits output edge 24 (i.e., output light 104-O). This allowsdetector 200 to detect a local change in the variation of intensity in output light 104-O, as opposed to collecting essentially all of the light and obtaining an integrated measurement that will not substantially change. This is because the perturbation ofwaveguide 22 generally results on a redistribution of light within the waveguide. - To efficiently detect the redistribution of
light 104, the size of theaperture 124 needs to be smaller than the thickness TH of thewaveguide 20. This can be achieved by either using anaperture 124 in conjunction with a detector larger than the waveguide thickness, or by using only a detector having a size smaller than the waveguide thickness.Aperture 124 can be circular, but can be rectangular to optimize the power collection efficiency. - In other embodiments as discussed above,
detector 200 is pixelated so that a measurement of a large portion of output light 104-O includes being able to sense the distribution of light in the interference pattern (i.e., the light and dark fringes) so that changes in the pattern can be detected when touch events TE occur. Thus, in one example embodiment, one or more portions ofoutput edge 24 are imaged ontodetector 200, which includes the case of placingdetectors 200 at different locations right up against the output edge.Detector 200 can also have a photosensing surface that has a dimension smaller than the waveguide thickness TH -
System 10 is configured so thatlight beam 104 travels throughwaveguide 22 frominput edge 23 tooutput edge 24 over multiple optical paths OPn associated with light rays 104-n, where n is an integer and equal to or greater than 2. InFIG. 3 , two of optical paths OPn are represented by two light rays 104-1 and 104-2 of light rays 104-n by way of illustration. In an example, the number n of different optical paths correspond to the number n of light rays that undergo a different number of total-internal reflections (“bounces”) when traveling between input andoutput edges - One skilled in the art will appreciate that the guided modes represented by the n light rays 104-n are capable of optical interference. To this end, output
optical system 124 is configured to receive n light rays 104-n that exitoutput edge 24 and combine the light rays (guided modes) so that they interfere, thereby forming an output light beam 104-O. The output light beam 104-O is directed todetector 200, which detects the output light beam. - From an electromagnetic viewpoint, when light 104 is launched into
waveguide 22, the total electrical field E can be represented by: -
E=ΣE n exp(−iβ n z) (1) - where En and βn are the electrical field distribution and propagation constant of mode n respectively. The light intensity is given by:
-
I∝E 1 2 +E 2 2 + . . . +E 1 E 2 cos(Δβ12 z)+E 1 E 3 cos(Δβ13 z)+ . . . E m E n cos(Δβmn z) (2) - where is Δβ is the propagation constant difference between modes n and m.
- Due to the phase differences among different modes, Eq. (2) shows that interference will arise at
output edge 24 ofwaveguide 22. The phase difference is very sensitive to external perturbations to waveguide 22, such as bending, pressure etc. This effect can be used insystem 10 to enable force-sensitive or pressure-sensitive touch applications. - In some embodiments, at least one of light rays 104-n represent the lowest-order mode of
waveguide 22, while the other light rays represent higher-order modes. The lowest-order mode ofwaveguide 22 travels directly along central axis A1 without undergoing any bounces. Thus, input and outputoptical systems body 25 ofwaveguide 22. -
Waveguide 22 may generally be made of any suitably transparent material that can be formed into a thin planar sheet, such as plastic, acrylic, glass, etc., and that supports the transmission of light beam 104-n without substantial loss due to scattering or absorption. In an example embodiment, waveguide thickness TH such that the waveguide can flex without breaking when pressure is locally applied atupper surface 22 at touch location TL. An exemplary range for thickness TH is from 0.3 mm to 1.5 mm. Other thickness can be employed consistent with the particular application fortouch system 10. In an example, only top waveguide 22A has a thickness that allows it to flex, while bottom waveguide 22B is sufficiently thick or is otherwise rigid that it retains its generally planer configuration even when the top waveguide is subject to a flexing force due to a touch event TE. - In an example embodiment,
waveguide 20 may be formed from a chemically strengthened glass, such as a soda-lime-type glass. An example glass s an alkali aluminosilicate glass hardened through ion exchange. These types of glass can comprise Na2O (soda), CaO (lime) and SiO2 (silica), but can also include oxides such as MgO, Li2O, K2O, ZnO, and ZrO2. Once hardened through ion exchange, these types of glass exhibit certain characteristics that make them desirable for touch screen applications, as well as other applications (e.g., as a cover glass). - Further details as to the formulation or production, or both, of soda-lime-type glass suitable for use as waveguiding sheets may be found in one or more of U.S. patent application Ser. No. 11/888,213 filed Jul. 31, 2007; U.S. patent application Ser. No. 12/537,393 filed Aug. 7, 2009; U.S. patent application Ser. No. 12/545,475 filed Aug. 21, 2009; and U.S. patent application Ser. No. 12/392,577 filed Feb. 25, 2009. An exemplary glass for use herein is Gorilla® glass, from Corning, Incorporated, Corning, N.Y. Also, an exemplary glass, such as low-iron Gorilla® glass or other low-iron ion-exchanged glass, is transparent to an infrared operating wavelength λ.
-
FIG. 4A is an example embodiment ofassembly 20 based on that ofFIG. 3A but wherein light-source system 103 includes a single-mode optical fiber as inputoptical system 123, and wheredetector system 204 includes either a single-mode or multimode optical fiber as outputoptical system 124. The single or multimodeoptical fiber 124 serves as an aperture-limited optical system that allows for a localized measurement of output light 104-O to be made. In an alternative embodiment, multipleoptical fibers 124 can be used to compare intensities at different locations atoutput edge 24. This includes, for example, utilizing an optical fiber bundle. -
FIG. 4B is another example embodiment ofassembly 20 based on that ofFIG. 3A , but wherein light-source system 103 includes a grating as inputoptical system 123, and wheredetector system 204 includes a grating as outputoptical system 124. As discussed above, an aperture can be usedadjacent detector 200 to make the detection process aperture limited and thus directed to a local intensity measurement. -
FIG. 4C is another example embodiment ofassembly 20 similar to that ofFIG. 4B but wherein light-source system 103 includes a prism arranged onlower surface 27 as a component of inputoptical system 123, and wheredetector system 204 includes a prism also arranged onlower surface 27 as a component of outputoptical system 124. As discussed above, an aperture can be usedadjacent detector 200 to make the detection process aperture limited and thus directed to a local intensity measurement. -
FIG. 4D is another example embodiment ofassembly 20 similar to that ofFIG. 4C but wherein input andoutput edges Light 104 fromlight source 100 enterswaveguide 22 atlower surface 27 over a range of angles, and is internally reflected atangled edge 23. The internal reflection directs light 104 to be guided over optical paths OPn. At the detector side, light 104 traveling as light rays 104-n reflects fromangled edge 24 and is directed to exitwaveguide 22 atlower surface 27, where the output light 104-O is detected atdetector 200.Angled edge 23 thus defines a component of inputoptical system 123 and anglededge 24 defines a component of outputoptical system 124. As discussed above, an aperture can be usedadjacent detector 200 to make the detection process aperture limited and thus directed to a local intensity measurement. - In the general operation of
system 10, wherein there is no touch event TE occurring onupper surface 26 ofwaveguide 22, optical paths OPn associated with the different guide modes remain constant so that the output light 104-O exiting the waveguide at the detector end remains constant in time.FIG. 5A is a photograph of a near-field interference pattern from output light 104-O atoutput edge 24 ofwaveguide 22 when there is no touch event TE occurring. -
FIG. 5B is a photograph of the near-field interference pattern from output light 104-O for thesystem 10 associated withFIG. 5A , but with a touch event TE applied with a moderate amount of pressure. It can be seen that the light distribution of the near-field interference pattern has changed from the no-touch-event condition ofFIG. 5A .FIG. 5C is a photograph of the near-field interference pattern from output light 104-O for thesystem 10 associated withFIGS. 5A and 5B , but with a touch event TE applied with a strong pressure. It can be seen that the light distribution of the near-field interference pattern has changed from the moderate-pressure touch-event condition ofFIG. 5B . - The change in the light distribution in output light 104-O arises because pressure from the touch event TE causes
waveguide 22 to bend, which causes a change in the relative optical path differences for the light rays 104-n. Said differently the waveguide bending affects each optical path OPn differently, so that changes in the existing optical path differences arise and give rise to a changed set of optical paths OP′n. The output light 104-O thus defines a multimode interference pattern, and this pattern changes when the differences between the optical paths OPn changes. -
FIG. 6A is a cross-sectional view ofwaveguide 22 withlight 104 traveling over a first optical path OP1 that the lowest-order mode, i.e., travels straight through the waveguide along central axis AC. In fact, the first optical path OP1 and central axis AC are the same in this case. -
FIG. 6B is thesame waveguide 22 as inFIG. 6A but whereupper surface 26 is subject to a touch event TE at a touch event location TL in the middle and that bends the waveguide. It is assumed thatwaveguide 22 has a length L when no touch event TE is occurring. When a touch event TE occurs at touch location TL,waveguide 22 bends with a radius of curvature R measured relative to central axis AC. - The new optical path OP1′ associated with the flexed waveguide of
FIG. 6B is longer than the optical path OP1 of the unflexed top waveguide ofFIG. 6A . Assuming that the curvature of waveguide has a radius of curvature R=r+δr, and that curvature subtends an angle θ, then if θ is a relatively small angle (i.e., R is relatively large, which is a reasonable assumption in the present instance), it can be readily shown that the change in the optical path from OPA to OPA′ is approximately δr. - Thus, the optical path difference between the optical paths OP1 and OP1′ due to bending of
waveguide 22 due to a touch event is about δr. If δr is for example about 2.5 microns, that would be roughly equal to two wavelengths of infrared light of wavelength of 800 microns or so. This amount of optical path difference would manifest itself as a change in the output light 104-O, e.g., a change in the amount of optical power at a given point atoutput edge 24 due to shifting fringes in the detected portion of the resulting interference pattern. This is what is shown inFIGS. 5A through 5C . The changes in the optical paths other than the lowest-order optical path change in a similar manner. - Modal decomposition and the attendant multimode interference is one way to describe the way that light 104 gets re-distributed in
waveguide 20. In this description, output light 104-O can be thought of as having changing pattern due to changing interference effects. However, another way to represent the redistribution oflight 104 is to use a geometrical model based on ray tracing. Indeed, with a waveguide thickness TH in the order of 1 mm, diffraction effects can be neglected. So in other embodiments, different components (rays) of output light 104-O are re-directed by the deflection ofwaveguide 20, and the re-direction changes the character of the output light, e.g., the intensity pattern, the location of the intensity centroid, the division of a generally single output beam into multiple output beams, etc. - When injecting substantially collimated light 104 into a
planar waveguide 20 such as a transparent glass sheet (see, e.g.,FIG. 6C ), the light travels therethrough without being reflected. The resulting energy distribution as defined by output light 104-O at theoutput edge 24 ofwaveguide 20 has a substantially homogeneous distribution. When some bending is introduced (seeFIG. 6D ), a portion oflight 104 is reflected off of the upper andlower surfaces -
FIG. 6F shows example images output light 104-O as determined using a ray tracing model for different amounts of waveguide bending. The energy distribution starts out substantially homogeneous forwaveguide 20 without any bending (top left image). The energy distribution then becomes assymetric and ends up substantially homogeneous again when the amount of bending is close to half of the waveguide thickness. By putting anaperture 124 at the output, one can expect obtain a quasi-sinusoidal detector signal SD as a function of the waveguide bending amplitude. - The results shown in
FIG. 6F does not include any interference effects since all the rays that propagate are added in intensity.FIG. 14 shows images akin to those ofFIG. 6F but that are the result of the same model, except that rays are added in electric field. As can be seen, higher-frequency fringes appear due to interference effects between the two beams exitingoutput edge 24 ofwaveguide 20 at two different angles. -
System 10 can be operated in two different modes. In the first mode, the nearly collimated light 104 is injected at some angle with respect towaveguide 20, resulting in creating the very high-frequency fringes, which are visible inFIGS. 6G and 5B . By choosing aperture 214 to be significantly larger than the period of those fringes, the detection process becomes insensitive to the fringes and is only sensitive to the motion of the envelope predicted byFIG. 6F . In the second mode, light 104 is injected nearly parallel towaveguide 20 and aperture 214 is significantly smaller than the fringe period. In this case, the detection process is sensitive to the motion of the fringes, which can improve the detection sensitivity -
FIGS. 6C and 6D are close-up views of the input edge portion ofwaveguide 22 ofFIG. 6B .FIG. 6C shows parallel (collimated)input light 104 traveling in the lowest-order mode straight down the waveguide without any bounces when there is no flexing of the waveguide.FIG. 6D shows a flexed (bent) waveguide where the inputted collimated light 104 ends up bouncing off of the upper and lower surfaces. This means that the optical path of light 104 in the bent waveguide is even longer than if it traveled straight down the curved central axis AC. So the bending or flexing ofwaveguide 22 can turn collimated (lowest-order-mode) light into higher-order-mode light. This results in a greater amount of optical path change, which translates into a greater amount of change in the distribution of output light 104-O atoutput edge 24. -
FIG. 6E is a close-up, cross-sectional view of the output edge portion ofwaveguide 22, showing light rays 104-n based on the results of ray tracing modeling when the waveguide is flexed, as shown inFIG. 6C . Light rays 104-n are inhomogeneously distributed due to the flexedwaveguide 22.FIG. 6F show the intensity distribution of output light 104-O atoutput edge 24, and illustrates the change in the intensity distribution as the amount of flexing (bending) increases. -
FIG. 6G shows a sequence of images of output light 104-O atoutput edge 24 ofwaveguide 22. Thewaveguide 22 was a sheet of glass having a thickness TH=1.3 mm thickness. The thickness TH is indicated in each of the images. The approximate locations of the upper and lower surfaces are indicated by white dotted lines. The light distribution in output light 104-O light starts moving to the right, reaches a point where most of the light is concentrated at the edge of the sheet and then comes back to the center. If we keep bending, light keeps moving right-left and left-right a periodic way. The bending that is needed to make the light moving from being centered on the sheet to be centered again is nearly equal to half the thickness of the sheet which is in good agreement with the model. -
FIG. 7A is a schematic cross-sectional diagram ofwaveguide 22 with afinger 50 poised to create a touch event TE a central touch location.FIG. 7B shows the touch event caused byfinger 50 exerting downward pressure onwaveguide 22 onupper surface 26, thereby causingwaveguide 22 to flex.FIG. 7C is similar toFIG. 7B , except that the touch event TE occurs at a touch location TL that is closer tooutput edge 24, i.e., the touch location is off-center ofwaveguide 22. - Aspects of the disclosure include determining the time evolution of the touch event TE. This can be used for example to determine a relative amount of pressure that is applied to
upper surface 26 ofwaveguide 22 by, for example, a finger, a stylus, the eraser-end of a pencil, or like implement. It is noted here that the pressure applied toassembly 30 at top waveguide 22A may be through another surface that resides upper surface 26A, such as a coating layer. - Thus, in an example embodiment, the time evolution of the processed detector signal SD is used to characterize the time evolution of touch event TE. For example, as an object (e.g.,
finger 50, stylus, etc.) initially contacts surface 26 ofwaveguide 22, a small amount of flexing of the transparent sheet occurs. Asfinger 50 continues to push intotop waveguide 22, the amount of flexing of the top waveguide changes, so that optical path lengths OPn continuously changes. The changing optical paths show up as a continuous change in the output light 104-O and thus the processed detector signal SD. The continuous change in the optical paths changes the angular and spatial distribution at the output light 104-O. This includes interference patterns due to changes in optical paths and the polarization state oflight 104 due to the light passing difference regions of fabrication-induced and stress induced birefringence. - Once the object applies a constant pressure at touch location TL, the processed detector signal SD stops changing. At this point, the amount of time that the processed detector signal SD remains constant can be measured. This information can be used, for example, to carry out a function by requiring the touch event TE to have associated therewith not only a certain amount of pressure but a select duration as well. Further in the example embodiment, it can be required that the touch event have a select time evolution in pressure that is consistent with say a finger or stylus used to intentionally cause a touch event, as opposed to say an arbitrary object pressing down on
upper surface 26 ofwaveguide 22 and inadvertently triggering a touch event. -
FIG. 8 is a plot of the measured optical power PM in microwatts (μW) versus the applied touching force FT in Newtons (N) for anexample system 10 having multiplelight sources 100 andmultiple detectors 200. The plot includes data from a touch event TE that has a touch location at the center ofwaveguide 22, as indicated by squares in the plot and as shown inFIG. 7B . The plot also includes data from a touch event near the edge as indicated by diamonds in the plot and as shown inFIG. 7C . - The plot indicates that a touch event TE near the edge of
waveguide 22 do not give rise to as large a change in the measured power atdetector 200 as does a touch event near the center. This data can be used to establish the general location of a touch event, i.e., whether it is closer to the center than to the edge of the waveguide. - To demonstrate the touch sensitivity of
system 10, an example optical-fiber-based system as shown inFIG. 4A was employed.Light source 100 was in the form of a laser having an operating wavelength of 6328 nm.Laser 100 was pigtailed to a single-mode fiber 123. A collimating lens was used launched into a 4″×4″ Gorilla® glass substrate aswaveguide 22. Amultimode fiber 124 was butt-coupled to the glass substrate atoutput edge 24 to collect a portion of output light 104-O and relay it todetector 200. - When waveguide 22 is subjected to pressure (force) at a touch location TL, the detected light intensity changes.
FIGS. 5A through 5C , introduced and discussed above, shows the near field image of bright and dark interference pattern taken at the edge of the glass by adetector 200 in the form of a CCD camera. Significant pattern changes can be seen, with the center interference intensity maximum shifted from the being near theupper surface 26 to being near the lower surface 37. - With the variation of the intensity pattern of output light 104-O, the change in detected power can be used to indicate the magnitude of the applied force associated with the touch event.
- One example embodiment of
system 10 detects output light in the “near field,” i.e., close tooutput edge 24, while in another example embodiment the system detects the output light in the “far field,” i.e., away fromoutput edge 24. Near-field detection can be accomplished by placing a small aperture 214 (i.e., smaller than the thickness TH of waveguide 22) in front ofdetector 200. In this configuration, ray-trace modeling ofsystem 10 indicates that the detected signal SD is a periodic function as the waveguide is flexed, with the period being close to the thickness TH ofwaveguide 22. - Far-field detection can be accomplished by injecting substantially collimated light 104 into
input edge 23 ofwaveguide 22 and observing in the far field the output light 104-O, which is expected to be concentrated about two directions. The two directions correspond to light 104 undergoing an even number and an odd number of reflections, respectively. Changing the amount of bending inwaveguide 22 changes the distribution of optical power in the two directions. The two directions translate into two locations, depending on the distance at which output light 104-O is detected. -
FIG. 9A is a simulation of output light 104-O as measured in the far-field for a flexed waveguide, showing the two directions (positions) of the output light.FIG. 9B shows the measurement results for an actualflexed waveguide 22, with the far-field distribution of intensity of output light 104-O closely resembling the modeled results ofFIG. 9A .FIG. 9C is a plot of the % of Power P vs. glass deformation D (mm) for the two light directions as determined by first and second photodetectors (curves A and B in the plot) arranged at the locations of the light spots. As can be seem from the plot, the amount of power in the spots is periodic, with the two periods being out of phase by 180 degrees. -
FIG. 10 is plot of voltage V versus time in one of the two far-field light spots when applying an instantaneous force of 1 Newton to anexample waveguide 22 made of glass having a thickness TH of 1.2 mm. The voltage represents the detected optical power. The plot indicates a steep transition, which means that the detection of the touch event can be based on the transfer of optical power between the different directions of the far-field output light 104-O. -
System 10 can also be configured for detecting output light 104-O at one or both of upper andlower surfaces waveguide 22 changes the way light 104 bounces from the upper andlower surfaces -
FIGS. 11A and 11B depict ray trace simulations based on injecting light 104 into awaveguide 22 having a thickness TH of 1.2 mm. The light 104 is injected at an angle of 10 degrees so that the light bounces off of upper andlower surfaces FIG. 11A shows no waveguide bending whileFIG. 11B shows a bending of 0.3 mm.Detector 200 is shown disposed adjacentupper surface 26 ofwaveguide 22. The detector signal SD changes as the degree of bending ofwaveguide 22 changes since the location of the light bounces (and in some cases, the number of bounces) changes. According to the model, the detector signal SD is periodic with a period equal to half the waveguide thickness TH. - An
example detector 200 has a length LD in the direction of central axis AC defined by LD=TH/(sin θ), where TH is the aforementioned waveguide thickness and θ is the angle of light 104 with respect to upper andlower surfaces waveguide 22. -
FIGS. 12A through 12C show ray-trace simulations oflight 104 traveling in awaveguide 22 having a thickness TH of 1.2 mm and having an axial length of 240 mm.Input edge 23 was illuminated with homogeneous illumination having divergence (full) angles of 0 degrees (FIG. 12A ), 0.3 degrees (FIG. 12B ) and 0.6 degrees (FIG. 12C ). As can be seen, at 0.6 degrees, the entire waveguide is filled with light 104 so that the signal modulation induced by waveguide bending disappears. Themaximum beam divergence 6 when theinput beam 104 overfills waveguide thickness TH is approximately given by δ<2·TH/L, where L is the propagation length. - According to this model, the expectation is that the signal will be periodic (independent of the detection scheme). So, as long the system is operated close to the zero of the periodic function, the signal will be substantially linear. However, the phase of the response function depends on many parameters such as the glass length, the glass thickness, the angle of injection, and the like. In an example embodiment, active alignment can be used to ensure that
system 10 operates close to the zero of the periodic function. -
FIG. 13 illustrates an example embodiment ofsystem 10 that employs two detectors 200 (200U, 200L) disposed adjacent upper andlower surfaces Detectors - In
FIG. 13 , the distance Dx denotes the period of the bouncing, by locating two detectors shifted by Dx/4+n Dx (n integer), the expectation is that the signal modulation versus the applied force will be out of phase by one quarter of the signal period. - In an example embodiment such as illustrated in
FIG. 13 , two ormore detectors 200 can be employed on one or both of upper andlower surfaces detectors 200 are used. Two of the threedetectors 200 can be disposed on upper andlower surfaces adjacent output edge 26 while the third can be arranged at or near the middle ofwaveguide 22 on either the upper or lower surface. Simulations indicate that such a configuration allows for the detection of three periodic detector signals SD that are out of phase, and with the relative phases changing as a function of the amount of bending inwaveguide 22. - In one aspect of the operation of
system 10, light rays 104-n are launched intowaveguide 22 and the output irradiance profile is measured based on output light 104-O, which can be outputted from one or more ofoutput end 24 and upper andlower surfaces beams 104 are propagating at two different angles, they can interfere and create high-frequency fringes. These fringes are visible when using a high magnification to image the output beam on a CCD camera. - In practice, output light 104-O can define fringes having relatively high frequencies. In the case where an aperture-limited detection scheme is used, the aperture 214 use to filter the output light 104-O is generally much larger than the fringe period. In this case, the detection is only sensitive to the motion of the envelope of the output light beam.
- If the
input light beam 104 can be aligned precisely with central axis AC ofwaveguide 22, low frequency fringes will arise, and the pinhole will filter the fringes. So, on top of detecting the motion of the beam envelope, the system will also start detecting the lower-frequency fringes. -
FIG. 14 shows a series of simulated images of output light beams 104-O obtained by summing electric fields of the light rather than the intensity. In the simulation, the waveguide thickness was TH=1.2 mm and theinput beam 104 was collimated and normally incident theinput end 23, with the illumination overfilling the input end. The degree of bending is shown above each image. - As can be seen, when waveguide 20 starts bending, fringes appear in the pattern and generally add to the general motion of the envelope. Assuming that the near-field filtering element is smaller than the period of the fringes, the high frequency modulation can be detected making this measurement regime much more sensitive than when just detecting the motion of the beam envelope.
- Waveguide with Cladding Layers
- In an embodiment of
system 10, light 104 is injected close to the direction of the waveguide (i.e., substantially collimated), so that the light is very well guided.FIG. 15 illustrates an example embodiment ofsystem 10 that includes at least one of upper and alower cladding layers 26C and 27C, respectively.Cladding layers 26C and 27C have a refractive index slightly lower than the index ofwaveguide 22, thereby serving to enhance the waveguiding properties of the waveguide. This allows for an adhesive layer (e.g., epoxy bond) to be applied to one or both of the cladding layers, or to add an anti-glare layer or other such performance-enhancing layer or layers on the upper or lower sides ofwaveguide 22 without disturbing the propagation oflight 104 therein. - The
touch system 10 can be improved by the additional use of polarization optics configured to a detect polarization effects, such as a change in the polarization state of output beam 104-O. This is made possible by changes in the birefringence inwaveguide body 25 and thus along the optical path of light 104 as it traverses the waveguide. - Birefringence is the optical property of a material wherein the material refractive index depends on the polarization and propagation direction of light. Birefringence is also known as photoelasticity. Certain birefringent optical materials such as glass are optically anisotropic due to mechanical stress, while many crystals are birefringent due to their crystal structure. In the case of single-axis mechanical stress, the value of birefringence is the difference of the refractive index for light oscillating in the parallel direction of the stress and that oscillating in the perpendicular direction.
- The difference in the optical path between light oscillating in two orthogonal directions is known as the retardation (Ret) of the beam. If a beam is linearly polarized and aligned so that the oscillation is in the direction of the stress, or perpendicular to the stress, then no retardation is detected since only one index is observed. The amount of retardation is proportional to the mechanical stress and the stress optical coefficients (K). The stress optical coefficient varies with glass types, and varies much less with temperature and wavelength.
- The amount of retardation Ret can be calculated by the relation:
-
- where Ret is the retardance in waves, n is the refractive index relative to the stress direction, d is the optical path length, λ is wavelength, a is the mechanical stress (which is positive for tensile stress and negative for compressive stress), and K is the optical stress coefficient. The units of a is N/mm2, or MPa (mega-Pascals). The units of K are mm2/N. The common glass type BK7 has a K of ˜2.8×10−6, and the table below is an example of the calculation of retardance due to stress birefringence over path lengths (distance) and pressures for a near infrared (IR) wavelength.
- A simple implementation of polarization detection is shown in
FIG. 16 .Finger 50 is shown giving rise to a touch event that createpressure 550 inwaveguide body 25 at and around touch location TL. Afirst polarizer 501 is disposed betweenlight source 100 andinput edge 24.Polarizer 501 is configured to linearly polarize light 104 in a direction 45° to the prominent direction ofpressure 550, which is perpendicular toupper surface 22 ofwaveguide 20. In an example, light 104 is substantially collimated to travel parallel to central axis AC. -
System 10 also includes a second polarizer 511 (also called an “analyzer”) disposed betweenoutput edge 24 anddetector 200, e.g., immediatelyadjacent detector 200.Detector 200 can be considered in some embodiments to consist of two detectors, denoted 200-A and 200-B. In an example embodiment,second polarizer 511 is arranged in the same 45° at thefirst polarizer 501 so that in the absence of any polarization rotation oflight 104, the detector signal is maximum. However,second polarizer 511 can have any polarization orientation. - When
pressure 550 is applied towaveguide 20, the retardance Ret of light changes 104. This means that the transmission of thepolarizer 511 changes and the detector signal SDA from detector 200-A changes. - If second (detector) polarizer 511 is oriented at +45° to the y-axis and is parallel to the first (source) polarizer 501, then the detector signal SD as normalized to the maximum signal prior the application of
pressure 550 will be equal to 1. - If the aforementioned second detector 200-B is employed and includes its
own detector polarizer 512 that is orientated at −45° to the y-axis and 90° topolarizer 511, then the detector signal SDB from detector 200B will be zero while nopressure 550 is being applied. This assumes that under no additional pressure from the mounting of the glass, and that the glass is birefringent free in fabrication, which will be discussed later. -
FIG. 17 plots the detector signals SDA and SDB of detectors 200-A (“det A) and 200-B (“det B”) versus the induced stress retardance along the optical path due to compression by thepressure 550. The linearlypolarized light 104 that entersinput edge 23 becomes more elliptically polarized as the retardance along the optical path OP increases from zero, and becomes circular when the retardance reaches a quarter of a wave. At this point, the transmission of the twoorthogonal polarizers - When the
pressure 550 increases to the point where it generates a half-wave retardance inwaveguide body 25, then light 104 reverts to being linear polarized but rotated 90° relative to the source polarization. At this point, the transmission ofpolarizer 511 is zero, and the transmission ofpolarizer 12 is 1. The transmission of the two polarizers versus retardance is sinusoidal, with the two being perfectly out of phase. - An advantage of having two detectors 200-A and 200-B that detect orthogonal polarizations is that the summation and difference of the two detector signals SDA and SDB can be employed. One detector can determine the magnitude of the retardance Ret from the pressure, but the summation of the two detector signals provides the total intensity of the incident light on the detectors. This allows the information of the retardance change and the steering of the beam off of or onto the detectors to isolate the position (touch location TL) and the amount of
pressure 550 associated with touch event TE. The difference of the detector signals SDA and SDB is more sensitive to changes in retardance and also assists in the isolation of beam steering and retardance components of the detector signal. -
FIG. 18A-18E are images that show the measured results of energy profiles imaged through an analyzer (polarizer 511) as aglass waveguide 20 undergoes bending. As inFIG. 6G where there was no analyzer, the beam moves as the waveguide is bent. However, superimposed on this motion, the shape and power are also changing, which indicates that the polarization oflight 104 is changing due to the birefringence along the optical path OP. This demonstrates the advantage of having two detectors 200-A and 200-B to track the signal changes of the beam steering and the birefringence. Thefirst image 18A is with nopressure 550, with thesubsequent images 18B-18E taken with increasing pressure. The image strength (which corresponds to the detector signal SD) is greatly reduced at the amount of pressure applied inFIG. 18E , indicating that around a half-wave of retardance was introduced by the stress birefringence. - In an example embodiment,
system 10 optionally includes a quarter-wave waveplate 503 (shown in phantom) disposed between source polarizer 501 andinput edge 23 ofwaveguide 20. Ifwaveplate 503 is arranged with its fast axis oriented at 45° to the source polarizer axis, then circularpolarized light 104 will be injected intowaveguide 20. This allows for greater sensitivity to birefringence changes near zero retardance. The detector signals SDA and SDB associated with detectors 200-A and 200-B can be described by the plot ofFIG. 17 if the horizontal axis is shifted by 0.25λ, so that zero retardance location is moved to where the detector signals SDA and SDB are equal. In this configuration, the difference of the two detector signals SDA and SDB is at the location of highest slope so that the ratio of the two detector signals provide even higher sensitivity. Near zero retardance, the slope of the ratio of the normalized detector signals for detectors 200-A and 200-B is 4n. - The difference between the two linear orthogonal polarizations is defined by one of the four Stokes parameters for characterizing the state of polarization. An
example touch system 10 includes four detectors with quarter-wave plates (not shown) placed just downstream ofdetector polarizers detectors 200 detects right-handed circularly polarized light and the other detects left-handed circularly polarized light. The difference in the signals between the two detectors defines another one of the Stokes parameters. - These different polarizers and quarter-wave plates can be placed in front of the four sections of a quad-
cell detector 200. Measuring two Stokes parameters provides not only information on the retardance of thebeam 104, but also the mean rotation of the stress vectors along the optical path as projected in the plane perpendicular to the optical path. The additional information provided by the two added detectors can be used in isolating touch locations TL and the amounts ofpressure 550 applied at the touch locations during a touch event TE. - An example embodiment of
system 10 ofFIG. 16 includes at least onesupport member 520 operably arranged and configured to supportwaveguide 20. An embodiment of asupport member 520 covers the entirelower surface 24 ofwaveguide 20 and is relatively inflexible.Support member 520 serves to constrain the motion ofwaveguide 20 so thatpressure 550 produces compressive stress at the touch location TL where the pressure is applied, as well as in a surrounding portion ofwaveguide body 25.Support member 520 can also be in the form of a frame or have another configuration other than that of a plenum, as long as the support member enhances the compressive stress produces bypressure 550 as compared to having no support member. -
FIG. 19A is a schematic cross-sectional view ofsystem 10, wherein two frame-line support members 520 are operably arranged on the upper andlower surfaces waveguide 20 near perimeter P (seeFIG. 1 ). Thepressure 550 from any touch event TE will predominantly bendwaveguide 20 and will lead to compressive and tensile stress over thewhole waveguide body 25. The set ofvectors 551 shown along optical path OP are representative of the direction of the stress and how it varies overwaveguide body 25 due topressure 550. The retardance from the optical path differences is additive and so tensile and compressive regions will compensate each other. - The compressive stress near the touch location TL will add as vectors to the broader compressive or tensile pressure of the bending of
waveguide 20. The relative weighting of the vector summation of the two sources of stress will depend on the constraints provide by the at least onesupport member 520. The additive nature of the retardance experienced bylight beam 104 as it travels over optical path OP produces a continuous change in retardance versus touch pressure. - Glass under no mounting constraints or external pressure will typically have some amount of birefringence from the fabrication of the glass. Localized stress regions can be formed in the process of cooling down the glass into a solid state. Glass used in high-performance imaging systems often requires weeks of annealing to obtain the high degree of homogeneity of index that is needed and resultant the low stress birefringence, which is typically <2 nm/cm. In the near IR, this amount of stress produces 1/100th of a wavelength per 50 mm of path length.
- With reference to
FIGS. 19B and 19C ,stress regions 552 are formed on both the upper and lower sides of aglass plate 20 that is chemically harden by ion exchange. Instead of illustrating the stress distribution by vectors as inFIG. 19A , the darkness of the shading represents the magnitude of the stress, with the darker color indicating greater stress. The difference betweenFIGS. 19A and 19B is thatpressure 550 bends the glass (FIG. 19C ), and alters the path of light 104 through a region of higher fabrication-induced stress birefringence. The fabrication-induced stress ofregions 552 add by the nature of vectors to the near region compressive stress and the bending stresses. The additive nature of the retardance of beam of light will produce a continuous change in retardance versus touch pressure. -
FIGS. 28A through 28C provide supplemental information for the polarization-based embodiments described herein. -
FIG. 20 is a schematic side view of anexample touch system 10 whereinwaveguide 20 is now in the form of a glass sheet that includes a relativelythin waveguide region 29 adjacentupper surface 22.Waveguide region 29 serves as a relatively thin optical waveguide as compared to the entire bulk ofbody 25 serving as the waveguide as described in various example embodiment above. -
Waveguide region 29 can be formed using ion-exchange or a laminated fusion draw process or any other technique known in the art for forming thin waveguide structures on a substrate. In an example,light source 100 is optically coupled towaveguide region 29 via a section ofoptical fiber 123 that has one end butt-coupled to the waveguide input end at input edge 23 (hereinafter, waveguide input end 23).Detector 200 is optically coupled with or is otherwise in optical communication withwaveguide region 29 at output edge 24 (hereinafter, waveguide output end 24). - Thus, light 104 travels within
waveguide region 29 as guided light and it outputted fromwaveguide output end 24 at output light 104-O. Sincewaveguide region 29 is much thinner than thebulk waveguide body 25, the light-guiding is best described using electromagnetic theory rather than a geometric light ray approach that ignores diffraction and like effects. - In an experiment based on the configuration of
touch system 10 ofFIG. 20 , a pigtailed laser diode as used aslight source 100. Gorilla® glass was used forglass sheet 20 and an ion-exchange process was used to formwaveguide region 29. Since the refractive index of the waveguide region is higher than that ofbody 25, light is guided withinwaveguide region 29, which defines a thin slab waveguide.Waveguide region 29 had a thickness of about 50 μm, which is much thinner than glass sheet. Thus,waveguide region 29 supports multiple modes, though far fewer modes than when the entirety of the glass sheet is used as a waveguide. - Once a touching force is applied to
upper surface 22 ofglass sheet 20, the relative phase difference among the different modes traveling withinwaveguide region 29 are changed. This serves to alter the character of output light 104-O, which in the present instance is representative of an interference pattern. In particular, the light distribution in output light changes. A quantitative relationship between the collected (light) power P (nW) as collected by a multimode fiber versus the magnitude of touching force (Newtons) is plotted inFIG. 21 .Light 104 was propagated through the glass center. It is clear that different portions of glass sheet (edge vs. center) have different touching sensitivity, and this difference can be used to determine the touch location TL where the force is applied during a touch event TE. -
FIG. 22 is a top-down view of an alternate configuration forwaveguide regions 29 as formed onglass sheet 20. Rather than being configured as surface slab waveguides,waveguide regions 29 can be configured as channel waveguides, as shown. Thechannel waveguide regions 29 can be configured sculptured within the glass or atop the glass.FIG. 23 also shows an alternative embodiment forchannel waveguide regions 29 that shows two branching networks (fan-outs) associated with two pairs oflight sources 100 anddetectors 200. It is noted the spacing of thechannel waveguide regions 29 need not be uniform and can be concentrated in certain locations that are generally associated with where touch events TE are either more likely to occur or that are designated to occur. - Depending on the particular patter of
channel waveguide regions 20, differentlight sources 100 anddetectors 200 can be employed to detect an applied force and the (x, y) touch location TL. - An aspect of the disclosure is utilizing the time response of two or
more detectors 200 to identify the touch location TL of a touch event TE. This technique can be used because the deformation of waveguide/glass sheet 20 proceeds outward from the touch location as a function of time. This in turn has a different impact on different optical paths that light rays 104 take through the waveguide. The result is a delay in the detector signals of the two detectors. -
FIG. 24 plots the amplitude AMP of the detector signal (arbitrary units) vs. time t for two different detectors (A and B in the plot) for two different touch events TE at different locations on the waveguide/glass sheet 20. The time lag between the A and B signals can be correlated with different locations on waveguide/glass sheet 20. The optical path closest to the touch event location TL responds first, giving rise to the time lag in detector signals. Thus, in an example embodiment,controller 300 includes information about various time lags associated with detector signals forvarious detectors 200 as a function of possible touch locations TL. In another example,controller 300 is configured to calculate the touch location TL based on the information in one or more detector signals. -
FIG. 25A is a schematic elevated view of an example pressure-sensing display 400 formed by operably arrangingtouch system 10 adjacent and above (e.g., atop) aconventional display unit 410, such as a liquid crystal display, which display may have conventional position-based sensing capability.Touch system 10 can be any of the embodiments described herein. -
FIG. 25B is a schematic cross-sectional, partial exploded view of an example touch-sensitive display 400 illustrating an example of how to integratetouch system 10 withconventional display unit 410. Theconventional display unit 410 is shown in the form of a liquid crystal display that includes abacklighting unit 414 that emits light 416, a thin-film transistor (TFT)glass layer 420, aliquid crystal layer 430, a colorfilter glass layer 450 with aupper surface 452, and atop polarizer layer 460 with aupper surface 462, all arranged as shown. Aframe 470 is disposed around the edge of colorfilter glass layer 450.Light source 100 is shown by way of example as being operably supported withinframe 470. This forms anintegrated display assembly 480 having atop side 482. - To form the final touch-
sensitive display 400,assembly 20 is added tointegrated display assembly 480 ofconventional display unit 410 by operably disposing the assembly ontop side 482. Theassembly 20 can include theaforementioned cover 40 in the form of an IR-transparent but visibly opaque layer disposed adjacentlight source 100 anddetector 200. - In an example, various indicia or indicium (not shown) such as a keyboard (not shown) may be presented to
user 500 on or throughupper surface 26 to guide the user to interact withtouch system 10. By way of example, the indicium may include areas onupper surface 26 ofwaveguide 22 that are set aside for indicating user choices, software execution, etc., or to indicate a region where the user should create touch event TE. Such region, for example, might be required where light 104 does not reach certain portions ofupper surface 26. - In some applications of
touch system 10, as the applied force (pressure) at touch location TL is increased, the at least onedetector 200 may not respond uniformly (smoothly) to the intensity changes in output light 104-O. Accordingly, aspects of the disclosure are directed to estimating the applied force in such cases using various embodiments and configurations for the detection of output light 104-O. - In an example embodiment illustrated in
FIGS. 26A and 26B ,touch system 10 can include a sloped attenuation filter (attenuator) 125 in front ofdetector 200.Sloped attenuator 125 can be formed from glass configured with an attenuation that changes uniformly from the bottom edge to top edge.FIG. 26B is an example plot of the transmission T vs. height ofattenuator 125. Since the overall power hitting the light-sensitive area of thedetector 200 is substantially constant, the sloped attenuation will cause that detector signal SD to change with the vertical “center of mass” of output light 104-O. This allows for the detector signal SD to be correlated with applied pressure. - In some cases, the detector response to the applied pressure at the touch location may not be completely monotonic. For example, the image can move in one direction until the pressure reaches certain amount and then jump to the other edge of glass (detector). Since the monotonic range is not too small and touch force does not change instantly, an aspect of the disclosure includes performing a method to “unwrap” the measurements.
- The method assumes that the detector signal SD is sampled sufficiently fast, e.g., 60 Hz or faster and the force is reasonably large (e.g., 100 g) and applied monotonically vs. impulsively. Also:
-
- Whenever capacitive touch senses no touches, reset accumulated measure value to 0.
- If new position is reasonable close to old position, one can use new position as valid measurement. If old position was close to end of monotonic range, and new position jumps to other end of range, add entire range to most recent measurement.
- If old position was close to beginning of monotonic range and we have estimate bigger than one range, and new position jumps to other end of range, subtract entire range to obtain most recent estimate.
- Another aspect of the disclosure employs fringe-motion detection. Since the fringes in output light 104-O tend to move uniformly with pressure, one can employ a vertical stripe (linear array) of CMOS or CCD cells. It would be sufficient to use few tens of cells. A typical 2D array pixel-based
detector 200 has thousands of cells. Thelinear array detector 200 can provide a vertical intensity profile of output light 104-O. The intensity profile has two components: One is slow changing that typically has one or two peaks, while the second represents fast changing fringes. - In an example embodiment, a filter is used to eliminate the slow-changing component. The remaining fast-changing component shows peaks corresponding to fringes. If the fringe profile is sampled fast enough (e.g., 60 Hz), the difference in phase between consecutive frames can be computed. Integrating the differences yields a detector signal SD that is representative (e.g., proportional) to the applied pressure at the touch location TL.
- Thus, example detector measurement configurations and methods include the following performed during a touch event where pressure is being applied at a touch location TL:
-
- Integrate total power (equivalent of large area detector). Call this configuration TOTAL
- Integrate small area in the middle of image (equivalent of small pinhole1). Call this configuration PINHOLE1
- Integrate small area just above middle of image (equivalent of small pinhole2). Call this configuration PINHOLE2.
- Integrate large area with attenuation vertical change 20:1 (largest attenuation at top of image). Call this SLOPE1 configuration.
- Integrate large area with attenuation vertical change 20:1 (largest attenuation at bottom of image). Call this SLOPE2 configuration.
-
FIG. 27A is a plot of the detector signal SD (arbitrary units) vs. frame # F for the total integrated power, i.e., TOTAL signal (blue) and an integrated power of a small area in the middle of the detector, i.e.,PINHOLE 1 signal (orange). -
FIG. 27B is a plot of the detector signal SD (arbitrary units) vs. frame # for the total integrated power, i.e., TOTAL signal (blue) and an integrated power of a small area just above the middle of the detector, i.e.,PINHOLE 2 signal (orange). -
FIG. 27C is a plot of the detector signal SD (arbitrary units) vs. frame # for the total integrated power, i.e., TOTAL signal (blue) and signal with linear attenuation filter (high attenuation at top of image), i.e., SLOPE 1 (orange). -
FIG. 27D is a plot of the detector signal SD (arbitrary units) vs. frame # for the total integrated power, i.e., TOTAL signal (blue) and signal with linear attenuation filter (high attenuation at bottom of image), i.e., SLOPE 1 (orange). - Of the four different signal plots of 27A through 27D, SLOPE2 and then PINHOLE1 are suitable candidates for use in assessing amounts of applied pressure at the touch location. Also, the PINHOLE signals are location sensitive and so can be used to determine the position of the touch location TL.
- Although the embodiments herein have been described with reference to particular aspects and features, it is to be understood that these embodiments are merely illustrative of desired principles and applications. It is therefore to be understood that numerous modifications may be made to the illustrative embodiments and that other arrangements may be devised without departing from the spirit and scope of the appended claims.
Claims (20)
1. A pressure-sensing touch system for detecting a touch event caused by the application of an amount of pressure at a touch location, comprising:
a waveguide having an upper surface, a lower surface, an input edge and an output edge, wherein the waveguide is bendable when pressure is applied at the touch location;
a light source system in optical communication with the input edge and configured to introduce light into the waveguide that defines output light at the output edge, wherein the output light has an associated intensity distribution, and where bending the waveguide from the application of the amount of pressure causes a change in the intensity distribution.
a detector system in optical communication with the output edge and configured to detect at least a portion of the output light that exits the output edge and detect the change in the intensity distribution upon bending the waveguide, and in response thereto generate a detector signal; and
a controller operably connected to and configured to control the operation of the light source system and the detector system, and further configured to process the detector signal to determine whether a touch event has occurred.
2. The pressure-sensing touch system of claim 1 , wherein the waveguide has a thickness in a range from 0.05 mm to 1.5 mm.
3. The pressure-sensing touch system of claim 1 , where the light source system includes multiple light sources and the detector system includes multiple detectors.
4. The pressure-sensing touch system of claim 1 , wherein the waveguide has a thickness and wherein the detector system includes at least one detector and at least one aperture arranged adjacent the at least one detector, wherein the at least one aperture has a dimension that is smaller than the glass thickness
5. The pressure-sensing touch system of claim 1 , wherein the waveguide has a thickness and wherein the detector system includes at least one detector having a photosensitive area that is smaller in at least one direction than the waveguide thickness.
6. The pressure-sensing touch system of claim 1 , wherein the light source system includes an input optical system having one of an input optical fiber, an input prism, an input grating and an angled input edge, and wherein the detector system includes an output optical system having one of output optical fiber, an output prism, an output grating and an angled output edge.
7. The pressure-sensing touch system of claim 1 , wherein the detector system includes at least one detector operably arranged on the upper surface of the waveguide adjacent the output edge.
8. The pressure-sensing touch system of claim 7 , wherein the detector system includes at least one detector operably arranged on the lower surface of the waveguide adjacent the output edge, wherein the detectors on the upper and lower surface are arranged to provide respective detector signals that are out of phase.
9. The pressure-sensing touch system of claim 1 , wherein the light source has a divergence lower than 5 degrees in at least one direction
10. The pressure-sensing touch system of claim 1 , wherein the light source includes an LED or a VCSEL.
11. The pressure-sensing touch system of claim 1 , wherein the light source emits light of a select polarization, and wherein the detector system includes a detector polarizer, and wherein the detector signal is representative of an amount of induced birefringence caused by said application of pressure at the touch location.
12. The pressure-sensing touch system of claim 1 , wherein the change in the intensity distribution in the output light includes the movement of intensity fringes, and wherein the detector detects the movement of the intensity fringes to determine the amount of pressure associated with the touch event.
13. The pressure-sensing touch system of claim 12 , further including an aperture arranged adjacent the detector to make the detection aperture limited.
14. The pressure-sensing touch system of claim 12 , further including a sloped attenuator arranged adjacent the detector to make the detection of output light position-sensitive on the detector.
15. The pressure-sensing touch system of claim 1 , wherein:
the light source emits light of a select polarization,
the detector system includes a detector polarizer, and
the detector signal is representative of an amount of change in the polarization state from the path altering through different birefringent regions of the glass caused by said application of pressure at the touch location.
16. The pressure-sensing touch system of claim 15 , wherein the change in polarization is from induced birefringence and the change of the path of light through different regions of existing birefringence that are formed in the fabrication of the glass.
17. The pressure-sensing touch system of claim 1 , wherein:
the light source emits light of a select polarization, and
the detector system includes multiple detectors with different polarizing optics in front of each that allow the detection of the polarization state of the emitted light from the glass.
18. The pressure-sensing touch system of the claim 17 , wherein one or more of
the magnitude of retardance from the input polarization;
the retardance from the input polarization;
the percentage of the light that is polarized; and
the magnitude of the intensity the emitted light from the glass is detected.
19. A method of sensing an application of pressure for a touch event at a touch location on a flexible waveguide, comprising:
sending light over multiple optical paths from an input edge to an output edge of the flexible waveguide to form output light having an intensity distribution at the output edge;
flexing the waveguide by applying pressure to the waveguide, thereby causing a change in the multiple optical paths to cause a change in an intensity distribution of the output light;
detecting the change in the intensity distribution and generating a detector signal representative thereof; and
processing the detector signal to associate the change in intensity distribution with the application of pressure at the touch location.
20. The method of claim 19 , wherein detecting the change in the intensity distribution include detecting the output light in a near-field relative to the output edge.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US16/298,538 US20190324592A1 (en) | 2012-10-04 | 2019-03-11 | Pressure sensing touch systems and methods |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201261744877P | 2012-10-04 | 2012-10-04 | |
US14/043,158 US20140210770A1 (en) | 2012-10-04 | 2013-10-01 | Pressure sensing touch systems and methods |
US15/591,528 US10228799B2 (en) | 2012-10-04 | 2017-05-10 | Pressure sensing touch systems and methods |
US16/298,538 US20190324592A1 (en) | 2012-10-04 | 2019-03-11 | Pressure sensing touch systems and methods |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/591,528 Continuation US10228799B2 (en) | 2012-10-04 | 2017-05-10 | Pressure sensing touch systems and methods |
Publications (1)
Publication Number | Publication Date |
---|---|
US20190324592A1 true US20190324592A1 (en) | 2019-10-24 |
Family
ID=49448299
Family Applications (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/043,158 Abandoned US20140210770A1 (en) | 2012-10-04 | 2013-10-01 | Pressure sensing touch systems and methods |
US15/591,528 Active US10228799B2 (en) | 2012-10-04 | 2017-05-10 | Pressure sensing touch systems and methods |
US16/298,538 Abandoned US20190324592A1 (en) | 2012-10-04 | 2019-03-11 | Pressure sensing touch systems and methods |
Family Applications Before (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/043,158 Abandoned US20140210770A1 (en) | 2012-10-04 | 2013-10-01 | Pressure sensing touch systems and methods |
US15/591,528 Active US10228799B2 (en) | 2012-10-04 | 2017-05-10 | Pressure sensing touch systems and methods |
Country Status (7)
Country | Link |
---|---|
US (3) | US20140210770A1 (en) |
EP (1) | EP2904477A1 (en) |
JP (1) | JP2015530688A (en) |
KR (1) | KR102211188B1 (en) |
CN (1) | CN105009046B (en) |
TW (1) | TW201435689A (en) |
WO (1) | WO2014055809A1 (en) |
Families Citing this family (55)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
SE533704C2 (en) | 2008-12-05 | 2010-12-07 | Flatfrog Lab Ab | Touch sensitive apparatus and method for operating the same |
GB201014053D0 (en) * | 2010-08-23 | 2010-10-06 | St Microelectronics Res & Dev | Optical navigation device |
US10168835B2 (en) | 2012-05-23 | 2019-01-01 | Flatfrog Laboratories Ab | Spatial resolution in touch displays |
WO2014168567A1 (en) | 2013-04-11 | 2014-10-16 | Flatfrog Laboratories Ab | Tomographic processing for touch detection |
TW201510823A (en) * | 2013-09-11 | 2015-03-16 | Wintek Corp | Optical touch panel and touch display panel |
WO2015108480A1 (en) | 2014-01-16 | 2015-07-23 | Flatfrog Laboratories Ab | Improvements in tir-based optical touch systems of projection-type |
WO2015108479A1 (en) | 2014-01-16 | 2015-07-23 | Flatfrog Laboratories Ab | Light coupling in tir-based optical touch systems |
HUE038106T2 (en) * | 2014-05-12 | 2018-09-28 | Agc Glass Europe | Glass sheet having a high transmission in the infrared for touch panel |
KR102253308B1 (en) * | 2014-06-12 | 2021-05-18 | 전진홍 | System for analyzing 3-dimentsional vector of force |
US10161886B2 (en) | 2014-06-27 | 2018-12-25 | Flatfrog Laboratories Ab | Detection of surface contamination |
TWI525511B (en) * | 2014-08-06 | 2016-03-11 | Infilm Optoelectronic Inc | Light guide plate optical touch device |
US11182023B2 (en) | 2015-01-28 | 2021-11-23 | Flatfrog Laboratories Ab | Dynamic touch quarantine frames |
US10318074B2 (en) | 2015-01-30 | 2019-06-11 | Flatfrog Laboratories Ab | Touch-sensing OLED display with tilted emitters |
WO2016130074A1 (en) | 2015-02-09 | 2016-08-18 | Flatfrog Laboratories Ab | Optical touch system comprising means for projecting and detecting light beams above and inside a transmissive panel |
EP3265855A4 (en) | 2015-03-02 | 2018-10-31 | FlatFrog Laboratories AB | Optical component for light coupling |
US9542037B2 (en) | 2015-03-08 | 2017-01-10 | Apple Inc. | Device, method, and user interface for processing intensity of touch contacts |
KR101668225B1 (en) * | 2015-06-01 | 2016-10-24 | (주)이미지스테크놀로지 | A pressure sensing device using a touch screen panel |
KR101656243B1 (en) * | 2015-06-03 | 2016-09-12 | (주)이미지스테크놀로지 | A pressure sensing device using bottom-layer pressure sensitive channel on the 2-layer structure touch screen panel |
KR101659281B1 (en) * | 2015-06-03 | 2016-09-26 | (주)이미지스테크놀로지 | A pressure sensing device for increasing the accuracy of pressure location by using assigned channel of display area on the 2-layer structure touch screen panel |
TWI567606B (en) * | 2015-07-17 | 2017-01-21 | 林志忠 | Touch display device |
US9786248B2 (en) | 2015-08-07 | 2017-10-10 | Chih-Chung Lin | Touch display device with pressure sensor |
US10001882B2 (en) * | 2015-12-02 | 2018-06-19 | Rapt Ip Limited | Vibrated waveguide surface for optical touch detection |
US10775937B2 (en) | 2015-12-09 | 2020-09-15 | Flatfrog Laboratories Ab | Stylus identification |
TWI579534B (en) * | 2015-12-16 | 2017-04-21 | 和碩聯合科技股份有限公司 | Pressure sensing system |
CN105786255B (en) | 2016-03-03 | 2018-11-06 | 京东方科技集团股份有限公司 | Pressure-sensing touch system and method and display system |
CN105892745B (en) * | 2016-03-31 | 2019-07-26 | 联想(北京)有限公司 | A kind of electronic equipment and its pressure detection method |
CN105912155B (en) * | 2016-04-01 | 2019-06-25 | 深圳市华星光电技术有限公司 | Electromagnetic touch screen and electromagnetic touch system |
KR101723895B1 (en) * | 2016-04-28 | 2017-04-06 | 한국광기술원 | Infrared touch screen system for enhancing accuracy of touch signal detection |
WO2017197337A1 (en) * | 2016-05-13 | 2017-11-16 | Synaptics Incorporated | Systems and methods for injecting light into cover glass |
US10663361B2 (en) * | 2016-10-13 | 2020-05-26 | The Trustees Of Columbia University In The City Of New York | Systems and methods for tactile sensing |
US10761657B2 (en) | 2016-11-24 | 2020-09-01 | Flatfrog Laboratories Ab | Automatic optimisation of touch signal |
CN116755580A (en) | 2016-12-07 | 2023-09-15 | 平蛙实验室股份公司 | touch sensing device |
CN116679845A (en) | 2017-02-06 | 2023-09-01 | 平蛙实验室股份公司 | Touch sensing device |
EP3602258B1 (en) | 2017-03-22 | 2024-05-08 | FlatFrog Laboratories AB | Pen differentiation for touch displays |
EP4036697A1 (en) | 2017-03-28 | 2022-08-03 | FlatFrog Laboratories AB | Optical touch sensing apparatus |
EP3435139A1 (en) * | 2017-07-25 | 2019-01-30 | Essilor International | Optical article with a holographic waveguide |
EP3676694A4 (en) | 2017-09-01 | 2021-06-09 | FlatFrog Laboratories AB | Improved optical component |
CN111356967A (en) * | 2017-12-26 | 2020-06-30 | 深圳市柔宇科技有限公司 | Flexible electronic device, deformation control method thereof, and storage medium |
US11567610B2 (en) | 2018-03-05 | 2023-01-31 | Flatfrog Laboratories Ab | Detection line broadening |
WO2019185510A1 (en) * | 2018-03-26 | 2019-10-03 | Seereal Technologies S.A. | Display device |
CN108549504B (en) * | 2018-04-17 | 2021-11-26 | 中芯集成电路(宁波)有限公司 | Touch sensing substrate and touch device |
WO2020080992A1 (en) | 2018-10-20 | 2020-04-23 | Flatfrog Laboratories Ab | Frame for a touch-sensitive device and tool therefor |
CN110243784B (en) * | 2018-11-21 | 2023-03-28 | 湖北大学 | Transparent ceramic elasto-optic coefficient testing method based on Stokes vector |
WO2020153890A1 (en) | 2019-01-25 | 2020-07-30 | Flatfrog Laboratories Ab | A videoconferencing terminal and method of operating the same |
TWI713987B (en) * | 2019-02-01 | 2020-12-21 | 緯創資通股份有限公司 | Optical touch panel and pressure measurement method thereof |
DE102019102612A1 (en) * | 2019-02-01 | 2020-08-06 | Carl Zeiss Jena Gmbh | Waveguide for a spatially resolved detection of a touch |
LU101144B1 (en) | 2019-03-01 | 2020-09-02 | Univ Braunschweig Tech | Optical Sensor |
EP4066089B1 (en) | 2019-11-25 | 2024-09-25 | FlatFrog Laboratories AB | A touch-sensing apparatus |
TWI726537B (en) * | 2019-12-16 | 2021-05-01 | 宏碁股份有限公司 | Bending damage detection apparatus for flexible display panel |
CN111157154B (en) * | 2020-01-07 | 2021-04-09 | 腾讯科技(深圳)有限公司 | Touch sensor, touch event detection method and device and intelligent robot |
WO2021162602A1 (en) | 2020-02-10 | 2021-08-19 | Flatfrog Laboratories Ab | Improved touch-sensing apparatus |
TWI767264B (en) * | 2020-06-24 | 2022-06-11 | 財團法人工業技術研究院 | Compression state measuring method and compression state measuring system |
US11573450B1 (en) | 2020-09-23 | 2023-02-07 | Apple Inc. | Electronic devices with chemically strengthened coherent fiber bundles |
US20230190579A1 (en) * | 2021-12-17 | 2023-06-22 | Evernorth Strategic Development, Inc. | Smart container |
KR102640163B1 (en) * | 2023-05-24 | 2024-02-23 | 주식회사 리스펙트 | Physical contact recognition method of touch sensor |
Citations (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5177802A (en) * | 1990-03-07 | 1993-01-05 | Sharp Kabushiki Kaisha | Fingerprint input apparatus |
US20010005004A1 (en) * | 1999-11-30 | 2001-06-28 | Akihide Shiratsuki | Irregular pattern detector |
US20040025091A1 (en) * | 2002-07-30 | 2004-02-05 | Totman Peter D. | Method and apparatus for detecting and determining event characteristics with reduced data collection |
US20040252091A1 (en) * | 2003-06-14 | 2004-12-16 | Massachusetts Institute Of Technology | Input device based on frustrated total internal reflection |
US20070034783A1 (en) * | 2003-03-12 | 2007-02-15 | Eliasson Jonas O P | Multitasking radiation sensor |
US20070125937A1 (en) * | 2003-09-12 | 2007-06-07 | Eliasson Jonas O P | System and method of determining a position of a radiation scattering/reflecting element |
US20090219261A1 (en) * | 2007-12-11 | 2009-09-03 | Joseph Jacobson | Touch-Sensitive Illuminated Display Apparatus and Method of Operation Thereof |
US20100002995A1 (en) * | 2008-07-01 | 2010-01-07 | Nitto Denko Corporation | Optical touch panel and method for manufacturing the same |
US20100007622A1 (en) * | 2008-07-10 | 2010-01-14 | Nitto Denko Corporation | Optical touch panel |
US20100302210A1 (en) * | 2009-06-01 | 2010-12-02 | Han Jefferson Y | Touch Sensing |
US20110124648A1 (en) * | 2004-06-14 | 2011-05-26 | Eli Lilly And Company | Glucagon receptor antagonists, preparation and therapeutic uses |
US20110122091A1 (en) * | 2009-11-25 | 2011-05-26 | King Jeffrey S | Methods and apparatus for sensing touch events on a display |
US20120068970A1 (en) * | 2010-09-17 | 2012-03-22 | Nigel Patrick Pemberton-Pigott | Touch-sensitive display with depression detection and method |
US20130162555A1 (en) * | 2010-04-07 | 2013-06-27 | Opdi Technologies A/S | Touch-sensitive device and method for detection of touch |
US20140098306A1 (en) * | 2012-10-04 | 2014-04-10 | Corning Incorporated | Touch screen systems with interface layer |
Family Cites Families (134)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US3673327A (en) * | 1970-11-02 | 1972-06-27 | Atomic Energy Commission | Touch actuable data input panel assembly |
US4484179A (en) | 1980-04-16 | 1984-11-20 | At&T Bell Laboratories | Touch position sensitive surface |
US4542375A (en) | 1982-02-11 | 1985-09-17 | At&T Bell Laboratories | Deformable touch sensitive surface |
WO1983003314A1 (en) | 1982-03-16 | 1983-09-29 | Burroughs Corp | Fiber wrap keyboard and switch |
US4511760A (en) | 1983-05-23 | 1985-04-16 | International Business Machines Corporation | Force sensing data input device responding to the release of pressure force |
US4725978A (en) | 1983-05-30 | 1988-02-16 | Ichiro Fujioka | Graphic pattern inputting apparatus |
US4710760A (en) * | 1985-03-07 | 1987-12-01 | American Telephone And Telegraph Company, At&T Information Systems Inc. | Photoelastic touch-sensitive screen |
US4687885A (en) | 1985-03-11 | 1987-08-18 | Elographics, Inc. | Electrographic touch sensor with Z-axis capability |
US5222400A (en) | 1985-12-18 | 1993-06-29 | Spaceball Technologies Incorporated | Force and torque converter |
US4733068A (en) | 1986-04-07 | 1988-03-22 | Rockwell International Corporation | Crossed fiber optic tactile sensor |
CA1294802C (en) * | 1986-06-04 | 1992-01-28 | Benjamin J. Ainslie | Optical waveguides and their manufacture |
US4834480A (en) | 1988-04-21 | 1989-05-30 | Bell Communications Research, Inc. | Composite channel waveguides |
FI82989C (en) * | 1989-04-13 | 1991-05-10 | Nokia Oy Ab | FRAMEWORK FOR FRAMING REQUIREMENTS AND INSPECTION. |
JPH0377222A (en) | 1989-08-17 | 1991-04-02 | Sony Corp | Input device |
US5610629A (en) | 1991-12-06 | 1997-03-11 | Ncr Corporation | Pen input to liquid crystal display |
US5295205A (en) | 1993-03-29 | 1994-03-15 | Corning Incorporated | Environmentally stable monolithic Mach-Zehnder device |
US5351325A (en) | 1993-04-29 | 1994-09-27 | Corning Incorporated | Narrow band Mach-Zehnder filter |
US5712937A (en) | 1994-12-01 | 1998-01-27 | Asawa; Charles K. | Optical waveguide including singlemode waveguide channels coupled to a multimode fiber |
US5943458A (en) | 1995-06-09 | 1999-08-24 | Corning Incorporated | Mach-Zehnder interferometric devices with composite fibers |
GB2313195A (en) | 1996-05-02 | 1997-11-19 | Univ Bristol | Data entry device |
JPH10207616A (en) | 1997-01-20 | 1998-08-07 | Sharp Corp | Inputting device |
US6031520A (en) | 1997-04-04 | 2000-02-29 | De Gotari; Sergio Salinas | Substantially stationary pressure sensitive system for providing input to an electrical device, particularly a computer |
EP0901233B1 (en) | 1997-09-05 | 2005-03-02 | STMicroelectronics S.r.l. | Double sampled sigma delta modulator of second order having a semi-bilinear architecture |
DE59813354D1 (en) | 1997-09-08 | 2006-04-13 | Infineon Technologies Ag | Digital telecommunication device |
US6556149B1 (en) | 1999-03-01 | 2003-04-29 | Canpolar East Inc. | Switches and joysticks using a non-electrical deformable pressure sensor |
US7707082B1 (en) | 1999-05-25 | 2010-04-27 | Silverbrook Research Pty Ltd | Method and system for bill management |
CA2273113A1 (en) | 1999-05-26 | 2000-11-26 | Tactex Controls Inc. | Touch pad using a non-electrical deformable pressure sensor |
US6504530B1 (en) | 1999-09-07 | 2003-01-07 | Elo Touchsystems, Inc. | Touch confirming touchscreen utilizing plural touch sensors |
US6539156B1 (en) | 1999-11-02 | 2003-03-25 | Georgia Tech Research Corporation | Apparatus and method of optical transfer and control in plasmon supporting metal nanostructures |
US7157649B2 (en) | 1999-12-23 | 2007-01-02 | New Transducers Limited | Contact sensitive device |
AU2001212430A1 (en) | 2000-10-27 | 2002-05-06 | Elo Touchsystems, Inc. | Touch confirming touchscreen utilizing plural touch sensors |
KR20010096633A (en) * | 2001-04-18 | 2001-11-08 | 장광식 정윤철 | Touch Panel with Light Guide and manufacturing method thereof |
CA2353697A1 (en) | 2001-07-24 | 2003-01-24 | Tactex Controls Inc. | Touch sensitive membrane |
DE10139147A1 (en) | 2001-08-09 | 2003-03-06 | Siemens Ag | Optical touch screen for data display and command input has an evanescent field based on a two-dimensional waveguide for detection and localization of a pointing object or finger that overcomes drawbacks of existing technology |
CN1568452A (en) | 2001-10-09 | 2005-01-19 | 皇家飞利浦电子股份有限公司 | Device with touch sensible function |
KR20040062956A (en) * | 2001-11-01 | 2004-07-09 | 임머숀 코퍼레이션 | Method and apparatus for providing tactile sensations |
DE10158775B4 (en) | 2001-11-30 | 2004-05-06 | 3Dconnexion Gmbh | Arrangement for detecting relative movements or relative positions of two objects |
US6900795B1 (en) | 2002-02-27 | 2005-05-31 | Knight, Iii Jack | Unitary molded lens filter for touch screen interface |
US20040040800A1 (en) | 2002-07-31 | 2004-03-04 | George Anastas | System and method for providing passive haptic feedback |
US9195344B2 (en) | 2002-12-10 | 2015-11-24 | Neonode Inc. | Optical surface using a reflected image for determining three-dimensional position information |
US7685538B2 (en) | 2003-01-31 | 2010-03-23 | Wacom Co., Ltd. | Method of triggering functions in a computer application using a digitizer having a stylus and a digitizer system |
US7442914B2 (en) * | 2003-09-12 | 2008-10-28 | Flatfrog Laboratories Ab | System and method of determining a position of a radiation emitting element |
KR101098635B1 (en) | 2004-02-13 | 2011-12-23 | 큐알쥐 리미티드 | Capacitive Sensor |
US7042371B2 (en) | 2004-02-24 | 2006-05-09 | Nokia Corporation | Optical keyboard with geodesic optical elements |
US20060001654A1 (en) * | 2004-06-30 | 2006-01-05 | National Semiconductor Corporation | Apparatus and method for performing data entry with light based touch screen displays |
US7158054B2 (en) | 2004-09-21 | 2007-01-02 | Nokia Corporation | General purpose input board for a touch actuation |
US7417627B2 (en) | 2004-10-27 | 2008-08-26 | Eastman Kodak Company | Sensing display |
US8599140B2 (en) * | 2004-11-17 | 2013-12-03 | International Business Machines Corporation | Providing a frustrated total internal reflection touch interface |
US8130210B2 (en) | 2004-11-30 | 2012-03-06 | Avago Technologies Ecbu Ip (Singapore) Pte. Ltd. | Touch input system using light guides |
US7903090B2 (en) | 2005-06-10 | 2011-03-08 | Qsi Corporation | Force-based input device |
WO2006134552A2 (en) * | 2005-06-14 | 2006-12-21 | Koninklijke Philips Electronics N.V. | Flexible displays and user input means therefor |
CN101000529B (en) | 2006-01-13 | 2011-09-14 | 北京汇冠新技术股份有限公司 | Device for detecting touch of infrared touch screen |
US7951583B2 (en) * | 2006-03-10 | 2011-05-31 | Plc Diagnostics, Inc. | Optical scanning system |
CN101432647B (en) | 2006-05-01 | 2013-01-30 | Rpo私人有限公司 | Waveguide materials for optical touch screens |
US8144271B2 (en) * | 2006-08-03 | 2012-03-27 | Perceptive Pixel Inc. | Multi-touch sensing through frustrated total internal reflection |
WO2008018768A1 (en) * | 2006-08-10 | 2008-02-14 | Lg Chem, Ltd. | A light guide plate for system inputting coordinate contactlessly, a system comprising the same and a method for inputting coordinate contactlessly using the same |
US7920124B2 (en) | 2006-08-29 | 2011-04-05 | Canon Kabushiki Kaisha | Force sense presentation device, mixed reality system, information processing method, and information processing apparatus |
TWI355631B (en) | 2006-08-31 | 2012-01-01 | Au Optronics Corp | Liquid crystal display with a liquid crystal touch |
JP4294668B2 (en) | 2006-09-14 | 2009-07-15 | 株式会社日立製作所 | Point diagram display device |
WO2008034184A1 (en) | 2006-09-22 | 2008-03-27 | Rpo Pty Limited | Waveguide configurations for optical touch systems |
US8872085B2 (en) * | 2006-10-06 | 2014-10-28 | Qualcomm Mems Technologies, Inc. | Display device having front illuminator with turning features |
US20080088600A1 (en) | 2006-10-11 | 2008-04-17 | Apple Inc. | Method and apparatus for implementing multiple push buttons in a user input device |
US20080088597A1 (en) | 2006-10-11 | 2008-04-17 | Apple Inc. | Sensor configurations in a user input device |
KR101385969B1 (en) | 2007-03-21 | 2014-04-17 | 삼성전자주식회사 | Image forming apparatus |
FR2914756B1 (en) | 2007-04-05 | 2012-09-21 | Jazzmutant | TRANSPARENT MULTI-TOUCH SENSOR. |
US7666511B2 (en) | 2007-05-18 | 2010-02-23 | Corning Incorporated | Down-drawable, chemically strengthened glass for cover plate |
WO2008147929A1 (en) | 2007-05-22 | 2008-12-04 | Qsi Corporation | Touch-based input device providing a reconfigurable user interface |
US8917244B2 (en) | 2007-06-11 | 2014-12-23 | Honeywell Internation Inc. | Stimuli sensitive display screen with multiple detect modes |
EP2034287A1 (en) | 2007-09-10 | 2009-03-11 | Nederlandse Organisatie voor Toegepast-Natuuurwetenschappelijk Onderzoek TNO | Optical sensor for measuring a force distribution |
US20090124024A1 (en) * | 2007-11-07 | 2009-05-14 | Shingo Kasai | Optical-waveguide sensor chip, method of manufacturing the same, method of measuring substance, substance-measuring kit and optical-waveguide sensor |
JP4904249B2 (en) | 2007-11-15 | 2012-03-28 | 日東電工株式会社 | Optical waveguide for touch panel and touch panel using the same |
TWI380196B (en) | 2007-12-25 | 2012-12-21 | Pixart Imaging Inc | Method for detecting users' pressing action and optical operating unit |
US8179375B2 (en) | 2008-01-04 | 2012-05-15 | Tactus Technology | User interface system and method |
US8947383B2 (en) | 2008-01-04 | 2015-02-03 | Tactus Technology, Inc. | User interface system and method |
EP3138822B1 (en) | 2008-02-26 | 2023-07-26 | Corning Incorporated | Fining agents for silicate glasses |
US20090219253A1 (en) | 2008-02-29 | 2009-09-03 | Microsoft Corporation | Interactive Surface Computer with Switchable Diffuser |
US8553014B2 (en) | 2008-06-19 | 2013-10-08 | Neonode Inc. | Optical touch screen systems using total internal reflection |
US20100001978A1 (en) | 2008-07-02 | 2010-01-07 | Stephen Brian Lynch | Ambient light interference reduction for optical input devices |
US8075999B2 (en) | 2008-08-08 | 2011-12-13 | Corning Incorporated | Strengthened glass articles and methods of making |
JP2012500177A (en) | 2008-08-21 | 2012-01-05 | コーニング インコーポレイテッド | Durable glass housing / enclosure for electronic devices |
US8777099B2 (en) | 2008-08-29 | 2014-07-15 | The Invention Science Fund I, Llc | Bendable electronic device status information system and method |
KR101482125B1 (en) | 2008-09-09 | 2015-01-13 | 엘지전자 주식회사 | Mobile terminal and operation method thereof |
US10289199B2 (en) * | 2008-09-29 | 2019-05-14 | Apple Inc. | Haptic feedback system |
US20100103140A1 (en) * | 2008-10-27 | 2010-04-29 | Sony Ericsson Mobile Communications Ab | Touch sensitive device using optical gratings |
CN101739170A (en) | 2008-11-12 | 2010-06-16 | 鸿富锦精密工业(深圳)有限公司 | Touch panel component and touch panel system |
WO2010063320A1 (en) | 2008-12-03 | 2010-06-10 | Agc Flat Glass Europe Sa | Panel of glass comprising at least a sheet of glass, an exciter and a touch sensing device |
KR101521096B1 (en) | 2008-12-19 | 2015-05-18 | 삼성디스플레이 주식회사 | Display device |
JP5239835B2 (en) | 2008-12-24 | 2013-07-17 | 富士ゼロックス株式会社 | Optical waveguide and optical waveguide type touch panel |
US8384682B2 (en) * | 2009-01-08 | 2013-02-26 | Industrial Technology Research Institute | Optical interactive panel and display system with optical interactive panel |
CN102388354A (en) | 2009-02-17 | 2012-03-21 | 诺亚·安格林 | Floating plane touch detection system |
CN101539815A (en) | 2009-02-25 | 2009-09-23 | 韩鼎楠 | Multi-point touch screen operating tool |
KR20100102774A (en) | 2009-03-12 | 2010-09-27 | 삼성전자주식회사 | Touch sensing system and display apparatus employing the same |
US20100245288A1 (en) | 2009-03-29 | 2010-09-30 | Harris Technology, Llc | Touch Tunnels |
US8253712B2 (en) | 2009-05-01 | 2012-08-28 | Sony Ericsson Mobile Communications Ab | Methods of operating electronic devices including touch sensitive interfaces using force/deflection sensing and related devices and computer program products |
US20110032214A1 (en) | 2009-06-01 | 2011-02-10 | Qualcomm Mems Technologies, Inc. | Front light based optical touch screen |
US8624853B2 (en) * | 2009-06-01 | 2014-01-07 | Perceptive Pixel Inc. | Structure-augmented touch sensing with frustated total internal reflection |
US20100309169A1 (en) | 2009-06-03 | 2010-12-09 | Lumio Inc. | Optical Touch Screen with Reflectors |
WO2010146580A1 (en) | 2009-06-14 | 2010-12-23 | Micropointing Ltd. | Finger-operated input device |
KR101071672B1 (en) | 2009-06-23 | 2011-10-11 | 한국표준과학연구원 | Brightness controllable electro luminescence device with tactile sensor sensing intensity of force or intensity of pressure, flat panel display having the same, mobile terminal keypad having the same |
TWI398804B (en) | 2009-06-30 | 2013-06-11 | Pixart Imaging Inc | Displacement detection system of an optical touch panel and method thereof |
CN101957693B (en) | 2009-07-20 | 2013-04-24 | 鸿富锦精密工业(深圳)有限公司 | Touch control system |
US8390481B2 (en) | 2009-08-17 | 2013-03-05 | Apple Inc. | Sensing capacitance changes of a housing of an electronic device |
CN102004339B (en) * | 2009-09-02 | 2012-05-30 | 北京京东方光电科技有限公司 | Substrate and manufacturing method thereof, liquid crystal panel and manufacturing method thereof |
KR101697133B1 (en) | 2009-09-30 | 2017-02-01 | 베이징 아이어터치 시스템 코퍼레이션 리미티드 | Touch screen, touch system and method for positioning a touch object in a touch system |
JP4932895B2 (en) | 2009-11-12 | 2012-05-16 | 奇美電子股▲ふん▼有限公司 | Display device and electronic apparatus |
US8570297B2 (en) | 2009-12-14 | 2013-10-29 | Synaptics Incorporated | System and method for measuring individual force in multi-object sensing |
CN101751186B (en) | 2009-12-30 | 2011-12-21 | 鸿富锦精密工业(深圳)有限公司 | Touch electronic device and control method thereof |
KR101346456B1 (en) | 2010-03-31 | 2014-01-02 | 가시오게산키 가부시키가이샤 | Optical sensor device, display apparatus, and method for driving optical sensor device |
WO2011142075A1 (en) | 2010-05-12 | 2011-11-17 | 日本電気株式会社 | Information processing terminal, terminal operation method and computer-readable medium |
IT1400420B1 (en) | 2010-06-04 | 2013-05-31 | Maria De | SENSOR FOR THE MEASUREMENT OF AN EXTERNAL FORCE APPLIED TO THAT SENSOR. |
FR2963839B1 (en) | 2010-08-13 | 2012-08-17 | Delphi Tech Inc | CONTROL PANEL HAVING A RESISTIVE KEY |
KR101436771B1 (en) | 2010-08-27 | 2014-09-01 | 인텔 코포레이션 | Capture and recall of home entertainment system session |
US9513737B2 (en) | 2010-09-17 | 2016-12-06 | Blackberry Limited | Touch-sensitive display with optical sensor and method |
EP2439619B1 (en) | 2010-09-17 | 2019-07-17 | BlackBerry Limited | Touch-sensitive display with optical sensor and method |
EP2437144B1 (en) * | 2010-09-17 | 2018-08-29 | BlackBerry Limited | Touch-sensitive display with optical sensor and method |
US20120068939A1 (en) * | 2010-09-17 | 2012-03-22 | Nigel Patrick Pemberton-Pigott | Touch-sensitive display with depression detection and method |
EP2439620B1 (en) * | 2010-09-17 | 2018-04-11 | BlackBerry Limited | Touch-sensitive display with depression detection and method |
US20120071206A1 (en) | 2010-09-17 | 2012-03-22 | Nigel Patrick Pemberton-Pigott | Touch-sensitive display with optical sensor and method |
EP2437145A1 (en) * | 2010-09-17 | 2012-04-04 | Research In Motion Limited | Touch-sensitive display with depression detection and method |
TWI428804B (en) | 2010-10-20 | 2014-03-01 | Pixart Imaging Inc | Optical screen touch system and method thereof |
US9235303B2 (en) | 2010-12-20 | 2016-01-12 | Intel Corporation | Micro deflectors on touch sensor |
US8665244B2 (en) | 2011-02-22 | 2014-03-04 | Microsoft Corporation | Optical touch detection |
US9052765B2 (en) | 2011-08-31 | 2015-06-09 | Sony Corporation | Method for operating a touch sensitive user interface |
EP2748695B1 (en) | 2011-09-16 | 2019-01-02 | Sony Mobile Communications Inc. | Force sensitive touch sensor |
WO2013068651A2 (en) | 2011-11-11 | 2013-05-16 | Qitec Ltd | A touch sensitive operation interface |
WO2013081894A1 (en) | 2011-11-28 | 2013-06-06 | Corning Incorporated | Optical touch-screen systems and methods using a planar transparent sheet |
JP2015503159A (en) | 2011-11-28 | 2015-01-29 | コーニング インコーポレイテッド | Robust optical touch screen system and method of using a flat transparent sheet |
US8994694B2 (en) | 2011-11-30 | 2015-03-31 | Blackberry Limited | Optical interference based user input device |
WO2013089623A2 (en) * | 2011-12-16 | 2013-06-20 | Flatfrog Laboratories Ab | Tracking objects on a touch surface |
TWM436872U (en) | 2012-03-15 | 2012-09-01 | Univ China Sci & Tech | Improved optical touch panel including optic fiber for transmission |
US9880653B2 (en) * | 2012-04-30 | 2018-01-30 | Corning Incorporated | Pressure-sensing touch system utilizing total-internal reflection |
US9405382B2 (en) | 2012-07-24 | 2016-08-02 | Rapt Ip Limited | Augmented optical waveguide for use in an optical touch sensitive device |
US9041690B2 (en) | 2012-08-06 | 2015-05-26 | Qualcomm Mems Technologies, Inc. | Channel waveguide system for sensing touch and/or gesture |
US9134842B2 (en) * | 2012-10-04 | 2015-09-15 | Corning Incorporated | Pressure sensing touch systems and methods |
-
2013
- 2013-10-01 US US14/043,158 patent/US20140210770A1/en not_active Abandoned
- 2013-10-04 EP EP13780003.3A patent/EP2904477A1/en not_active Withdrawn
- 2013-10-04 JP JP2015535795A patent/JP2015530688A/en not_active Abandoned
- 2013-10-04 TW TW102136054A patent/TW201435689A/en unknown
- 2013-10-04 WO PCT/US2013/063355 patent/WO2014055809A1/en active Application Filing
- 2013-10-04 CN CN201380063433.5A patent/CN105009046B/en not_active Expired - Fee Related
- 2013-10-04 KR KR1020157011527A patent/KR102211188B1/en active IP Right Grant
-
2017
- 2017-05-10 US US15/591,528 patent/US10228799B2/en active Active
-
2019
- 2019-03-11 US US16/298,538 patent/US20190324592A1/en not_active Abandoned
Patent Citations (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5177802A (en) * | 1990-03-07 | 1993-01-05 | Sharp Kabushiki Kaisha | Fingerprint input apparatus |
US20010005004A1 (en) * | 1999-11-30 | 2001-06-28 | Akihide Shiratsuki | Irregular pattern detector |
US20040025091A1 (en) * | 2002-07-30 | 2004-02-05 | Totman Peter D. | Method and apparatus for detecting and determining event characteristics with reduced data collection |
US20070034783A1 (en) * | 2003-03-12 | 2007-02-15 | Eliasson Jonas O P | Multitasking radiation sensor |
US20040252091A1 (en) * | 2003-06-14 | 2004-12-16 | Massachusetts Institute Of Technology | Input device based on frustrated total internal reflection |
US20070125937A1 (en) * | 2003-09-12 | 2007-06-07 | Eliasson Jonas O P | System and method of determining a position of a radiation scattering/reflecting element |
US20110124648A1 (en) * | 2004-06-14 | 2011-05-26 | Eli Lilly And Company | Glucagon receptor antagonists, preparation and therapeutic uses |
US20090219261A1 (en) * | 2007-12-11 | 2009-09-03 | Joseph Jacobson | Touch-Sensitive Illuminated Display Apparatus and Method of Operation Thereof |
US20100002995A1 (en) * | 2008-07-01 | 2010-01-07 | Nitto Denko Corporation | Optical touch panel and method for manufacturing the same |
US20100007622A1 (en) * | 2008-07-10 | 2010-01-14 | Nitto Denko Corporation | Optical touch panel |
US20100302210A1 (en) * | 2009-06-01 | 2010-12-02 | Han Jefferson Y | Touch Sensing |
US20110122091A1 (en) * | 2009-11-25 | 2011-05-26 | King Jeffrey S | Methods and apparatus for sensing touch events on a display |
US20130162555A1 (en) * | 2010-04-07 | 2013-06-27 | Opdi Technologies A/S | Touch-sensitive device and method for detection of touch |
US20120068970A1 (en) * | 2010-09-17 | 2012-03-22 | Nigel Patrick Pemberton-Pigott | Touch-sensitive display with depression detection and method |
US20140098306A1 (en) * | 2012-10-04 | 2014-04-10 | Corning Incorporated | Touch screen systems with interface layer |
Also Published As
Publication number | Publication date |
---|---|
KR102211188B1 (en) | 2021-02-03 |
KR20150063546A (en) | 2015-06-09 |
EP2904477A1 (en) | 2015-08-12 |
US20170336919A1 (en) | 2017-11-23 |
US20140210770A1 (en) | 2014-07-31 |
US10228799B2 (en) | 2019-03-12 |
JP2015530688A (en) | 2015-10-15 |
WO2014055809A1 (en) | 2014-04-10 |
CN105009046A (en) | 2015-10-28 |
TW201435689A (en) | 2014-09-16 |
CN105009046B (en) | 2020-05-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10228799B2 (en) | Pressure sensing touch systems and methods | |
US9134842B2 (en) | Pressure sensing touch systems and methods | |
US10572071B2 (en) | Waveguide-based touch system employing interference effects | |
EP2845079B1 (en) | Pressure-sensing touch system utilizing total-internal reflection | |
US11216637B2 (en) | Optical fingerprint recognition device and display device | |
US9619084B2 (en) | Touch screen systems and methods for sensing touch screen displacement | |
US9557846B2 (en) | Pressure-sensing touch system utilizing optical and capacitive systems | |
CN104094203A (en) | Optical coupler for use in optical touch sensitive device | |
CN104160366A (en) | Robust optical touch-screen systems and methods using a planar transparent sheet | |
JP2016530617A (en) | Light guide plate having diffraction grating | |
US20160170565A1 (en) | Light guide assembly for optical touch sensing, and method for detecting a touch | |
CN101930321B (en) | Optical touch device and electronic device employing same | |
US20150220190A1 (en) | Display apparatus | |
KR20120063867A (en) | Optical touch panel |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: ADVISORY ACTION MAILED |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |