JP2023154227A - communication system - Google Patents

Abstract

To provide a high value-added communication system by integrating an IP call system and a monitoring camera system.SOLUTION: A communication system 1 includes: an IP call system 10 comprising a plurality of call terminals and transmitting/receiving voice data and video data using a call protocol between the call terminals over an IP network; a system manager which controls transmitting/receiving the voice data and the video data; and a monitoring camera system 40 including a monitoring camera 41. A video captured by the monitoring camera can be displayed on a display of a call terminal. When another call terminal or an IP speaker is selected and called from one call terminal belonging to the IP call system, the IP speaker being able to receive voice data using the call protocol, the system manager specifies one monitoring camera disposed near the other call terminal or the IP speaker and displays a video captured by the specified monitoring camera on the display of the one call terminal.SELECTED DRAWING: Figure 1

Description

The present disclosure relates to a communication system that can integrate and operate local calls using intercoms and IP speakers, loudspeaker broadcasting, video monitoring using a surveillance camera system, video recording, etc.

An intercom system (IP call system) is a system that mainly performs local calls. Typically, an intercom system includes one or more telephone terminals and one or more public address equipment, such as speakers. Each call terminal is equipped with a microphone and a speaker, and is interconnected via a network. Each call terminal performs a local call by transmitting the input voice to another call terminal according to a predetermined protocol such as the SIP protocol. Furthermore, each call terminal performs a method of amplifying the sound from the loudspeaker equipment by transmitting the input voice to the loudspeaker equipment.

A surveillance camera system is a system mainly used for crime prevention purposes. Typically, a surveillance camera system includes one or more surveillance cameras and a recorder to which each surveillance camera is connected. Each surveillance camera includes a camera installed at a predetermined location such as a ceiling or a wall, and a camera installed on a moving body such as a drone or a car. The recorder can receive video captured by a surveillance camera and record it by saving it to a built-in or external recording medium, or can output the captured video to an external display in real time for live viewing. can.

An example of an intercom system is disclosed in Patent Document 1. An example of a surveillance camera system is disclosed in Patent Document 2.
JP2006-114951 JP2009-296207

The present disclosure aims to provide a communication system with higher added value by integrating an IP call system and a surveillance camera system.

A communication system according to a first aspect of the present disclosure includes a plurality of call terminals each connected to an IP network and each having a microphone, a speaker, and a display, and transmits a call protocol between the call terminals via the IP network. an IP telephone call system that performs transmission and reception processing of the audio data and video data used;
a system manager that is connected to the IP network separately from the call terminals and controls transmission and reception processing of audio data and video data between the call terminals using the call protocol;
a surveillance camera system including a surveillance camera connected to an IP network;
Equipped with
The video captured by the surveillance camera can be displayed on the display of the call terminal,
When selecting and calling another call terminal or an IP speaker capable of receiving audio data using the call protocol from one call terminal belonging to the IP call system, the system manager selects and calls another call terminal or an IP speaker capable of receiving audio data using the call protocol. , or specify one surveillance camera placed around the IP speaker, and display an image obtained by the identified surveillance camera on the display of the one call terminal.

The communication system according to the second aspect of the present disclosure includes:
Each terminal is connected to an IP network, each includes a plurality of telephone terminals each having a microphone, a speaker, and a display, and transmits and receives audio data and video data using a telephone protocol between the telephone terminals via the IP network. IP call system and
a system manager that is connected to the IP network separately from the call terminals and controls transmission and reception processing of audio data and video data between the call terminals using the call protocol;
a surveillance camera system including a surveillance camera connected to an IP network;
Equipped with
The video captured by the surveillance camera can be displayed on the display of the call terminal,
When a call or broadcast is selected on the first call terminal while displaying an image captured by a surveillance camera on the display of one call terminal belonging to the IP call system, the system manager Other call terminals located around the surveillance camera of No. 1 and belonging to the IP call system, or IP speakers capable of receiving audio data using the call protocol are identified, or the identified call terminals are identified. Call to IP speaker.

In the communication system of the present disclosure, the video of the surveillance camera can be used at the call terminal, so the user can use the IP call system more conveniently and efficiently.

FIG. 1 is a diagram showing a schematic configuration of a communication system 1 according to the first embodiment. FIG. 2 is a schematic diagram of a network N including a LAN and a WAN. FIG. 3 is a diagram showing an example of the configuration of the telephone terminal 11. As shown in FIG. FIG. 4 is a diagram showing the appearance of the telephone terminal 11. As shown in FIG. FIG. 5A is an example of a management information table for each terminal managed by the system manager 20 of the first embodiment. FIG. 5B is another example of the management information table for each terminal managed by the system manager 20 of the first embodiment. FIG. 6 is an example of a management information table for each terminal managed by the system manager 20 of the second embodiment. FIG. 7 is a flowchart showing a basic call flow using the IP call system 10. FIG. 8 is a diagram showing an example of a display on the display 113 of the call terminal 11. As shown in FIG. FIG. 9A is an example of a method of using camera images of surveillance cameras 41a located around the second call terminal 11b when making a call from the first call terminal 11a to the second call terminal 11b in the first embodiment. It is a flowchart which shows. FIG. 9B is an example of a method of using camera images of surveillance cameras 41a located around the second call terminal 11b when making a call from the first call terminal 11a to the second call terminal 11b in the modified embodiment 1A. It is a flowchart which shows. FIG. 10 is a diagram showing an example of a display on the display 113 of the call terminal 11. As shown in FIG. FIG. 11 is a diagram showing an example of a display on the display 113 of the call terminal 11. As shown in FIG. FIG. 12A is a diagram showing an example of a display on the display 113 of the call terminal 11. FIG. 12B is a diagram showing an example of a display on the display 113 of the call terminal 11. FIG. 13 is a diagram showing a schematic configuration of a communication system 1a according to the second embodiment. FIG. 14 shows an example of a method of using camera images from a surveillance camera 41a located around the IP speaker 51a when performing loudspeaker broadcasting from the first call terminal 11a to the IP speaker 51 in the second embodiment. It is a flowchart. FIG. 15 shows an example of a method of using camera images of the surveillance camera 41a located around the IP speaker 51a when performing loudspeaker broadcasting from the first call terminal 11a to the IP speaker 51a in the second embodiment. It is a flowchart.

1. First Embodiment (1) Configuration of Communication System 1 of First Embodiment As shown in FIG. 1, the communication system 1 of this embodiment includes an IP call system 10, a system manager 20, a surveillance camera system 40, It is equipped with The IP call system 10, system manager 20, and surveillance camera system 40 are interconnected via a network N.

IP call system 10 includes a plurality of call terminals 11. The call terminal 11 is a terminal for making a voice call, and has a function of making a voice call by transmitting and receiving voice data to and from other call terminals 11 via the network N. Each call terminal 11 is assigned an identifier (for example, an IP address) that uniquely identifies itself on the network N. During a voice call, the call terminal 11 transmits and receives audio data and video data in accordance with an IP call protocol. An example of a protocol for IP calls is SIP (Session Initiation Protocol), which has been standardized by IETF (Internet Engineering Task Force) and defined in RFC3261.

The system manager 20 is a control device that allows the call terminal 11 to transmit and receive audio data and video data according to the IP call protocol. The transmission/reception process includes call control such as calling. For example, the system manager 20 is a SIP server that performs call control in compliance with SIP. The system manager 20 is assigned an identifier (eg, an IP address) that uniquely identifies itself on the network.

The surveillance camera system 40 is a system for monitoring a predetermined area (monitoring area) for crime prevention or the like, and includes one or more surveillance cameras 41 and a recorder 42 . Each surveillance camera 41 has a function of generating video data from a video signal acquired by an image sensor such as a CCD or CMOS, and transmitting the video data to the outside. The surveillance camera 41 transmits streaming video in accordance with a transmission protocol for surveillance camera systems. An example of a transmission protocol for a surveillance camera system is a protocol based on the ONVIF (Open Network Video Interface Forum) standard. Each surveillance camera 41 is assigned an identifier (for example, an IP address) that uniquely identifies itself on the network. In the surveillance camera 41, the recorder 42 is a recording device equipped with a recording medium such as an HDD or an SSD, and has a function of recording video data transmitted from the connected surveillance camera 41. Like the surveillance camera 41, the recorder 42 receives and records video data in accordance with the transmission protocol for surveillance camera systems. The recorder 42 is assigned unique identification information (for example, an IP address) on the network. The recorder 42 has a voice input function via a microphone, and has a function of generating voice data from the voice input from the microphone and transmitting it to the outside. The recorder 42 transmits audio data in accordance with a transmission protocol for surveillance camera systems. The surveillance camera system 40 may be integrally managed by a VMS (Video Management System). In the case of integrated management by VMS, the surveillance camera 41 and recorder 42 are controlled and managed by VMS software installed on a PC (Personal Computer). In the case of integrated management by VMS, the recorder 42 may be a PC installed with VMS software and equipped with a recording medium such as an HDD or SSD. Send externally.

The surveillance camera 41 includes a processing section including a CPU, an MPU, etc., and a memory that holds a computer program executable by the processing section. Various functions of the surveillance camera 41 are realized by the processing unit executing computer programs stored in the memory. Computer programs maintained in memory include program instructions that perform various functions, such as event detection functions.

The recorder 42 includes a processing section including a CPU, an MPU, etc., and a memory that holds a computer program that can be executed by the processing section. Various functions of the recorder 42 are realized by the processing unit executing computer programs stored in the memory. The computer programs held in memory include program instructions for performing various functions, such as recording functions, event detection functions, etc.

As shown in FIG. 2, the network N may be configured through a plurality of LANs (Local Area Networks) and a WAN (Wide Area Network) such as the Internet that interconnects these LANs. The IP call system 10, system manager 20, and surveillance camera system 40 are each configured on a LAN and interconnected. In such a configuration, various types of communication can be performed, such as voice calls between call terminals 11 between different IP call systems 10 across a plurality of LANs. When the IP call system 10 is configured on a LAN, the call terminal 11 is connected to a router that makes up the LAN with an Ethernet cable, and transmits voice data via the Ethernet cable, as well as PoE (Power) via the Ethernet cable. over Ethernet). When the surveillance camera system 40 is configured on a LAN, the surveillance camera 41 and recorder 42 are connected to a router that configures the LAN with an Ethernet cable, and transmit and receive video data via the Ethernet cable, and also transmit and receive video data via the Ethernet cable. PoE power supply is recommended.

Hereinafter, an example will be explained in which SIP is used as the IP call protocol and ONVIF protocol is used as the transmission protocol for the surveillance camera system.

As shown in FIG. 3, the telephone terminal 11 includes a microphone 110, a speaker 111, a camera 112, a display 113, an input section 114, a processing section 116, and a memory 117. The microphone 110 is an electroacoustic transducer whose sound collection direction is directed outward from the casing of the telephone terminal 11, and collects the voice of a speaker speaking to the telephone terminal 11 and outputs an audio signal. The speaker 111 is an electroacoustic transducer whose sound emission direction is directed outward from the casing of the telephone terminal 11, and outputs the sound obtained by reproducing the sound data. The camera 112 is an imaging device including an image sensor such as a CCD image sensor or a CMOS image sensor, and the camera 112 is directed toward the outside of the casing of the call terminal 11 and in the direction in which the figure of the speaker speaking to the call terminal 11 is reflected. is directed. The camera 112 generates video data of a still image or a moving image from a video signal obtained by photographing and outputs the video data. The display 113 is a display including a display element such as an LCD or an organic EL, and displays images taken by the camera 112 of the call terminal 11 or other call terminals 11, and other images related to the GUI and the like. The input unit 114 is an input device such as a button or a switch that receives user operations. Input unit 114 and display 113 may be integrated to form a touch panel. The telephone terminal 11 can take various forms, such as a type placed on a desk or tabletop, a wall-mounted type, or a wall-embedded type. The telephone terminal 11 is a telephone device called a speakerphone, an interphone, or an intercom.

FIG. 4 is an external view showing one configuration of the telephone terminal 11. As shown in FIG. The telephone terminal 11 includes a camera 12, a display 113, an input section 114, and a receiver 115. The receiver 115 includes a microphone 110 and a speaker 111. The telephone terminal 11 in FIG. 4 includes a microphone 110 and a speaker 111 in addition to the handset 115, and is capable of collecting and producing sound even when the handset 115 is placed on the main body. Used for hands-free calls.

In the telephone terminal 11, the processing unit 116 includes a CPU (Central Processing Unit), an MPU (Micro Processing Unit), and the like. The memory 117 holds computer programs executable by the processing unit 116. Various functions of the telephone terminal 11 are realized by the processing unit 116 executing the computer program stored in the memory 117. The computer programs held in the memory 117 include a telephone call function, a recording function, an event detection function, a judgment function using AI, a loudspeaker function, a real-time broadcast function, a recorded broadcast function, a download broadcast function, a simultaneous broadcast function, etc. Contains program instructions that perform various functions.

(2) Basic call method using IP call system 10 A basic SIP call method will be explained using the flowchart in FIG. 7.

The system manager 20 has a SIP server function and performs call control. As shown in FIGS. 5A and 5B, the system manager 20 manages information on each terminal (call terminal 11, surveillance camera 41, etc.) in the communication system 1 in a table. Here, the information on each terminal is the "IP address" and the "name" of the location where each terminal is located.

The name of each terminal may be input arbitrarily by the user from the input unit 114 of each call terminal 11.

The name of each terminal may be the same between the call terminal 11 and the camera 41, as shown in FIG. 5A, or may be different between the call terminal 11 and the camera 41, as shown in FIG. 5B.

From now on, the calling terminal (first calling terminal 11a) named "2nd floor north" will be the calling source, and the calling terminal (second calling terminal 11b) named "1st floor lobby" will be the calling destination. This will be explained based on an example.

The user first tries to make a call from the first call terminal 11a on the "2nd floor north" which is the calling source, to the second call terminal 11b on the "1st floor lobby", and the user selects the display 113 of the first call terminal 11a. Select "1st floor lobby" on the display screen (see FIG. 8). In response to the user's selection, the first telephone terminal 11a calls the system manager 20 (S101). In response to the call from the first call terminal 11a, the system manager 20 relays the call to the second call terminal 11b located in the "first floor lobby" (S102). When the second call terminal 11b responds to the call, a call session is started between the first call terminal 11a and the second call terminal 11b (S103). A call session refers to a state of the IP call system 10 that enables a call between the user of the first call terminal 11a and the user of the second call terminal 11b.

(3) Communication method using the IP call system 10 and the surveillance camera system 40 in cooperation The flowchart in FIG. 9A shows the communication method using the IP call system 10 and the surveillance camera system 40 in cooperation in the communication system 1 of this embodiment. Explain using.

The call terminals 11 or cameras 41 of the communication system 1 are placed at multiple locations in the building. Here, the first floor lobby and the second floor north are assumed to be the locations where the call terminal 11 or camera 41 is installed. In this communication method, when making a call from the first call terminal 11a installed in the "second floor north" to the second call terminal 11b installed in the "first floor lobby", the "first floor lobby" This is a case where camera images from surveillance cameras located around the call terminal are used.

The user first tries to make a call from the first call terminal 11a on the "2nd floor north" which is the calling source, to the second call terminal 11b on the "1st floor lobby", and the user selects the display 113 of the first call terminal 11a. Select "1st floor lobby" on the display screen (see FIG. 8). Upon receiving the user's input, the first telephone terminal 11a makes an inquiry to the system manager 20 (S201). Upon receiving the notification, the system manager 20 identifies surveillance cameras that are likely to be around the second call terminal 11b in the selected "1st floor lobby" and notifies the first call terminal 11a of the address of the camera 41a ( S202). The first call terminal 11a that received the notification sends a video request to the camera 41a in the "first floor lobby" (S203). The camera 41a, which has received a video request from the first call terminal 11a, sends the camera video being captured to the first call terminal 11a using the ONVIF protocol (S204). The transmitted on-time video of the camera 41a is displayed on the display 113 of the first call terminal 11a (FIG. 10).

A user on the "2nd floor north" talks with a user on the "1st floor lobby" using the first and second call terminals 11a and 11b while viewing the camera image on the "1st floor lobby". Specifically, the user selects a call to the "first floor lobby" on the first call terminal 11a. Upon receiving the user's input, the first telephone terminal 11a calls the system manager 20 (S205). In response to the call from the first call terminal 11a, the system manager 20 relays the call to the second call terminal 11b located in the "first floor lobby" (S206). When the second call terminal 11b responds to the call, a call session is started between the first call terminal 11a and the second call terminal 11b (S207).

Furthermore, as shown in FIG. 5A, there may be a case where there are a plurality of cameras 41 with the name "1st floor lobby" in the table that manages information about each terminal. In this case, the system manager 20 may select one camera or a plurality of cameras from among the plurality of cameras 41 in the "first floor lobby." When a plurality of cameras are selected, the image displayed on the display 113 of the first call terminal 11a may be an image obtained by dividing the display on the display 113 in order to display a plurality of images.

In the above description, when the user selects the second call terminal 11b in the "1st floor lobby", in step S202, the system manager 20 specifies the camera 41a whose name is "1st floor lobby". If the table for managing information on each terminal is as shown in FIG. 5A, the process is performed as described above. On the other hand, if the table for managing information of each terminal is as shown in FIG. 41, the camera 41 of "1st floor lobby reception" and/or the camera 41 of "1st floor lobby west" may be selected.

In the case of FIG. 5B, the system manager 20 may select a plurality of cameras 41, that is, the camera 41 in the "1st floor lobby reception" and the camera 41 in the "1st floor lobby west". In this case, the image displayed on the display 113 of the first call terminal 11a may be an image obtained by dividing the display on the display 113.

As described above, in the communication system 1 of the present embodiment, the user can make a call after confirming the state of the other party using the camera image. Therefore, it is possible to determine how to make a call based on the image of the person being called. For example, if the camera image shows that there is no one to call, it can be determined that the call will be made again later. Alternatively, if there are many people on the other end of the call, it can be determined by speaking loudly.

When a call session is started in step S207, on-time video captured by the camera 112 of the second call terminal 111b is displayed on the display 113 of the first call terminal 11a, as shown in FIG. On the display screen of the display 113, not only images but also icons for operation or for indicating the state of the operation may be simultaneously displayed on a part of the display screen of the display 113, as shown in FIG. The icons shown in FIG. 11 are icons that indicate, in order from the top, on/off or switching of a video image, on/off of a telephone call, and switching to a communication location selection screen.

As shown in FIG. 12A, in step S207, the display 113 of the first call terminal 11a during the call session shows not only the image taken by the camera 112 of the second call terminal 11b but also the image captured by the camera 112 of the first call terminal 11a. Images may be displayed simultaneously. In this case, as shown in FIG. 12A, the video of the first call terminal 11a is displayed smaller than the video of the second call terminal 11b.

In addition, as shown in FIG. 12B, in step S207, the display 113 of the first call terminal 11a during the call session displays the image captured by the camera 41a of the "first floor lobby" along with the image of the camera 112 of the second call terminal 11b. Images may be displayed simultaneously. In this case, as shown in FIG. 12B, the image captured by the camera 41a in the "first floor lobby" may be displayed smaller than the image of the second call terminal 11b.

Further, after the call session (S207) is started, the image of the surveillance camera 41a may be displayed on the display 113 of the first call terminal 11a according to the user's selection. During a call, if you select the camera icon at the top right on the display of the first call terminal 11a in FIG. 11, the "1st floor lobby" will be monitored instead of the image from the camera 112 of the second call terminal 11b shown in FIG. On-time video captured by the camera 41a may be displayed. Alternatively, as shown in FIG. 12B, an on-time video taken by the surveillance camera 41a in the "first floor lobby" may be displayed together with the video from the camera 112 of the second call terminal 11b. With this configuration, a user on the "second floor north" can talk on the phone while looking at the "first floor lobby".

(4) Modified embodiment 1A
In the above method (3) of cooperation between the IP call system 10 and the surveillance camera system 40, in step S201, the first call terminal 11a makes an inquiry to the system manager 20, and the system manager 20, which has received the notification, The camera 41 is identified and notified to the first call terminal 11a (S202), and a video request is sent from the first call terminal 11a to the surveillance camera 41a (S203).

Steps S201 to S203 may be replaced by steps S211 to S212, as shown in FIG. 9B. That is, in step S211, the first telephone terminal 11a makes an inquiry to the system manager 20, and upon receiving the notification, the system manager 20 identifies the surveillance camera 41a and sends a video request to the surveillance camera 41a (S212). The subsequent step S204 and subsequent steps are exactly the same as those in FIG. 9A.

(5) Modified embodiment 1B
In the communication method shown in FIG. 9A or 9B, when making a call between the first call terminal 11a and the second call terminal 11b, the system manager 20 searches for the surveillance camera 41a around the second call terminal 11b. The case where the video of the surveillance camera 41a is displayed on the display 113 of the first call terminal 11a has been described.

Modification Embodiment 1B is a case where the user selects and executes a call with a person around the monitoring camera 41a while the on-time video of the monitoring camera 41a is being displayed on the first call terminal 11a. The communication method of the modified embodiment 1B is similar to that shown in FIG. 9A or 9B in terms of the flowchart, so it will be explained here using FIG. 9B.

The user displays the image of the surveillance camera 41a of the "1st floor lobby" which is located away from "2nd floor north" on the display 113 of the first call terminal 11a (S211, S212). , S204). The user presses the "call" button on the first call terminal 11a while viewing the video of the surveillance camera 41a, depending on the situation. Then, the first telephone terminal 11a calls the system manager 20 (S205). The system manager 20 identifies call terminals 11 around the surveillance camera 41a, and calls the second call terminal 11b, which is the identified call terminal 11 (S206). When another user around the second call terminal 11b responds to the call, a call session starts between the first call terminal 11a and the second call terminal 11b (S207).

In the modified embodiment 1B, when the user who has viewed the video of the surveillance camera 41 makes a call, the second telephone terminal 11b around the surveillance camera 41a is specified, and a telephone conversation is enabled. For example, after confirming whether the person the user is looking for is in the vicinity of the surveillance camera 41a, the user can talk to that person.

(6) Modified embodiment 1C
In the explanation of (3) above, when the user selects the second call terminal 11b in "1st floor lobby", in step S202, the system manager 20 specifies the camera 41a whose name is "1st floor lobby". . If the table for managing information on each terminal is as shown in FIG. 5A, it is possible to search for a terminal using the "name" of the table for managing information on each terminal. Additionally, there may be cases where a nearby camera cannot be identified even if you search by name. The system manager 20 may use an identifier other than the "name" to identify the target camera.

An example of an identifier other than "name" used to specify a terminal is an IP address. IP addresses may be used to identify cameras that share a common network or cameras that are connected to the same router.

Furthermore, as another example, the system manager 20 may use a combination of multiple identifiers to identify the target camera. For example, "name" and "IP address" may be used in combination. By doing this, for example, if the same name is registered as "1st floor lobby" but it refers to a different lobby in a different building, by using a combination of IP addresses, you can Camera 41 can be identified.

2. Second Embodiment (1) Configuration of Communication System 1a of Second Embodiment As shown in FIG. We are prepared. The IP call system 10, system manager 20, surveillance camera system 40, and network N are the same as those in the first embodiment, so detailed explanations will be omitted. In the communication system 1a, an IP call system 10, a system manager 20, a surveillance camera system 40, and a loudspeaker system 50 are interconnected via a network N.

The loudspeaker system 50 is a system provided in a predetermined area (loudspeaker area) for purposes such as providing evacuation guidance during a disaster and reproducing music such as BGM, and includes one or more IP speakers 51. Each IP speaker 51 is assigned unique identification information (for example, an IP address) on the network. The IP speaker 51 has a function of receiving, reproducing, and amplifying audio data in accordance with the same IP call protocol as the call terminal 11 and the same transmission protocol for the surveillance camera system as the recorder 42. Further, the loudspeaker system 50 includes a paging gateway 52 connected to the same network as the IP speaker 51. The paging gateway 52 is assigned unique identification information (for example, an IP address) on the network. The paging gateway 52 receives audio data via the network in accordance with the same IP call protocol as the call terminal 11 and the same surveillance camera system transmission protocol as the recorder 42, and sends the audio data to the IP speaker via the network. It has a function of transferring audio data to 51. That is, the paging gateway 52 can once receive audio data intended for the IP speakers 51 and transfer the audio data to the IP speakers 51 to simultaneously broadcast the audio data. The paging gateway 52 transfers audio data to the IP speaker 51 by multicast or broadcast. The IP speaker 51 receives and reproduces digitized audio data via a wireless communication medium such as an Ethernet cable or cellular communication.

In this way, in the communication system 1a, the IP call system 10, the system manager 20, the surveillance camera system 40, and the loudspeaker system 50 are interconnected via the network, and the call terminal 11 of the IP call system 10 They can make voice calls with each other, broadcast voice from the call terminal 11 of the IP call system 10 to the IP speakers 51 of the public address system 50, and broadcast voice from the recorder 42 of the surveillance camera system 40 to the IP speakers 51 of the public address system. You can do this.

As shown in FIG. 2, the network N may be configured through a plurality of LANs (Local Area Networks) and a WAN (Wide Area Network) such as the Internet that interconnects these LANs. The IP call system 10, system manager 20, and surveillance camera system 40 are each configured on a LAN and interconnected. In such a configuration, it is possible to perform voice calls between call terminals 11 between different IP call systems 10 across multiple LANs, or to perform voice calls between call terminals 11 of IP call systems 10 in one LAN to a call terminal 11 in the other LAN. Broadcasting audio to the IP speakers of the loudspeaker system 50, broadcasting audio from the recorder 42 of the surveillance camera system 40 in one LAN to the IP speakers 51 of the loudspeaker system 50 in the other LAN, and various other types of communication. It can be performed. When the IP call system 10 is configured on a LAN, the call terminal 11 is connected to a router that makes up the LAN with an Ethernet cable, and transmits voice data via the Ethernet cable, as well as PoE (Power) via the Ethernet cable. over Ethernet). When the surveillance camera system 40 is configured on a LAN, the surveillance camera 41 and recorder 42 are connected to a router that configures the LAN with an Ethernet cable, and transmit and receive video data via the Ethernet cable, and also transmit and receive video data via the Ethernet cable. PoE power supply is recommended. When the public address broadcasting system 50 is configured on a LAN, the IP speakers 51 and the paging gateway 52 are connected to a router that configures the LAN via an Ethernet cable, and receive audio data via the Ethernet cable. It is recommended that PoE power be supplied.

Also, in the second embodiment, similarly to the first embodiment, the system manager 20 has a SIP server function and performs call control. As shown in FIG. 6, the system manager 20 manages information on each terminal (call terminal 11, IP speaker 51, surveillance camera 41, etc.) in the communication system 1 in a table. Here, the information on each terminal is the "IP address" and the "name" of the location where each terminal is located.

Also, in the communication system 1a of the second embodiment, the communication method that does not use the loudspeaker broadcasting system 50 is the same as the communication system 1 of the first embodiment. In other words, "(2) Basic call method using the IP call system 10", "(3) Communication method using the IP call system 10 and the surveillance camera system 40 in cooperation", and " (4) Modified Embodiment 1A," "(5) Modified Embodiment 1B," and "(6) Modified Embodiment 1C," so the explanation will be omitted.

(2) Communication method using the IP telephone call system 10, the loudspeaker system 50, and the surveillance camera system 40 in collaboration In the communication system 1a of this embodiment, the IP telephone call system 10, the loudspeaker system 50, and the surveillance camera system 40 are used in collaboration. The communication method will be explained using the flowchart of FIG. 14.

In the communication system 1a, a first call terminal 11a is arranged in the "north of the second floor" where the user is located, and an IP speaker 51a and a surveillance camera 41a are arranged in the "first floor lobby". In this communication method, when performing a loudspeaker broadcast from the first call terminal 11a installed in the ``2nd floor north'' to the IP speaker 51b installed in the ``1st floor lobby,'' This is a case where a camera image of the surveillance camera 41a located around the IP speaker 51a is acquired.

First, the user tries to make a loudspeaker broadcast from the first call terminal 11a on the "2nd floor north" which is the calling source to the IP speaker 51a on the "1st floor lobby", and the display screen of the display 113 of the first call terminal 11a. (See FIG. 8), select "1st floor lobby". Upon receiving the user's input, the first telephone terminal 11a makes an inquiry to the system manager 20 (S301). After receiving the notification, the system manager 20 identifies surveillance cameras 41a ("1st floor lobby" cameras) that are likely to be around the selected "1st floor lobby" IP speaker 51a, and monitors the surveillance cameras 41a in the "1st floor lobby". The address is notified to the first call terminal 11a on the "second floor north". (S302). As a result, a video request is sent from the first call terminal 11a on the "2nd floor north" to the "1st floor lobby" camera (S303). The camera 41a requested by the first call terminal 11a sends the camera image being captured to the first call terminal 11a using the ONVIF protocol (S204). The transmitted image from the camera 41a is displayed on the display 113 of the first call terminal 11a.

The user on the "second floor north" performs the loudspeaker broadcast while viewing the camera image of the "first floor lobby" (S307).

As described above, in the communication system of this embodiment, the user can determine how to carry out amplified broadcasting after checking the situation at the other end of the call using the camera image. For example, if there is no person at the other end of the call based on the camera image, it can be determined that the loudspeaker broadcast will not be performed. Alternatively, if there are many people at the destination of the loudspeaker broadcast, it can be determined that the loudspeaker broadcast will be performed at a louder volume.

(3) Modified embodiment 2A
In the above method (2) of linking the IP call system 10, the public address broadcast system 50, and the surveillance camera system 40, in step S301, the first call terminal 11a makes an inquiry to the system manager 20, and the system manager 20 receives the notification. The manager 20 identifies the surveillance camera 41, notifies the first telephone terminal 11a (S302), and sends a video request from the first telephone terminal 11a to the surveillance camera 41a (S203).

In the communication method of the modified embodiment 2A, as shown in FIG. Then, a video request is sent to the surveillance camera 41a (S312). The subsequent steps from step S304 onwards are exactly the same as the communication method shown in FIG.

(4) Modified embodiment 2B
In the communication method shown in FIG. 14 or 15, when making a loudspeaker broadcast from the first call terminal 11a to the IP speaker 51a, the system manager 20 searches for surveillance cameras 41a around the IP speaker 51a, The case where the video is displayed on the display 113 of the first call terminal 11a has been described.

Modification Embodiment 2B is a case where the user selects and executes loudspeaker broadcasting to the vicinity of the surveillance camera 41a while the on-time video of the surveillance camera 41a is being displayed on the first call terminal 11a. The communication method of the modified embodiment 2B is similar to that shown in FIG. 14 or 15 in terms of the flowchart, so it will be explained here using FIG. 15.

The user displays the image of the surveillance camera 41a of the "first floor lobby", which is located far from the "second floor north", on the display 113 of the first call terminal 11a (S311, S312). , S304). The user presses the "broadcast" button on the first call terminal 11a while viewing the video of the surveillance camera 41a, depending on the situation. Then, the first telephone terminal 11a calls the system manager 20 (S305). The system manager 20 identifies IP speakers 51a around the surveillance camera 41a, and calls the identified IP speaker 51a (S306). In this way, loudspeaker broadcasting can be performed from the first call terminal 11a to the IP speaker 51a.

In the modified embodiment 2B, the IP speakers 51a around the surveillance camera 41a are specified by the user who has viewed the video of the surveillance camera 41, and loudspeaker broadcasting becomes possible. For example, after confirming from the video whether the people the user is looking for are in the vicinity of the surveillance camera 41a, it is possible to make a loudspeaker broadcast to those people.

In addition, the case where, when the user presses the "broadcast" button, the system manager 20 specifies the IP speaker 51a and executes the broadcast has been described above. The system manager 20 may specify a plurality of IP speakers 51 in the "first floor lobby" to perform broadcasting. Furthermore, instead of the IP speaker 51a, the second call terminal 11b located in the "first floor lobby" may be designated to perform the broadcast. For example, this is effective when there is no IP speaker 51 in the "first floor lobby". Furthermore, the system manager 20 may specify one or more IP speakers 51 and one or more call terminals 11 in the "first floor lobby" to perform broadcasting.

3. Features of the first and second embodiments (1) The communication system 1 includes an IP call system 10, a system manager 20, and a surveillance camera system 40. The IP call system 10 includes a plurality of call terminals 11. The telephone terminal 11 is connected to an IP network N. The telephone terminal 11 includes a microphone 110, a speaker 111, and a display 113. The system manager 20 is independently connected to the IP network N. The system manager 20 controls transmission and reception processing of audio data and video data between the plurality of call terminals 11 using a call protocol. The surveillance camera system 40 includes a surveillance camera 41 connected to an IP network N.

The call terminal 11 can display the video captured by the surveillance camera 41 on the display 113 of the call terminal 11 .

The call protocol of the communication system 1 may be the SIP protocol.

When selecting and calling the second call terminal 11b located elsewhere from the first call terminal 11a (S201), the system manager 20 is arranged around the second call terminal 11b and monitors the surveillance camera system 40. The first monitoring camera 41a to which it belongs is specified (S202), and the video acquired by the specified monitoring camera 41a is displayed on the display of the first call terminal 11a (S203, S204). Thereafter, the user using the first telephone terminal 11a can make a telephone conversation with the second telephone terminal 11b while viewing the video of the surveillance camera 41a around the second telephone terminal 11b (S205 to S207).

In the communication system 1, the user can determine how to make the call after confirming the state of the person on the other end of the call using a surveillance camera image. For example, if the camera image shows that there is no one to call, it can be determined that the call will be made again later. Alternatively, if there are many people on the other end of the call, it can be determined by speaking loudly.

(2) When the communication system 1 is called from the first call terminal 11a while displaying the image being captured by the surveillance camera 41a on the display 113 of the first call terminal 11a, the system manager 20 It is also possible to specify other telephone terminals placed around the telephone terminal 41a, and to enable a telephone conversation between the identified telephone terminal (second telephone terminal 11b) and the first telephone terminal.

By utilizing the communication system 1 in this way, the second call terminal 11b around the surveillance camera 41a is specified when the user who has viewed the image of the surveillance camera 41a makes a call, and a telephone conversation becomes possible. For example, the user can confirm whether the person he or she is looking for is present in the vicinity of the surveillance camera 41a through video, and then talk to that person.

(3) The communication system 1a includes an IP call system 10, a loudspeaker system 50, a system manager 20, and a surveillance camera system 40. The IP call system 10 includes a plurality of call terminals 11. The telephone terminal 11 is connected to an IP network N. The telephone terminal 11 includes a microphone 110, a speaker 111, and a display 113. The system manager 20 is independently connected to the IP network N. The loudspeaker system 50 includes IP speakers 51. The IP speaker 51 is connected to the network N and is capable of receiving audio data using a telephone call protocol. The system manager 20 controls transmission and reception processing of audio data and video data between the plurality of call terminals 11 using a call protocol. The surveillance camera system 40 includes a surveillance camera 41 connected to an IP network N.

The call terminal 11 can display the video captured by the surveillance camera 41 on the display 113 of the call terminal 11 .

The call protocol of the communication system 1a may be the SIP protocol.

When selecting and calling an IP speaker 51a located at another location from the first call terminal 11a (S301), the system manager 20 selects and calls an IP speaker 51a located in another location from the first call terminal 11a. The camera 41a is identified (S302), and the video acquired by the identified surveillance camera 41a is displayed on the display of the first call terminal 11a (S203, S204). Thereafter, the user using the first call terminal 11a can make a loudspeaker broadcast to the IP speaker 51a while viewing the video of the surveillance camera 41a around the second call terminal 11b (S205 to S207).

The communication system 1a can determine how to carry out amplified broadcasting after checking the situation at the other end of the call using images from a surveillance camera. For example, if the camera image shows that there is no person on the other end of the call to whom the loudspeaker broadcast is intended, it can be determined that the loudspeaker broadcast will be repeated later. Alternatively, if there are many people at the destination of the loudspeaker broadcast, it can be determined by speaking loudly.

(4) When the user selects broadcasting on the first call terminal 11a while displaying the image being captured by the surveillance camera 41a on the display 113 of the first call terminal 11a, the communication system 1a starts the first call. The terminal 11a may call the system manager 20, and the system manager 20 may specify an IP speaker 51a placed around the surveillance camera 41a, and perform a loudspeaker broadcast to the specified IP speaker 51a.

By utilizing the communication system 1a in this way, the IP speakers 51a around the surveillance camera 41a are identified by a call from a user who has viewed the video of the surveillance camera 41a, and amplified sound broadcasting becomes possible. For example, after checking the video to see if the person the user is looking for is in the vicinity of the surveillance camera 41a, the user can make a loudspeaker broadcast to that person.

4. Other Embodiments The case where the name of the camera specified by the user is completely the same as the name of the camera in the table held by the system manager 20 has been described above. The two may not be a complete match, but may be a partial match.

In the above example, the system manager 20 specifies one camera in response to the user's selection. The system manager 20 may specify multiple cameras.

In the above, based on the name input and set by the user from the input unit, the system manager 20 identified a camera that seems to have a similar name. The system manager 20 may identify the camera using an identifier other than the "name". An IP address may be used as the identifier. When the LAN is divided into multiple LANs by multiple routers or virtually divided into multiple LANs by switches (L2 switch, L3 switch), calls are made based on the degree of commonality between the device identifiers of the calling terminal and the camera. Cameras connected to the same LAN as the terminal (=cameras that appear to be nearby) may be identified. For example, if the identifier of each device is an IP address, the installation location of each device can be estimated by looking at the network part of the IP address of each device. That is, devices having the same network section can be determined to belong to the same network N1. For example, IP addresses 192.168.1.1 and 192.168.1.8 can be determined to be the same network, and IP addresses 192.168.2.2 and 192.168.2.4 can be determined to be the same network.

Furthermore, identification based on the degree of coincidence between the name input and set by the user from the input section and the name of the camera in the table held by the system manager 20, and identification based on the degree of commonality of device identifiers may be used in combination. good.

1, 1a Communication system 10 IP call system 11 Call terminal 11a First call terminal 11b Second call terminal 113 Display 20 (of the call terminal) System manager 40 Surveillance camera system 41 Surveillance camera 42 Recorder 50 Loudspeaker system 51 IP speaker

Claims (6)

Each of them is connected to an IP network, each includes a plurality of call terminals each having a microphone, a speaker, and a display, and transmits and receives audio data and video data using a call protocol between the call terminals via the IP network. , an IP call system,
a system manager that is connected to the IP network separately from the call terminals and controls transmission and reception processing of audio data and video data between the call terminals using the call protocol;
a surveillance camera system including a surveillance camera connected to an IP network;
Equipped with
The video captured by the surveillance camera can be displayed on the display of the call terminal,
When selecting and calling another call terminal or an IP speaker capable of receiving audio data using the call protocol from one call terminal belonging to the IP call system, the system manager selects and calls another call terminal or an IP speaker capable of receiving audio data using the call protocol. , or identifying one surveillance camera placed around the IP speaker, and displaying the image obtained by the identified surveillance camera on the display of the one call terminal;
communication system. When the system manager identifies one surveillance camera, the system manager identifies a surveillance camera having a name that is the same as or similar to the name of another telephone terminal or IP speaker input in the one telephone terminal;
The communication system according to claim 1. When the system manager identifies one surveillance camera, the system manager identifies a surveillance camera that has a common IP address in the network part of the IP address with the IP address of another telephone terminal or IP speaker input in the first telephone terminal. do,
The communication system according to claim 1. Each terminal is connected to an IP network, each includes a plurality of telephone terminals each having a microphone, a speaker, and a display, and transmits and receives audio data and video data using a telephone protocol between the telephone terminals via the IP network. IP call system and
a system manager that is connected to the IP network separately from the call terminals and controls transmission and reception processing of audio data and video data between the call terminals using the call protocol;
a surveillance camera system including a surveillance camera connected to an IP network;
Equipped with
The video captured by the surveillance camera can be displayed on the display of the call terminal,
When a call or broadcast is selected on the first call terminal while displaying an image captured by a surveillance camera on the display of one call terminal belonging to the IP call system, the system manager Other call terminals located around the surveillance camera of No. 1 and belonging to the IP call system, or IP speakers capable of receiving audio data using the call protocol are identified, or the identified call terminals are identified. Call to IP speaker
communication system. Further, a loudspeaker system including a plurality of IP speakers that receives audio data transmitted from the telephone terminal and broadcasts the sound data over loudspeakers,
The communication system according to claim 1 or 4. The call protocol is the SIP protocol,
The communication system according to claim 1 or 4.

Images