CN114089811B - Data processing method, device, equipment and storage medium - Google Patents

Data processing method, device, equipment and storage medium Download PDF

Info

Publication number
CN114089811B
CN114089811B CN202111255612.1A CN202111255612A CN114089811B CN 114089811 B CN114089811 B CN 114089811B CN 202111255612 A CN202111255612 A CN 202111255612A CN 114089811 B CN114089811 B CN 114089811B
Authority
CN
China
Prior art keywords
module
vehicle
vehicle information
clock synchronization
local area
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202111255612.1A
Other languages
Chinese (zh)
Other versions
CN114089811A (en
Inventor
王成武
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Jidu Automobile Co Ltd
Original Assignee
Shanghai Jidu Automobile Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Jidu Automobile Co Ltd filed Critical Shanghai Jidu Automobile Co Ltd
Priority to CN202111255612.1A priority Critical patent/CN114089811B/en
Publication of CN114089811A publication Critical patent/CN114089811A/en
Application granted granted Critical
Publication of CN114089811B publication Critical patent/CN114089811B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/04Generating or distributing clock signals or signals derived directly therefrom
    • G06F1/12Synchronisation of different clock signals provided by a plurality of clock generators
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R16/00Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
    • B60R16/02Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
    • B60R16/023Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements for transmission of signals between vehicle parts or subsystems

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Small-Scale Networks (AREA)

Abstract

The embodiment of the invention discloses a data processing method, a device, equipment and a storage medium, which are applied to a vehicle, wherein the vehicle comprises a first module, a second module and a third module, and the execution method of the first module comprises the following steps: receiving a clock synchronization signal through a local area network; synchronizing a local clock according to the clock synchronizing signal; clock synchronization is carried out through the level signal and a second module connected with the vehicle bus network; and adding a first time stamp to the acquired first vehicle information according to the synchronized local clock, and sending the first vehicle information added with the first time stamp to a third module. By the technical scheme provided by the embodiment of the invention, the time synchronization of the data of different data sources can be realized, and the data of different data sources can be fused more accurately.

Description

Data processing method, device, equipment and storage medium
Technical Field
The embodiment of the invention relates to the technical field of computers, in particular to a data processing method, a device, equipment and a storage medium.
Background
With the increasing degree of vehicle intelligence, the variety of data for recording the running state of the vehicle is increasing. For example, may include, but is not limited to: image data of the vehicle interior and the surrounding environment collected by the camera, audio data of the vehicle interior collected by the microphone, data collected by control equipment of components such as an airbag, a safety belt and the like in the vehicle, and the like.
Because different data are acquired through different data source devices, and networks connected with the different data source acquisition devices are different, the situation that clocks of different data sources are not synchronous possibly exists, and the accuracy of subsequent fusion processing of the different data source data is affected.
Disclosure of Invention
The invention provides a data processing method, a device, equipment and a storage medium, which can realize time synchronization of data of different data sources and facilitate fusion processing of the data of the different data sources more accurately.
In a first aspect, an embodiment of the present invention provides a data processing method, which is applied to a vehicle, where the vehicle includes a first module, a second module, and a third module, and the first module executes a method including:
receiving a clock synchronization signal through a local area network;
synchronizing a local clock according to the clock synchronizing signal;
clock synchronization is carried out through the level signal and a second module connected with the bus network of the vehicle;
and adding a first time stamp to the acquired first vehicle information according to the synchronized local clock, and sending the first vehicle information added with the first time stamp to a third module.
In a second aspect, an embodiment of the present invention provides a data processing method, which is applied to a vehicle, where the vehicle includes a first module, a second module, and a third module, and the second module executes a method including:
Clock synchronization is carried out through the level signal and a first module connected with a local area network;
adding a second timestamp for the acquired second vehicle information according to the synchronized local clock;
and sending the second vehicle information to which the second timestamp has been added to a third module.
In a third aspect, an embodiment of the present invention provides a data processing method, which is applied to a vehicle, where the vehicle includes a first module, a second module, and a third module, and the third module executes a method including:
acquiring first vehicle information carrying a first time stamp and sent by a first module through a local area network;
acquiring second vehicle information carrying a second time stamp and transmitted by a second module through a vehicle bus network;
processing the first vehicle information and the second vehicle information according to the first timestamp and the second timestamp to generate a vehicle data set;
the first timestamp and the second timestamp are added after clock synchronization of the first module and the second module.
In a fourth aspect, an embodiment of the present invention further provides a data processing apparatus, which is applied to a vehicle, where the vehicle includes a first module, a second module, and a third module, and the apparatus is configured in the first module, and includes:
The receiving unit is used for receiving the clock synchronization signal through a local area network;
the first synchronization unit is used for synchronizing the local clock according to the clock synchronization signal;
the second synchronization unit is used for performing clock synchronization with a second module connected with the vehicle bus network through the level signal;
the first timestamp adding unit is used for adding a first timestamp to the acquired first vehicle information according to the synchronized local clock;
and the first information sending unit is used for sending the first vehicle information added with the first time stamp to the third module.
In a fifth aspect, an embodiment of the present invention further provides a data processing apparatus applied to a vehicle, where the vehicle includes a first module, a second module, and a third module, and the apparatus is configured in the second module, and includes:
the third synchronization unit is used for performing clock synchronization with the first module connected with the local area network through the level signal;
the second timestamp adding unit is used for adding a second timestamp to the acquired second vehicle information according to the synchronized local clock;
and the second information sending module is used for sending the second vehicle information added with the second time stamp to the third module.
In a sixth aspect, an embodiment of the present invention further provides a data processing apparatus applied to a vehicle, where the vehicle includes a first module, a second module, and a third module, and the apparatus is configured in the third module, and includes:
the first vehicle information acquisition unit is used for acquiring first vehicle information carrying a first time stamp sent by the first module through a local area network;
the second vehicle information acquisition unit is used for acquiring second vehicle information carrying a second time stamp and sent by the second module through the vehicle bus network;
a vehicle data set generating unit, configured to process the first vehicle information and the second vehicle information according to the first timestamp and the second timestamp, and generate a vehicle data set;
the first timestamp and the second timestamp are added after clock synchronization of the first module and the second module.
In a seventh aspect, an embodiment of the present invention further provides an apparatus, including:
one or more processors;
a memory for storing one or more programs;
the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the data processing method as provided in any embodiment of the invention.
In an eighth aspect, embodiments of the present invention also provide a computer-readable storage medium having a computer program stored thereon. Wherein the program, when executed by a processor, implements a data processing method as provided by any of the embodiments of the present invention.
According to the technical scheme provided by the embodiment of the invention, the first module receives the clock synchronization signal through the local area network to synchronize the local clock, and simultaneously, the first module performs clock synchronization with the second module in a level signal mode by utilizing the vehicle bus network, and finally, the first vehicle information is obtained by adding the time stamp; the second module performs clock synchronization with the first module connected with the local area network through the level signal and adds a time stamp to obtain second vehicle information, so that time synchronization of different data sources can be realized, and the third module performs more accurate fusion processing on the first vehicle information obtained by the first module and the second vehicle information obtained by the second module to generate a vehicle data set and obtain more accurate vehicle data. The method provides a new idea of how to perform time synchronization between different modules (such as a first module and a second module) under different networks, the first module adds a time stamp for the acquired first vehicle information based on the synchronized time, the accuracy of the time stamp of the first vehicle information is improved, and a guarantee is provided for the follow-up third module to accurately analyze the vehicle information acquired by the different modules under the same time.
Drawings
FIG. 1 is a flow chart of a data processing method according to an embodiment of the present invention;
FIG. 2 is a flowchart of a data processing method according to an embodiment of the present invention;
FIG. 3 is a flowchart of a data processing method according to an embodiment of the present invention;
FIG. 4A is a flowchart of a data processing method according to an embodiment of the present invention;
FIG. 4B is a schematic diagram of a data processing principle according to an embodiment of the present invention;
FIG. 5 is a block diagram of a data processing apparatus according to an embodiment of the present invention;
FIG. 6 is a block diagram of a data processing apparatus according to an embodiment of the present invention;
FIG. 7 is a block diagram of a data processing apparatus according to an embodiment of the present invention;
fig. 8 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
The invention is described in further detail below with reference to the drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting thereof. It should be further noted that, for convenience of description, only some, but not all of the structures related to the present invention are shown in the drawings.
The vehicle in the present embodiment includes: the first module, the second module, and the third module may be software modules, hardware modules, or physical devices in the vehicle, and the embodiment is not limited thereto. The number of each module in the vehicle is at least one.
In this embodiment, the first module may be a module connected to a local area network on a vehicle, for example, may include, but is not limited to: vehicle positioning equipment, image acquisition equipment, audio acquisition equipment, physiological data acquisition equipment and the like. The vehicle positioning device is a device for acquiring vehicle GPS positioning data by using GPS (Global Positioning System ) positioning technology. The image capturing device may include a capturing element such as a camera, a sensor, or the like for capturing an interior of a vehicle or an environment around the vehicle, which may include an environment in front of the vehicle, behind the vehicle, or in a vehicle-side direction, and acquiring image or video data. The audio collection device may include a collection element such as a microphone for collecting voice data inside the vehicle. The physiological data acquisition device is a device which can acquire data of the driver in the aspects of electrocardio, electroencephalogram, myoelectricity, gastrointestinal electricity, blood pressure, muscle tension or tissue blood flow and the like. A time sensitive network (Time Sensitive Networking, TSN) is deployed in each first module. By TSN is meant a set of protocol standards defining time sensitive mechanisms for ethernet data transmission, and by deploying a time sensitive network TSN, devices comprised by the first module may communicate over a more stable and reliable ethernet.
The second module is a module connected to the vehicle bus network, for example, a control device including at least a vehicle driving behavior acquisition device and a vehicle safety restraint assembly. The vehicle driving behavior acquisition device can be used for acquiring vehicle driving information data, such as vehicle driving speed, vehicle driving acceleration, vehicle front wheel turning angle, vehicle steering wheel turning angle and the like. The vehicle safety restraint assembly is a vehicle assembly having a safety restraint function, and may be an assembly such as a seat belt or an airbag. The control device of the vehicle safety restraint assembly refers to a device that controls the operation of the vehicle safety restraint assembly, and may be, for example, a device such as a seat belt control device or an airbag controller. The control device of the vehicle safety restraint assembly may be configured to collect vehicle restraint system behavior data.
The third module may be a control device of the vehicle, which may interact with the first module through a local area network, and may also interact with the second module through a vehicle bus network, so as to obtain and analyze vehicle information collected by the first module and the second module.
At least one first module in the vehicle of the present embodiment is also connected to the vehicle bus network, i.e. at least one first module is capable of interacting with each second module.
Fig. 1 is a flowchart of a data processing method according to a first embodiment of the present invention, where the method is applicable to a case of synchronizing data processing on modules connected to different networks, and is particularly applicable to a case of synchronizing time between modules connected to a local area network and a bus network of a vehicle, and a case of data acquisition, and the method may be performed by a data processing device, which may be implemented in a software and/or hardware manner, and may be integrated in an electronic device having a data processing function, where the electronic device is configured in a first module of the vehicle. The first module for executing the present embodiment is a first module for connecting a local area network and a vehicle bus network simultaneously in a vehicle. As shown in fig. 1, the data processing method provided in this embodiment specifically includes:
s101, receiving a clock synchronization signal through a local area network.
Where a local area network refers to a wireless network located on a vehicle, for example, may include, but is not limited to, ethernet or Wi-Fi (Wireless Fidelity, wireless communication technology), and the like. Communication between devices (e.g., first modules) located under the same local area network may be performed through the local area network. The clock synchronization signal refers to a signal containing clock synchronization request information. The clock synchronization signal may be generated by at least one first module in the local area network based on the TSN protocol deployed thereon and transmitted to the local area network, and the first module performing the method of the embodiment may receive the clock synchronization signal through the local area network.
Optionally, the receiving, by the first module, the clock synchronization signal via the local area network includes: receiving the clock synchronization signal over the local area network includes: receiving a clock synchronization signal sent by a vehicle body gateway through a local area network; and/or receiving clock synchronization signals sent by other first modules connected with the local area network through the local area network. The vehicle body gateway, namely a central gateway in the vehicle, is the core of the communication of the local area network in the vehicle, and can be regarded as a first module of the vehicle because the vehicle body gateway is also connected with the local area network.
In this embodiment, if the vehicle body gateway sends the clock synchronization signal to the local area network, the first module executing the scheme may receive the clock synchronization signal sent by the vehicle body gateway through the local area network; if the rest of the first modules in the local area network send clock synchronization signals to the local area network, the first module executing the scheme can receive the clock synchronization signals sent by the rest of the first modules connected with the local area network through the local area network. If the first module executing the scheme receives clock synchronization signals sent by a plurality of different sending ends from the local area network, the first module can select one from the clock synchronization signals to execute subsequent operations according to a certain screening rule.
S102, synchronizing the local clock according to the clock synchronizing signal.
The local clock refers to clock information local to the first module of the vehicle. The purpose of the synchronization is to keep the clock information local to the first module of the vehicle consistent with the clock information in the received clock synchronization signal.
It should be noted that, due to network delay, the clocks of the first modules in the same local area network are often not synchronized, that is, the time when the different first modules receive data is different at the same time, that is, the clocks of the first modules are not synchronized, so that the local clocks of the first modules need to be synchronized according to a uniform clock synchronization signal.
For example, after receiving, through the local area network, clock synchronization signals from the body gateway and/or other first modules connected to the local area network, the local clock may be synchronized according to the received clock synchronization signals. Specifically, the local clock information may be updated to the clock information in the received synchronization signal.
S103, clock synchronization is carried out on the second module connected with the vehicle bus network through the level signal.
The level signal is a signal represented by a level value, and the level value may be divided into a high level "1" and a low level value "0". The vehicle bus network may be a CAN bus network, CANFD bus network, LIN bus network, flexRay bus network, or the like.
Optionally, since the first module of the present embodiment may further communicate with the second module through the vehicle bus network, the first module may receive the clock synchronization signal through the local area network and synchronize the local clock according to the clock synchronization signal, and may interact with the second module connected through the vehicle bus network, and send a level signal to the second module, so that the second module performs time synchronization with the first module based on the level signal.
Optionally, clock synchronization with a second module connected to the vehicle bus network via a level signal includes: generating a level signal; transmitting the level signal to a second module connected to the vehicle bus network through the vehicle bus network; the second module is controlled to perform clock synchronization based on the level signal.
Specifically, after the first module receives the clock synchronization signal through the local area network, a level signal, such as a high level signal or a low level signal, may be generated based on the clock synchronization signal. And then, the generated level signal is sent to a second module connected with the first module through the vehicle bus network on the basis of the vehicle bus network through a hard wire, so that the second module is controlled to perform clock synchronization on the basis of the level signal through the level signal.
It should be noted that, since the vehicle may include one or more second modules. If there are a plurality of second modules, each of the second modules needs to be clock-synchronized when clock-synchronizing with the second module connected to the vehicle bus network by the level signal.
S104, adding a first time stamp to the acquired first vehicle information according to the synchronized local clock, and sending the first vehicle information added with the first time stamp to the third module.
The synchronized local clock refers to the updated local clock information after the first module executes step S102. The first timestamp refers to an acquisition time corresponding to the first module acquiring the first vehicle information. The first vehicle information may be data information acquired when the first module is used as a data acquisition source, for example, if the first module is a vehicle positioning device, the first vehicle information is positioning information of a vehicle; if the first module is an image acquisition device, the first vehicle information is image or video data of the interior of the vehicle or the surrounding environment of the vehicle; if the first module is an audio acquisition device, the first vehicle information is audio data of the vehicle interior or the surrounding environment of the vehicle; if the first module is a physiological data acquisition device, the first vehicle information is physiological data of the driver.
Optionally, when the first module is used as a data acquisition source, the first module can acquire vehicle information in real time or at regular time, after the first vehicle information is acquired, a time stamp is made for acquiring the first vehicle information based on a local clock, namely, acquisition time is marked in the first vehicle information, and then the first vehicle information added with the first time stamp is sent to the third module. Because the local time of the first module is synchronized based on the clock synchronization signal, the time stamp added to the first vehicle information is accurate, that is, the time of each first vehicle information sent by each first module and received by the third module is synchronized.
In the embodiment of the present application, when the first module of the vehicle is a vehicle body gateway, the first module only needs to execute S101-S103; the first module of the vehicle performs only the operations of S101-S102, and S104 when it is a data acquisition device and it does not support the vehicle bus network. The first module of the vehicle performs the operations of S101-S104 when the first module is a data acquisition device and it supports a vehicle bus network.
In the technical scheme provided by the embodiment of the invention, a first module of a vehicle receives a clock synchronization signal through a local area network, synchronizes a local clock according to the clock synchronization signal, performs clock synchronization with a second module connected with a vehicle bus network through a level signal, adds a first timestamp to acquired first vehicle information according to the synchronized local clock, and sends the first vehicle information added with the first timestamp to a third module; the scheme provides a new idea of how to perform time synchronization between different modules (such as a first module and a second module) under different networks, the first module adds a time stamp for the acquired first vehicle information based on the synchronized time, the accuracy of the time stamp of the first vehicle information is improved, and a guarantee is provided for follow-up accurate analysis of the vehicle information acquired by the different modules under the same time.
Optionally, the embodiment further includes, before receiving the clock synchronization signal through the local area network: the first module connected to the local area network and the second module connected to the vehicle bus network perform initial clock synchronization through the vehicle bus network. The initial clock refers to clock information synchronized with the second module before the first module receives the clock synchronization signal for the first time. I.e. the synchronization of the initial clock is not based on the clock synchronization signal. Alternatively, after the vehicle is started, the first module and the second module in the vehicle perform initial clock synchronization through the vehicle bus according to the level signal. The accuracy of clock synchronization based on the clock signal is higher than that of the initial clock synchronization, for example, the accuracy of clock synchronization based on the clock signal is 1ms, and the accuracy of clock synchronization based on the initial clock is 100ms. According to the technical scheme, the first module and the second module are synchronized through the initial clock before accurate clock synchronization is performed based on the clock synchronization signals, so that clock errors of the first module and the second module are reduced before accurate clock synchronization is performed.
Fig. 2 is a flowchart of a data processing method according to a second embodiment of the present invention, where on the basis of the foregoing embodiment, the present embodiment may be suitable for a case of synchronizing data processing on modules connected to different networks, especially for a case of synchronizing time between modules connected to a local area network and a bus network of a vehicle, and a case of data acquisition, where the method may be performed by a data processing apparatus, and the apparatus may be implemented in a software and/or hardware manner, and may be integrated into an electronic device having a data processing function, where the electronic device is configured in a second module of the vehicle. As shown in fig. 2, the data processing method provided in this embodiment specifically includes:
S201, clock synchronization is carried out with a first module connected with a local area network through a level signal.
The first module connected to the local area network in this embodiment is a first module supporting communication between the local area network and the vehicle bus network at the same time.
For example, the first module of the vehicle converts the real-time clock synchronization signal into a level signal and sends the level signal to the second module, and the second module in the vehicle completes clock synchronization according to the level signal after receiving the level signal, that is, the second module performs clock synchronization with the first module connected to the local area network through the level signal.
Optionally, clock synchronization with a first module connected to the local area network through the level signal includes: receiving a level signal sent by a first module connected with a local area network through a vehicle bus network; local clock synchronization is performed based on the level signal. The level signal is generated after the first module receives the clock synchronization signal through the local area network. Specifically, after the first module receives the clock synchronization signal through the local area network, a level signal, such as a high level signal or a low level signal, may be generated based on the clock synchronization signal. And then, the generated level signal is sent to a second module connected with the first module through the vehicle bus network on the basis of the vehicle bus network through a hard wire, so that the second module is controlled to perform clock synchronization on the basis of the level signal through the level signal.
S202, adding a second timestamp to the acquired second vehicle information according to the synchronized local clock.
The synchronized local clock refers to the updated local clock information after the second module executes step S201. The second timestamp refers to an acquisition time corresponding to the second module acquiring the second vehicle information. The second vehicle information may be data information collected when the second module is used as a data collection source, for example, if the second module is a vehicle driving behavior collection device, the second vehicle information is vehicle driving behavior data of the vehicle; if the second module is a control device of the vehicle safety restraint assembly, the second vehicle information is vehicle restraint system behavior data of the vehicle.
Optionally, when the second module is used as a data acquisition source, the second module can acquire the vehicle information in real time or at fixed time, and after the second vehicle information is acquired, the second vehicle information is time stamped based on the local clock, namely, the acquisition time is marked in the second vehicle information.
And S203, transmitting the second vehicle information added with the second time stamp to a third module.
The second module collects the vehicle information in real time or at a fixed time, and further transmits the second vehicle information to which the second time stamp has been added to the third module after the second vehicle information is collected and the collected second vehicle information is time-stamped based on the local clock, that is, after the collection time is marked in the second vehicle information.
Since the local time of the second module is synchronized based on the level signal, the time stamp added to the second vehicle information is accurate, that is, the time of each second vehicle information transmitted by each second module received by the third module is synchronized.
In the technical scheme provided by the embodiment of the invention, the second module of the vehicle is in clock synchronization with the first module connected with the local area network through the level signal, a second time stamp is added for the acquired second vehicle information according to the synchronized local clock, and finally the second vehicle information added with the second time stamp is sent to the third module. The scheme provides a new idea of how to perform time synchronization between different modules (such as a first module and a second module) under different networks, and the second module adds a time stamp for the acquired second vehicle information based on the synchronized time, so that the accuracy of the time stamp of the second vehicle information is improved, and a guarantee is provided for the follow-up accurate analysis of the vehicle information acquired by the different modules under the same time.
Fig. 3 is a flowchart of a data processing method according to an embodiment of the present invention. On the basis of the above embodiment, the present embodiment is applicable to a case of processing data collected by modules of different networks, and is particularly applicable to a case of processing data collected by modules connecting a local area network and a vehicle bus network. The method may be performed by a data processing apparatus, which may be implemented in software and/or hardware, and may be integrated in an electronic device having data processing functionality. The electronic device is configured in a third module of the vehicle. As shown in fig. 3, the data processing method provided in this embodiment specifically includes:
S301, acquiring first vehicle information carrying a first time stamp and sent by a first module through a local area network.
S302, acquiring second vehicle information carrying a second time stamp and sent by a second module through a vehicle bus network.
The first vehicle information carrying the first timestamp may be first vehicle information to which the first timestamp is added, which is obtained by the method provided by the above embodiment of the present invention. The second vehicle information carrying the second time stamp may be second vehicle information to which the second time stamp has been added, which is obtained by the method provided by the above-described embodiment of the present invention. The third module can acquire the first vehicle information sent by the first module through a local area network, and can acquire the second vehicle information sent by the second module through a vehicle bus network.
Alternatively, the third module may actively acquire the first vehicle information and the second vehicle information through S301 and S302, or may passively acquire the first vehicle information and the second vehicle information through S301 and S302. Specifically, the third module may actively send a data acquisition request to the first module and the second module to acquire the first vehicle information and the second vehicle information, and correspondingly, the first module and the second module may feed back the third module based on the data acquisition request, that is, send the first vehicle information and the second vehicle information to the third module; optionally, the first module and the second module may further send the first vehicle information and the second vehicle information to the third module in real time or at a fixed time, where the third module passively acquires the first vehicle information and the second vehicle information.
Further, the third module may acquire the first vehicle information and the second vehicle information from the first module and the second module after receiving the vehicle information acquisition requirement issued by the user; the third module can also acquire the first vehicle information from the first module through the local area network when the data volume of the first vehicle information or the second vehicle information reaches a certain threshold value, and acquire the second vehicle information from the second module through the vehicle bus network at the same time; the third module may also acquire the first vehicle information and the second vehicle information from the first module and the second module when a duration of the first module and the second module collecting the first vehicle information and the second vehicle information reaches a certain threshold.
S303, processing the first vehicle information and the second vehicle information according to the first timestamp and the second timestamp to generate a vehicle data set.
The first time stamp and the second time stamp are added after clock synchronization of the first module and the second module. The vehicle data set refers to a data set including first vehicle information and second vehicle information.
Alternatively, so-called vehicle datasets may be used for subsequent presentation in accordance with the viewing needs of the person concerned with the viewing rights.
Further, the third module of the vehicle may perform S301 and S302 simultaneously or sequentially, which is not limited in the present invention.
The third module of the vehicle may further integrate the data of all the periods corresponding to the first vehicle information and the second vehicle information according to the first timestamp included in the first vehicle information and the second timestamp included in the second vehicle information after obtaining the first vehicle information with the first timestamp sent by the first module and/or obtaining the second vehicle information with the second timestamp sent by the second module through the vehicle bus network through the local area network, or may only obtain the data of some special scenes, such as the data of the accident scene, so as to generate the vehicle data set.
According to the technical scheme provided by the embodiment of the invention, the third module of the vehicle performs grouping integration on the vehicle information acquired by the first module and the second module after clock synchronization, and further generates the vehicle data set, so that more accurate and comprehensive vehicle data can be obtained.
Optionally, processing the first vehicle information and the second vehicle information according to the first timestamp and the second timestamp to generate a vehicle data set includes:
If the first timestamp and the second timestamp belong to the vehicle fault time period, grouping the first vehicle information and the second vehicle information according to the first timestamp and the second timestamp to obtain a vehicle information group corresponding to each time period; and integrating the vehicle information sets corresponding to the time periods according to the sequence of the time periods to obtain a vehicle data set.
The vehicle failure period may be a period of time before and after the vehicle fails, for example, may be 5 minutes or 10 minutes before and after the vehicle fails. The fault of the vehicle can be the sudden fault such as the rear-end collision of the vehicle and other vehicles, the collision of the vehicle to roadside obstacles, the sudden stop of the vehicle without oil, the tire burst of the vehicle and the like. The vehicle information group may be obtained by grouping and sorting the first vehicle information and the second vehicle information based on time information corresponding to the vehicle information data acquired from the first module and the second module of the vehicle.
Specifically, after the third module of the vehicle obtains the first vehicle information carrying the first timestamp sent by the first module through the local area network and/or obtains the second vehicle information carrying the second timestamp sent by the second module through the vehicle bus network, the vehicle time period to which the first timestamp and the second timestamp belong is further judged according to the first timestamp and/or the second timestamp contained in the second vehicle information contained in the first vehicle information, if the first timestamp and the second timestamp belong to the vehicle failure time period, the first vehicle information and the second vehicle information are grouped according to the first timestamp and the second timestamp to obtain vehicle information groups corresponding to each time period, and finally the vehicle information groups corresponding to each time period are integrated according to the sequence of the time periods. For example, if the failure time of the vehicle is 9 points, the failure time of the vehicle may be selected from a time period from 9 points to 9 points 20 minutes, further, the first vehicle information and the second vehicle information from 9 points to 9 points 20 minutes may be divided into two groups, namely, from 9 points to 9 points 10 minutes and from 9 points 10 to 9 points 20 minutes, to obtain the first vehicle information group and the second vehicle information group corresponding to the two time periods, and the vehicle information groups corresponding to the two time periods are integrated according to the sequence of the two time periods, that is, the data of the first vehicle information group is added at the position corresponding to the 9 points to 9 points 10 minutes on the time axis, and the data of the second vehicle information group is added at the position corresponding to the 9 points 10 minutes to 9 points 20 minutes on the time axis, so as to obtain the time axis data based on the time ordering distribution, that is, the vehicle data set based on the time ordering distribution.
It should be noted that, the first module and the second module of the vehicle may collect relevant data in real time and store the collected data periodically, if no vehicle fault occurs in the stored time period, the vehicle may cover the originally stored data in the next period, release the memory space of the buffer pool, or may not cover the originally stored data in the next period, but continue to open up a new space in the buffer pool to store the data acquired in the next period, so as to facilitate calling and viewing of relevant data when necessary.
Optionally, grouping the first vehicle information and the second vehicle information according to the first timestamp and the second timestamp to obtain a vehicle information group corresponding to each time period, including: encoding the first vehicle information and the second vehicle information according to the encoding rule corresponding to the data format; and grouping the coding results according to the first timestamp and the second timestamp to obtain a vehicle information group corresponding to each time period.
The data formats may include a binary format, a data format corresponding to a picture video, a custom format, and the like. The coding rule refers to a coding rule corresponding to a data format.
Alternatively, the vehicle driving behavior data and the vehicle restraint system behavior data may be encoded in binary data encoding. The vehicle image data, video data, and vehicle audio data may be encoded using a commonly used H264 encoding format. The physiological data can be encoded by a self-defined encoding mode.
For example, after the first vehicle information and the second vehicle information are encoded according to the encoding rule corresponding to the data format, the encoding results may be further grouped according to the first timestamp and the second timestamp to obtain the vehicle information groups corresponding to the time periods, and the vehicle information groups corresponding to the time periods are integrated according to the sequence of the time periods to obtain the vehicle data set.
According to the technical scheme provided by the embodiment of the invention, the third vehicle module obtains the first vehicle information with the first time stamp sent by the first module through the local area network, obtains the second vehicle information with the second time stamp sent by the second module through the vehicle bus network, and finally processes the first vehicle information and the second vehicle information according to the first time stamp and the second time stamp to generate the vehicle data set. The third module is used for carrying out more accurate fusion processing on the first vehicle information obtained by the first module and the second vehicle information obtained by the second module to generate a vehicle data set, so that the vehicle data set containing more accurate and comprehensive information of each time period of the vehicle can be obtained.
Optionally, after obtaining the vehicle information group corresponding to each time period, the embodiment further includes: judging whether missing data exists in each vehicle information group; if so, acquiring candidate data which corresponds to the missing data time period and is acquired by the candidate acquisition equipment; and updating the vehicle information group according to the candidate data.
The missing data refers to data which is missing due to damage to equipment on the vehicle when the vehicle breaks down. For some important data, at least one candidate acquisition device may be provided on the vehicle in order to ensure that the data is not lost. For example, a plurality of microphones may be configured on a vehicle with one of the microphones as a primary audio collection device and the remaining microphones as candidate audio collection devices. The candidate data refers to data corresponding to a missing data period acquired by the candidate acquisition device.
The method includes the steps of processing first vehicle information and second vehicle information according to a first timestamp and a second timestamp, further judging whether missing data exist in each vehicle information group after the vehicle information groups corresponding to each time period are obtained, judging whether candidate acquisition equipment is arranged in the missing data, acquiring candidate data corresponding to the missing data time period, acquired by the candidate acquisition equipment, updating the vehicle information groups according to the candidate data, and integrating the vehicle information groups corresponding to each time period according to the sequence of the time period to obtain a vehicle data set. If not, outliers are used to characterize the missing data. According to the technical scheme, by arranging the candidate acquisition equipment, the problem that certain types of vehicle information are lost in the vehicle data set due to the damage of the main equipment is avoided, and the integrity and the accuracy of the vehicle data set are greatly ensured.
Fig. 4A is a flowchart of a data processing method according to an embodiment of the present invention, and fig. 4B is a schematic diagram of a data processing principle according to an embodiment of the present invention, on the basis of the foregoing embodiment, the preferred steps after "generating a vehicle data set" are further explained in detail, as shown in fig. 4A-4B, where the data processing method according to the embodiment specifically includes:
s401, acquiring first vehicle information carrying a first time stamp and sent by a first module through a local area network.
S402, acquiring second vehicle information carrying a second timestamp and sent by a second module through a vehicle bus network.
S403, processing the first vehicle information and the second vehicle information according to the first timestamp and the second timestamp to generate a vehicle data set.
S404, responding to the vehicle accident inquiring request, and determining the collision time to be inquired.
The vehicle accident query request can be a query request sent by a related person with viewing authority. The query request may include information such as a time period of the query and a data type of the query. The collision time may be a period in which the vehicle is malfunctioning, or may be a time point in the period in which the vehicle is malfunctioning.
After the related personnel with the checking authority sends the vehicle accident inquiring request to the vehicle through the reading equipment of the vehicle, the third module of the vehicle responds to the vehicle accident inquiring request and further determines the collision time to be inquired according to the received vehicle accident inquiring request.
Optionally, if the reading device of the vehicle sends a corresponding vehicle accident querying request to the vehicle control unit, the vehicle control unit further sends the vehicle accident querying request to a third vehicle module, and the third vehicle module receives the corresponding vehicle accident querying request; if the reading device of the vehicle directly sends the corresponding vehicle accident inquiring request to the third vehicle module, the third vehicle module can directly receive the corresponding vehicle accident inquiring request.
And S405, extracting target vehicle information from the vehicle data set according to the collision time.
The target vehicle information refers to vehicle information of the vehicle to be queried, which is determined by related personnel with viewing authority. The target vehicle information may include vehicle data corresponding to a collision time. The vehicle data may be data obtained by the vehicle third module after fusion processing of data acquired by the first module and/or the second module of the vehicle.
For example, after determining the collision time to be queried in response to the vehicle accident query request, the vehicle third module may extract the target vehicle information from the vehicle dataset further according to the collision time.
S406, generating a vehicle accident report according to the target vehicle information.
The vehicle accident report may include a vehicle collision time, a name of each collecting device of the vehicle, an accident cause, and vehicle data collected by the collecting device. The vehicle accident report may be generated by a vehicle controller in a third module of the vehicle.
Optionally, after the third module of the vehicle extracts the target vehicle information from the vehicle data set according to the collision time in response to the vehicle accident query request, the target vehicle information may be further sorted according to the target vehicle information according to a time sequence or a grouping basis such as a vehicle data type, so as to generate a corresponding vehicle accident report, that is, display the vehicle data in the collision time period according to the query request of the related person with the viewing authority.
Optionally, the third vehicle module may further analyze the target vehicle information after extracting the target vehicle information from the vehicle data set according to the collision time in response to the vehicle accident query request, determine an accident cause, and generate a corresponding vehicle accident result according to the accident cause as a vehicle accident report.
Optionally, referring to fig. 4B, the embodiment has four first modules, which are an image acquisition device, an audio acquisition device, a physiological data acquisition device, and a vehicle positioning device, respectively, where clock synchronization can be performed between the four first modules through a local area network; the embodiment is provided with two second modules which are respectively vehicle driving behavior acquisition equipment and control equipment of a vehicle safety restraint assembly, wherein the two second modules can carry out clock synchronization through level signals sent by the first module; for example, clock synchronization can be performed between the image acquisition device and the control device of the vehicle safety restraint assembly, and between the image acquisition device and the vehicle driving behavior acquisition device respectively through level signals.
Optionally, referring to fig. 4B, the third module acquires, through the vehicle bus network, vehicle driving behavior data, that is, second vehicle information, acquired by the vehicle driving behavior acquisition device, acquires, through the vehicle bus network, vehicle constraint system behavior data, that is, second vehicle information, acquired by the vehicle safety constraint component control device, acquires, through the vehicle bus network, image data, that is, first vehicle information, acquired by the image acquisition device, acquires, through the local network, audio data, that is, first vehicle information, acquired by the audio acquisition device, acquires, through the local network, physiological data, that is, first vehicle information, acquired by the physiological data acquisition device, and acquires, through the local network, vehicle GPS positioning data, that is, first vehicle information, acquired by the vehicle positioning device. The third module further processes the first vehicle information and the second vehicle information according to the first timestamp and the second timestamp in the first vehicle information and the second vehicle information to generate a vehicle data set, if the first timestamp and the second timestamp belong to a vehicle failure period, the third module records collision accident data which is the generated vehicle data set, and when a reading request sent by the reading device is received, the collision accident data is fed back to the reading device.
According to the technical scheme provided by the embodiment of the invention, the third vehicle module obtains the first vehicle information carrying the first timestamp sent by the first module through the local area network, obtains the second vehicle information carrying the second timestamp sent by the second module through the vehicle bus network, processes the first vehicle information and the second vehicle information according to the first timestamp and the second timestamp finally, generates the vehicle data set, further responds to the vehicle accident inquiring request, determines the collision time to be inquired, extracts the target vehicle information from the vehicle data set according to the collision time, and finally generates the vehicle accident report according to the target vehicle information.
Fig. 5 is a block diagram of a data processing device according to a fifth embodiment of the present invention, where the data processing device according to the fifth embodiment of the present invention may execute a data processing method according to any one of the embodiments of the present invention, and the data processing device has functional modules and beneficial effects corresponding to the execution method. The data processing apparatus is configured in a first module, and may include a receiving unit 501, a first synchronizing unit 502, a second synchronizing unit 503, a first time stamp adding unit 504, and a first information transmitting unit 505.
Wherein, the receiving unit 501 is configured to receive a clock synchronization signal through a local area network;
a first synchronization unit 502, configured to synchronize a local clock according to the clock synchronization signal;
a second synchronization unit 503, configured to perform clock synchronization with a second module connected to the vehicle bus network through a level signal;
a first timestamp adding unit 504, configured to add a first timestamp to the collected first vehicle information according to the synchronized local clock;
a first information transmitting unit 505 for transmitting the first vehicle information to which the first time stamp has been added to the third module;
according to the technical scheme provided by the embodiment of the invention, the first module receives the clock synchronization signal through the local area network and performs clock synchronization with the second module in a level signal mode by utilizing the vehicle bus network, and finally, the first vehicle information is obtained by adding the time stamp.
Further, the second synchronization unit 503 may include:
a signal generation subunit for generating a level signal;
a signal transmitting subunit for transmitting the level signal to a second module connected to the vehicle bus network through the vehicle bus network;
And the clock synchronization subunit is used for controlling the second module to perform clock synchronization based on the level signal.
Further, the receiving unit 501 may include:
the signal sending subunit is used for receiving the clock synchronization signal sent by the vehicle body gateway through the local area network;
and/or the number of the groups of groups,
and the synchronous signal receiving subunit is used for receiving clock synchronous signals sent by the other first modules connected with the local area network through the local area network.
Further, the device is specifically further used for:
before receiving the clock synchronization signal through the local area network, a first module connected with the local area network and a second module connected with the vehicle bus network perform initial clock synchronization through the vehicle bus network.
Further, the first module includes at least one of: vehicle positioning equipment, image acquisition equipment, audio acquisition equipment and physiological data acquisition equipment.
Optionally, the first module is deployed with a time sensitive network TSN.
Fig. 6 is a block diagram of a data processing device according to an embodiment of the present invention, where the data processing device according to the embodiment of the present invention may execute a data processing method according to any one of the embodiments of the present invention, and the data processing device has functional modules and beneficial effects corresponding to the execution method. The data processing apparatus is configured in a second module, and the data processing apparatus may include a third synchronization unit 601, a second timestamp adding unit 602, and a second information transmitting unit 603.
The third synchronization unit 601 is configured to perform clock synchronization with a first module connected to the local area network through a level signal;
a second timestamp adding unit 602, configured to add a second timestamp to the collected second vehicle information according to the synchronized local clock;
a second information sending unit 603, configured to send the second vehicle information to which the second timestamp has been added to the third module.
According to the technical scheme provided by the embodiment of the invention, the second module performs clock synchronization with the first module connected with the local area network through the level signal, a second time stamp is added for the acquired second vehicle information according to the synchronized local clock, and finally the second vehicle information added with the second time stamp is sent to the third module.
Further, the third synchronization unit 601 may include:
the level signal receiving subunit is used for receiving the level signal sent by the first module connected with the local area network through the vehicle bus network, wherein the level signal is generated after the first module receives the clock synchronization signal through the Ethernet;
And the local synchronization subunit is used for carrying out local clock synchronization according to the level signal.
Optionally, the second module is a control device of a vehicle safety restraint assembly.
Fig. 7 is a block diagram of a data processing device according to an embodiment of the present invention, where the data processing device according to the embodiment of the present invention may execute a data processing method according to any one of the embodiments of the present invention, and the data processing device has functional modules and beneficial effects corresponding to the execution method. The data processing apparatus is configured in the second module, and may include a first vehicle information acquisition unit 701, a second vehicle information acquisition unit 702, and a vehicle data set generation unit 703.
The first vehicle information obtaining unit 701 is configured to obtain, through a local area network, first vehicle information carrying a first timestamp sent by the first module;
a second vehicle information obtaining unit 702, configured to obtain, through a vehicle bus network, second vehicle information carrying a second timestamp sent by a second module;
a vehicle data set generating unit 703 configured to process the first vehicle information and the second vehicle information according to the first time stamp and the second time stamp, and generate a vehicle data set;
The first time stamp and the second time stamp are added after clock synchronization of the first module and the second module.
According to the technical scheme, the first vehicle information with the first timestamp sent by the first module is obtained through the local area network, the second vehicle information with the second timestamp sent by the second module is obtained through the vehicle bus network, finally the first vehicle information and the second vehicle information are processed according to the first timestamp and the second timestamp to generate the vehicle data set, and in such a way, the third module carries out more accurate fusion processing on the first vehicle information obtained by the first module and the second vehicle information obtained by the second module to generate the vehicle data set, so that more accurate vehicle data is obtained.
Further, the vehicle data set generation unit 703 may include:
the vehicle information group acquisition subunit is used for grouping the first vehicle information and the second vehicle information according to the first timestamp and the second timestamp if the first timestamp and the second timestamp belong to the vehicle fault time period, so as to obtain a vehicle information group corresponding to each time period;
and the vehicle data set acquisition subunit is used for integrating the vehicle information sets corresponding to the time periods according to the sequence of the time periods to obtain a vehicle data set.
Further, the vehicle data set generation unit 703 may further include:
the coding subunit is used for coding the first vehicle information and the second vehicle information according to coding rules corresponding to the data format;
and the grouping subunit is used for grouping the coding result according to the first timestamp and the second timestamp to obtain a vehicle information group corresponding to each time period.
Further, the device further comprises a judging unit, a candidate data obtaining unit and an updating unit.
The judging unit is used for judging whether missing data exists in each vehicle information group after the vehicle information group corresponding to each time period is obtained;
a candidate data acquisition unit, configured to acquire candidate data corresponding to a missing data period acquired by the candidate acquisition device if missing data exists in each vehicle information group after obtaining the vehicle information group corresponding to each period;
and updating means for updating the vehicle information group based on the candidate data after obtaining the vehicle information group corresponding to each time zone.
Further, the device further comprises a collision time determining unit, an extracting unit and a report generating unit.
Wherein, the collision time determining unit is used for responding to the vehicle accident inquiring request after generating the vehicle data set, and determining the collision time to be inquired;
An extraction unit that extracts target vehicle information from the vehicle data set according to the collision time after the vehicle data set is generated;
and a report generation unit for generating a vehicle accident report according to the target vehicle information after generating the vehicle data set.
Fig. 8 is a schematic structural diagram of an electronic device provided by an embodiment of the present invention, and fig. 8 shows a block diagram of an exemplary device suitable for implementing an embodiment of the present invention. The device shown in fig. 8 is merely an example, and should not be construed as limiting the functionality and scope of use of embodiments of the present invention.
As shown in fig. 8, the electronic device 12 is in the form of a general purpose computing device. Components of the electronic device 12 may include, but are not limited to: one or more processors or processing units 16, a system memory 28, a bus 18 that connects the various system components, including the system memory 28 and the processing units 16.
Bus 18 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor, and a local bus using any of a variety of bus architectures. By way of example, and not limitation, such architectures include Industry Standard Architecture (ISA) bus, micro channel architecture (MAC) bus, enhanced ISA bus, video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect (PCI) bus.
Electronic device 12 typically includes a variety of computer system readable media. Such media can be any available media that is accessible by electronic device 12 and includes both volatile and nonvolatile media, removable and non-removable media.
The system memory 28 may include computer system readable media in the form of volatile memory, such as Random Access Memory (RAM) 30 and/or cache memory (cache 32). The electronic device 12 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 34 may be used to read from or write to non-removable, nonvolatile magnetic media (not shown in FIG. 8, commonly referred to as a "hard disk drive"). Although not shown in fig. 8, a magnetic disk drive for reading from and writing to a removable non-volatile magnetic disk (e.g., a "floppy disk"), and an optical disk drive for reading from or writing to a removable non-volatile optical disk (e.g., a CD-ROM, DVD-ROM, or other optical media) may be provided. In such cases, each drive may be coupled to bus 18 through one or more data medium interfaces. The system memory 28 may include at least one program product having a set (e.g., at least one) of program modules configured to carry out the functions of embodiments of the invention.
A program/utility 40 having a set (at least one) of program modules 42 may be stored in, for example, system memory 28, such program modules 42 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each or some combination of which may include an implementation of a network environment. Program modules 42 generally perform the functions and/or methods of the embodiments described herein.
The electronic device 12 may also communicate with one or more external devices 14 (e.g., keyboard, pointing device, display 24, etc.), one or more devices that enable a user to interact with the electronic device 12, and/or any devices (e.g., network card, modem, etc.) that enable the electronic device 12 to communicate with one or more other computing devices. Such communication may occur through an input/output (I/O) interface 22. Also, the electronic device 12 may communicate with one or more networks such as a Local Area Network (LAN), a Wide Area Network (WAN) and/or a public network, such as the Internet, through a network adapter 20. As shown, the network adapter 20 communicates with other modules of the electronic device 12 over the bus 18. It should be appreciated that although not shown, other hardware and/or software modules may be used in connection with electronic device 12, including, but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, data backup storage systems, and the like.
The processing unit 16 executes various functional applications and data processing by running programs stored in the system memory 28, for example, implementing the data processing method provided by the embodiment of the present invention.
The embodiments of the present invention also provide a computer-readable storage medium having stored thereon a computer program (or referred to as computer-executable instructions) for performing the data processing method provided by the embodiments of the present invention when the program is executed by a processor.
The computer storage media of embodiments of the invention may take the form of any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the computer-readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
The computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations for embodiments of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider).
Note that the above is only a preferred embodiment of the present invention and the technical principle applied. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, while the embodiments of the present invention have been described in connection with the above embodiments, the embodiments of the present invention are not limited to the above embodiments, but may include many other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.

Claims (18)

1. A data processing method, characterized in that it is applied to a vehicle, the vehicle including a first module, a second module, and a third module, the first module performing a method comprising:
receiving a clock synchronization signal through a local area network;
synchronizing a local clock according to the clock synchronizing signal;
clock synchronization is carried out through the level signal and a second module connected with the bus network of the vehicle; the level signal is obtained by converting the clock synchronous signal by the first module;
Adding a first time stamp to the acquired first vehicle information according to the synchronized local clock, and sending the first vehicle information added with the first time stamp to the third module; the method further comprises the following steps before receiving the clock synchronization signal through the local area network:
and the first module connected with the local area network and the second module connected with the vehicle bus network perform initial clock synchronization through the vehicle bus network.
2. The method of claim 1, wherein the clock synchronizing with a second module connected to the vehicle bus network via a level signal comprises:
generating a level signal;
transmitting the level signal to a second module connected to the vehicle bus network via the vehicle bus network;
and controlling the second module to perform clock synchronization based on the level signal.
3. The method of claim 1, wherein receiving a clock synchronization signal over a local area network comprises:
receiving a clock synchronization signal sent by a vehicle body gateway through a local area network;
and/or the number of the groups of groups,
and receiving clock synchronization signals sent by other first modules connected with the local area network through the local area network.
4. The method of claim 1, wherein the first module comprises at least one of: vehicle positioning equipment, image acquisition equipment, audio acquisition equipment and physiological data acquisition equipment.
5. A method according to any of claims 1-3, characterized in that the first module is deployed with a time sensitive network, TSN.
6. A data processing method, characterized in that it is applied to a vehicle, the vehicle including a first module, a second module, and a third module, the second module performing a method comprising:
clock synchronization is carried out through the level signal and a first module connected with a local area network; the level signal is obtained by converting and transmitting the clock synchronization signal by the first module after synchronizing the local clock according to the received clock synchronization signal; the clock synchronization signal is received by the first module through a local area network; the first module further comprises, prior to receiving a clock synchronization signal over the local area network: the first module connected with the local area network and the second module connected with a vehicle bus network perform initial clock synchronization through the vehicle bus network;
Adding a second timestamp for the acquired second vehicle information according to the synchronized local clock;
and sending the second vehicle information to which the second timestamp has been added to the third module.
7. The method of claim 6, wherein the clock synchronizing with the first module connected to the local area network via the level signal comprises:
receiving a level signal sent by a first module connected with a local area network through a vehicle bus network;
and according to the level signal, carrying out local clock synchronization.
8. The method of claim 6 or 7, wherein the second module is a control device of a vehicle safety restraint assembly.
9. A data processing method, characterized in that it is applied to a vehicle, the vehicle including a first module, a second module, and a third module, the third module performing a method comprising:
acquiring first vehicle information carrying a first time stamp and sent by a first module through a local area network;
acquiring second vehicle information carrying a second time stamp and transmitted by a second module through a vehicle bus network;
processing the first vehicle information and the second vehicle information according to the first timestamp and the second timestamp to generate a vehicle data set;
The first time stamp and the second time stamp are added after clock synchronization of the first module and the second module; the first module synchronizes a local clock according to the received clock synchronization signal; the clock synchronization signal is received by the first module through a local area network; the first module further comprises, prior to receiving a clock synchronization signal over the local area network: the first module connected with the local area network and the second module connected with the vehicle bus network perform initial clock synchronization through the vehicle bus network; the second module performs clock synchronization with the first module connected with the local area network through a level signal, and the level signal is obtained and transmitted by the first module through conversion of the clock synchronization signal.
10. The method of claim 9, wherein processing the first and second vehicle information according to the first and second time stamps to generate a vehicle dataset comprises:
if the first timestamp and the second timestamp belong to the vehicle fault time period, grouping the first vehicle information and the second vehicle information according to the first timestamp and the second timestamp to obtain a vehicle information group corresponding to each time period;
And integrating the vehicle information sets corresponding to the time periods according to the sequence of the time periods to obtain a vehicle data set.
11. The method of claim 10, wherein grouping the first vehicle information and the second vehicle information according to the first timestamp and the second timestamp to obtain a vehicle information group corresponding to each time period comprises:
encoding the first vehicle information and the second vehicle information according to encoding rules corresponding to the data format;
and grouping the coding results according to the first timestamp and the second timestamp to obtain a vehicle information group corresponding to each time period.
12. The method according to claim 10, wherein after obtaining the vehicle information group corresponding to each time period, further comprising:
judging whether missing data exists in each vehicle information group;
if so, acquiring candidate data which are acquired by the candidate acquisition equipment and correspond to the missing data time period;
and updating the vehicle information group according to the candidate data.
13. The method of claim 9, wherein after the generating the vehicle dataset, further comprising:
Responding to a vehicle accident inquiring request, and determining the collision time to be inquired;
extracting target vehicle information from the vehicle dataset according to the collision time;
and generating a vehicle accident report according to the target vehicle information.
14. A data processing apparatus for use in a vehicle, the vehicle including a first module, a second module, and a third module, the apparatus being disposed in the first module, comprising:
the receiving unit is used for receiving the clock synchronization signal through a local area network;
the first synchronization unit is used for synchronizing the local clock according to the clock synchronization signal;
the second synchronization unit is used for performing clock synchronization with a second module connected with the vehicle bus network through the level signal; the level signal is obtained by converting the clock synchronous signal by the first module;
the first timestamp adding unit is used for adding a first timestamp to the acquired first vehicle information according to the synchronized local clock;
a first information transmitting unit configured to transmit first vehicle information to which the first time stamp has been added to the third module; the first synchronization unit is further configured to, before receiving a clock synchronization signal through a local area network, connect the first module of the local area network with a second module connected to the vehicle bus network, and perform initial clock synchronization through the vehicle bus network.
15. A data processing apparatus for use in a vehicle, the vehicle including a first module, a second module, and a third module, the apparatus being disposed in the second module, comprising:
the third synchronization unit is used for performing clock synchronization with the first module connected with the local area network through the level signal; the level signal is obtained by converting and transmitting the clock synchronization signal by the first module after synchronizing the local clock according to the received clock synchronization signal; the clock synchronization signal is received by the first module through a local area network; the first module is further configured to connect the first module of the local area network with a second module connected to a vehicle bus network, before receiving a clock synchronization signal through the local area network, and perform initial clock synchronization through the vehicle bus network;
the second timestamp adding unit is used for adding a second timestamp to the acquired second vehicle information according to the synchronized local clock;
and a second information transmitting unit configured to transmit second vehicle information to which the second time stamp has been added to the third module.
16. A data processing apparatus for use in a vehicle, the vehicle including a first module, a second module, and a third module, the apparatus being disposed in the third module, comprising:
The first vehicle information acquisition unit is used for acquiring first vehicle information carrying a first time stamp sent by the first module through a local area network;
the second vehicle information acquisition unit is used for acquiring second vehicle information carrying a second time stamp and sent by the second module through the vehicle bus network;
a vehicle data set generating unit, configured to process the first vehicle information and the second vehicle information according to the first timestamp and the second timestamp, and generate a vehicle data set;
the first time stamp and the second time stamp are added after clock synchronization of the first module and the second module; the first module synchronizes a local clock according to the received clock synchronization signal; the clock synchronization signal is received by the first module through a local area network; the first module is further configured to connect the first module of the local area network with a second module of the vehicle bus network before receiving a clock synchronization signal through the local area network, and perform initial clock synchronization through the vehicle bus network; the second module performs clock synchronization with the first module connected with the local area network through a level signal, and the level signal is obtained and transmitted by the first module through conversion of the clock synchronization signal.
17. An apparatus, comprising:
one or more processors;
a memory for storing one or more programs;
when executed by the one or more processors, causes the one or more processors to implement the data processing method of any of claims 1-5, or the data processing method of any of claims 6-8, or the data processing method of any of claims 9-13.
18. A computer-readable storage medium, on which a computer program is stored, characterized in that the program, when being executed by a processor, implements a data processing method according to any one of claims 1-5, or a data processing method according to any one of claims 6-8, or a data processing method according to any one of claims 9-13.
CN202111255612.1A 2021-10-27 2021-10-27 Data processing method, device, equipment and storage medium Active CN114089811B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111255612.1A CN114089811B (en) 2021-10-27 2021-10-27 Data processing method, device, equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111255612.1A CN114089811B (en) 2021-10-27 2021-10-27 Data processing method, device, equipment and storage medium

Publications (2)

Publication Number Publication Date
CN114089811A CN114089811A (en) 2022-02-25
CN114089811B true CN114089811B (en) 2024-03-22

Family

ID=80297855

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111255612.1A Active CN114089811B (en) 2021-10-27 2021-10-27 Data processing method, device, equipment and storage medium

Country Status (1)

Country Link
CN (1) CN114089811B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115032449A (en) * 2022-08-10 2022-09-09 北京智芯半导体科技有限公司 Electric energy metering method and device, electronic equipment, chip and readable storage medium
CN115865250B (en) * 2022-11-21 2024-01-30 小米汽车科技有限公司 Clock synchronization method, device, equipment, vehicle and medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103824346A (en) * 2014-02-17 2014-05-28 深圳市宇恒互动科技开发有限公司 Driving recording and replaying method and system thereof
US10140417B1 (en) * 2013-10-18 2018-11-27 State Farm Mutual Automobile Insurance Company Creating a virtual model of a vehicle event
CN111554004A (en) * 2020-04-26 2020-08-18 东风汽车集团有限公司 Vehicle-mounted data acquisition equipment supporting bus data and video synchronization
CN111756463A (en) * 2019-03-29 2020-10-09 北京航迹科技有限公司 Time synchronization system and method for vehicle
CN112526980A (en) * 2020-12-22 2021-03-19 北京百度网讯科技有限公司 Remote control method, cockpit, cloud server and automatic driving vehicle

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101737520B1 (en) * 2015-04-30 2017-05-18 성균관대학교산학협력단 Vehicle accident information transmission method and apparatus and vehicle accident information collection method and apparatus based on interaction between apparatuses
US9935685B2 (en) * 2015-05-28 2018-04-03 Qualcomm Incorporated DC power line synchronization for automotive sensors

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10140417B1 (en) * 2013-10-18 2018-11-27 State Farm Mutual Automobile Insurance Company Creating a virtual model of a vehicle event
CN103824346A (en) * 2014-02-17 2014-05-28 深圳市宇恒互动科技开发有限公司 Driving recording and replaying method and system thereof
CN111756463A (en) * 2019-03-29 2020-10-09 北京航迹科技有限公司 Time synchronization system and method for vehicle
CN111554004A (en) * 2020-04-26 2020-08-18 东风汽车集团有限公司 Vehicle-mounted data acquisition equipment supporting bus data and video synchronization
CN112526980A (en) * 2020-12-22 2021-03-19 北京百度网讯科技有限公司 Remote control method, cockpit, cloud server and automatic driving vehicle

Also Published As

Publication number Publication date
CN114089811A (en) 2022-02-25

Similar Documents

Publication Publication Date Title
CN114089811B (en) Data processing method, device, equipment and storage medium
CN109542865B (en) Method, device, system and medium for synchronizing configuration files of distributed cluster system
CN112055024A (en) Authority verification method and device, storage medium and electronic equipment
CN109871385B (en) Method and apparatus for processing data
JP2009083815A (en) Drive recorder device and accident analysis simulation device
CN108924461B (en) Video image processing method and device
KR20120075580A (en) A system and method for car service management using mobile augmented reality in smart phone
CN113992469B (en) Data fusion method and device, electronic equipment and computer readable medium
CN115391422B (en) Vehicle perception information generation method, device, equipment, medium and program product
US20200234577A1 (en) Server, server control method, server control program, vehicle, vehicle control method, and vehicle control program
CN113114752B (en) Data acquisition method, device, terminal and server based on public traffic scene
CN113422738B (en) MCU communication service method of intelligent host
CN117255252B (en) Bypass acquisition method and system for automobile multimedia data link
CN113299058B (en) Traffic accident responsibility identification method, device, medium and electronic equipment
CN112994804A (en) Rocket telemetry data processing method and device, electronic equipment and storage medium
CN106973254B (en) A kind of firmware data transmission method, device and a kind of digital monitor system
KR102006080B1 (en) Method of providing video of black box and apparatuses performing the same
CN115460425B (en) Audio and video synchronous transmission method based on vehicle-mounted Ethernet transmission
CN104639892B (en) Video recording system and method and apparatus for processing image in main system
WO2022100073A1 (en) Information management systems and methods
CN114302278A (en) Headset wearing calibration method, electronic device and computer-readable storage medium
KR102261848B1 (en) Time-synchronized remote system and the operation method thereof
CN110928955A (en) Data interaction method and device, computer equipment and storage medium
JP7058757B2 (en) Information processing equipment and information processing method
JP2019091444A (en) Processing method of smart interactive, device, facility and computer storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right

Effective date of registration: 20220401

Address after: 201821 Building 2, No. 1688, Yecheng Road, Jiading District, Shanghai

Applicant after: Shanghai Jidu Automobile Co.,Ltd.

Address before: 201815 zone B, floor 1, building 2, No. 468, Huirong Road, Jiading District, Shanghai

Applicant before: Jidu Automobile Co.,Ltd.

TA01 Transfer of patent application right
GR01 Patent grant
GR01 Patent grant