阅读说明：本技术 发送装置、发送方法、接收装置和接收方法 (Transmission device, transmission method, reception device, and reception method ) 是由 市村元 于 2019-08-09 设计创作，主要内容包括：本发明的目的是与音频信号同步地令人满意地发送触觉振动信号。包括多个帧的每个块的发送信号通过预定的发送通道被顺序地发送到接收侧。在发送信号中包括与预定通道数量对应的音频信号和与预定通道数量对应的触觉振动信号。触觉振动信号可以基于与音频信号相关的媒体信号生成。可以将指示与预定通道数量对应的音频信号和与预定通道数量对应的触觉振动信号的配置的信息添加到发送信号。(An object of the present invention is to satisfactorily transmit a tactile vibration signal in synchronization with an audio signal. A transmission signal including each block of a plurality of frames is sequentially transmitted to a reception side through a predetermined transmission channel. The transmission signal includes an audio signal corresponding to a predetermined number of channels and a haptic vibration signal corresponding to the predetermined number of channels. The haptic vibration signal may be generated based on a media signal associated with the audio signal. Information indicating the configuration of the audio signal corresponding to the predetermined number of channels and the haptic vibration signal corresponding to the predetermined number of channels may be added to the transmission signal.)

1. A transmitting apparatus, comprising:

a transmission section sequentially transmitting transmission signals of respective blocks each including a plurality of frames to a receiver side via a predetermined transmission line, wherein

The transmission signal includes an audio signal of a predetermined number of channels and a haptic vibration signal of a predetermined number of channels.

2. The transmission apparatus according to claim 1, further comprising:

an information adding section that adds configuration information of the predetermined number of channels of audio signals and the predetermined number of channels of tactile vibration signals to a transmission signal.

3. The transmission apparatus according to claim 2, wherein the configuration information includes identification information for distinguishing the haptic vibration signal from the audio signal.

4. The transmission apparatus according to claim 3, wherein the identification information includes information of a vibration position of an object in each of the predetermined number of channels of the tactile vibration signal.

5. The transmission apparatus according to claim 2, wherein the information adding means adds the configuration information by using a predetermined channel state bit area formed for each of the blocks.

6. The transmission apparatus according to claim 2, wherein the information adding means adds the configuration information by using user data bits of a predetermined number of consecutive frames.

7. The transmission apparatus according to claim 1, wherein

The plurality of frames includes repetitions of multi-channel groups, each multi-channel group including a predetermined number of frames, an

The transmitting means transmits the predetermined number of channels of audio signals and the predetermined number of channels of haptic vibration signals in a state where the predetermined number of channels of audio signals and the predetermined number of channels of haptic vibration signals are separately arranged in all or some of the predetermined number of frames in a time-division manner for each of the multi-channel groups.

8. The transmission apparatus according to claim 1, further comprising:

a processing component that generates a haptic vibration signal based on a media signal associated with the audio signal.

9. The transmitting device of claim 1, wherein the predetermined transmission line is a coaxial cable, an optical cable, an ethernet (IEC 61883-6) cable, an HDMI cable, an MHL cable, or a displayport cable.

10. A transmission method, comprising:

a step of sequentially transmitting transmission signals each including respective blocks of a plurality of frames to a receiver side via a predetermined transmission line, wherein

The transmission signal includes an audio signal of a predetermined number of channels and a haptic vibration signal of a predetermined number of channels.

11. A receiving apparatus, comprising:

a receiving section sequentially receiving transmission signals of respective blocks each including a plurality of frames from a transmitter side via a predetermined transmission line, wherein

The transmission signal includes an audio signal of a predetermined number of channels and a haptic vibration signal of a predetermined number of channels.

12. The reception apparatus according to claim 11, further comprising:

a processing part which processes the transmission signal and outputs the predetermined number of channels of audio signals and the predetermined number of channels of haptic vibration signals.

13. The receiving device of claim 12, wherein

The transmission signal includes configuration information of the audio signal of the predetermined number of channels and the haptic vibration signal of the predetermined number of channels, an

The processing section processes the transmission signal based on the configuration information and outputs the predetermined number of channels of audio signals and the predetermined number of channels of tactile vibration signals.

14. The reception apparatus according to claim 13, wherein the configuration information is added by using a predetermined channel state bit region formed for each block.

15. The reception apparatus according to claim 13, wherein the configuration information is added by using user data bits of a predetermined number of consecutive frames.

16. The receiving device of claim 11, wherein

The plurality of frames includes repetitions of multi-channel groups, each multi-channel group including a predetermined number of frames, an

The predetermined number of channels of audio signals and the predetermined number of channels of tactile vibration signals are arranged in all or some of the predetermined number of frames in a time-division manner by channels for each of the multi-channel groups.

17. The receiving device according to claim 11, wherein the predetermined transmission line is a coaxial cable, an optical cable, an ethernet (IEC 61883-6) cable, an HDMI cable, an MHL cable, or a displayport cable.

18. A receiving method, comprising:

a step of sequentially receiving transmission signals each including respective blocks of a plurality of frames from a transmitter side via a predetermined transmission line, wherein

The transmission signal includes an audio signal of a predetermined number of channels and a haptic vibration signal of a predetermined number of channels.

Technical Field

The present technology relates to a transmitting device, a transmitting method, a receiving device, and a receiving method, and particularly relates to a transmitting device, a transmitting method, a receiving device, and a receiving method that process a haptic vibration signal along with an audio signal.

Background

In a multi-channel audio application such as a 5.1-channel or 7.1-channel application, channels are used according to a certain rule by a method of assigning names to the channels so as to identify how to use the respective channels. These channels are for example a right channel, a left channel, a center channel, an LFE (low frequency effect) channel, etc. These channels are transmitted to speakers arranged at positions indicated by their names and are desired to be reproduced as sound.

In recent years, multimedia applications have been proposed, and these proposed applications include tactile vibration applications and the like used in synchronization with conventional audio video. For example, PTL 1 describes a technique of transmitting a tactile vibration signal (tactile signal) and vibrating a vibration member on the receiver side based on the tactile vibration signal.

[ citation list ]

[ patent document ]

[PTL 1]

JP 2018-060313A

[ summary of the invention ]

[ problem ] to

In haptic vibration applications used in synchronization with audio video, it is desirable to transmit a haptic vibration signal in synchronization with an audio signal. Then, at this time, the haptic vibration signal has a signal property different from that of the audio signal, and it is desirable to be able to clearly distinguish the haptic vibration signal from the audio signal. In addition, at this time, it is assumed that the tactile vibration signal itself is formed by combining a plurality of signals according to a certain rule, and thus it is desirable that the plurality of signals can also be recognized.

It is an object of the present technology to advantageously transmit a haptic vibration signal in synchronization with an audio signal.

[ solution to problems ]

An idea according to the present technology is a transmission apparatus comprising: a transmission section sequentially transmits transmission signals of respective blocks each including a plurality of frames to a receiver side via a predetermined transmission line. The transmission signal includes an audio signal of a predetermined number of channels and a haptic vibration signal of a predetermined number of channels.

In the present technology, the transmission section sequentially transmits transmission signals of respective blocks each including a plurality of frames to the receiver side via a predetermined transmission line. Here, the transmission signal includes a predetermined number of channels of the audio signal and a predetermined number of channels of the haptic vibration signal. For example, the predetermined transmission line may be a coaxial cable, an optical cable, an ethernet (IEC 61883-6) cable, an HDMI cable, an MHL cable or a displayport cable. Additionally, for example, a processing component that generates a haptic vibration signal based on a media signal associated with the audio signal may also be included.

For example, an information adding section may be further included, the information adding section adding configuration information of the predetermined number of channels of audio signals and the predetermined number of channels of tactile vibration signals to the transmission signal. In this case, for example, the configuration information may include identification information for distinguishing the haptic vibration signal from the audio signal. Then, in this case, for example, the identification information may include information of a vibration position for which each of the predetermined number of channels of the tactile vibration signal is directed.

In addition, for example, the information adding section may add the configuration information by using a predetermined channel state bit area formed for each of the blocks. Further, for example, the information adding section may add the configuration information by using user data bits of a predetermined number of consecutive frames.

Further, for example, the plurality of frames may include repetitions of a plurality of channel groups, each of the plurality of channel groups including a predetermined number of frames, and the transmitting means may transmit the predetermined number of channels of audio signals and the predetermined number of channels of tactile vibration signals in a state where the predetermined number of channels of audio signals and the predetermined number of channels of tactile vibration signals are separately arranged for each channel in all or some of the predetermined number of frames in a time-division manner for each of the plurality of channel groups.

In this way, in the present technology, the audio signal including the predetermined number of channels and the haptic vibration signal including the predetermined number of channels are sequentially transmitted to the receiver side through the predetermined transmission line and the transmission signal for each block including the plurality of frames. Thus, the haptic vibration signal can be advantageously transmitted in synchronization with the audio signal.

In addition, another concept of the present technology is a receiving apparatus including: a receiving section sequentially receives transmission signals of respective blocks each including a plurality of frames from a transmitter side via a predetermined transmission line. The transmission signal includes an audio signal of a predetermined number of channels and a haptic vibration signal of a predetermined number of channels.

In the present technique, the reception section sequentially receives transmission signals of respective blocks each including a plurality of frames from the transmitter side via a predetermined transmission line. Here, the transmission signal includes a predetermined number of channels of the audio signal and a predetermined number of channels of the haptic vibration signal. For example, the predetermined transmission line may be a coaxial cable, an optical cable, an ethernet (IEC 61883-6) cable, an HDMI cable, an MHL cable or a displayport cable.

For example, a processing section may be further included, which processes the transmission signal and outputs the predetermined number of channels of audio signals and the predetermined number of channels of tactile vibration signals. Then, in this case, for example, the transmission signal may include configuration information of the predetermined number of channels of audio signals and the predetermined number of channels of tactile vibration signals, and the processing section may process the signal based on the configuration information and output the predetermined number of channels of audio signals and the predetermined number of channels of tactile vibration signals.

In addition, for example, the configuration information may be added by using a predetermined channel state bit area formed for each block. In addition, the configuration information may be added by using user data bits of a predetermined number of consecutive frames, for example. Further, for example, the plurality of frames may include repetitions of multi-channel groups each including a predetermined number of frames, and the predetermined number of channels of audio signals and the predetermined number of channels of tactile vibration signals may be arranged separately for each channel in all or some of the predetermined number of frames in a time-division manner for each of the multi-channel groups.

In this way, in the present technology, the audio signal including the predetermined number of channels and the haptic vibration signal including the predetermined number of channels are sequentially received by the transmitter side via the predetermined transmission line and the transmission signal for each block including the plurality of frames. Accordingly, the haptic vibration signal can be advantageously received in synchronization with the audio signal.

Drawings

Fig. 1 shows a block diagram showing a configuration example of an AV system as one embodiment.

Fig. 2 is a diagram showing a comparison between a video signal, an audio signal, and a tactile vibration signal with respect to examples of dynamic range, sampling frequency, continuity/discontinuity, and dimension.

Fig. 3 is a block diagram showing a configuration example of the HDMI receiving section of the television receiver and the HDMI transmitting section of the audio amplifier.

Fig. 4 is a diagram showing various types of transmission data periods in the case where image data including 1920 pixels × 1080 lines in the horizontal direction and the vertical direction is transmitted through a TMDS channel.

Fig. 5 is a diagram showing a pin (pin) array of the HDMI connector.

Fig. 6 is a diagram showing a configuration example of a high-speed bus interface of a television receiver.

Fig. 7 is a diagram showing a configuration example of a high-speed bus interface of an audio amplifier.

Fig. 8 is a diagram showing a frame configuration in the IEC 60958 standard.

Fig. 9 is a diagram showing a subframe configuration in the IEC 60958 standard.

Fig. 10 is a diagram showing a signal modulation method in the IEC 60958 standard.

Fig. 11 is a diagram showing channel coding of a preamble in the IEC 60958 standard.

Fig. 12 is a diagram showing one example of a frame configuration in a multi-channel transmission format.

Fig. 13 is a diagram schematically showing a channel status format in the IEC 60958 standard.

Fig. 14 is a diagram showing a correspondence relationship between a multichannel configuration value and an audio channel set represented thereby.

Fig. 15 is a diagram showing one example of grouping specifying the number of speakers at each height.

Fig. 16 is a diagram showing one example of a packet specifying which audio channel is to be transmitted in the transmission order within a multi-channel group.

Fig. 17 is a diagram showing a specific example of a method of specifying multi-channel groups 1 to 4 in a multi-channel transmission format.

Fig. 18 is a diagram showing one example of a frame configuration of a multi-channel transmission format in the case of simultaneously transmitting a multi-channel audio signal and a predetermined number of channels of haptic vibration signals.

Fig. 19 is a diagram showing a transmission signal including 5.1-channel audio and a haptic vibration signal of two channels.

Fig. 20 is a diagram for explaining an example of designating a multi-channel sub-group for simultaneously transmitting a multi-channel audio signal and a predetermined number of channels of haptic vibration signals by the second method.

Fig. 21 shows a block diagram illustrating another configuration example of the AV system.

Fig. 22 is a diagram for explaining X-axis, Y-axis, and Z-axis vibration data included in the haptic vibration signal.

Fig. 23 is a diagram for explaining allocation of X-axis, Y-axis, and Z-axis vibration data included in a haptic vibration signal to 24-bit slots in a subframe according to IEC 60958-1.

Fig. 24 is a diagram for explaining a case where a haptic vibration signal covering each vertex of the virtual cube space of the user is representatively transmitted.

Detailed Description

Next, a mode for carrying out the present invention (hereinafter, referred to as "embodiment") will be described. Note that the explanation is made in the following order.

1. Examples of the embodiments

2. Modified examples

<1. example >

[ configuration example of AV System ]

Fig. 1 shows a configuration example of an AV (audio/video) system 10 as one embodiment. The AV system 10 has a television receiver 100 and an audio amplifier 200. The television receiver 100 is connected to a television broadcast receiving antenna 121, a BD (blu-ray disc) player 122, and the internet 123. In addition, the audio amplifier 200 is connected to a dual or multi-channel speaker system 250 and a single or multi-channel vibration system 260. Note that "blue light" is a registered trademark.

The television receiver 100 and the audio amplifier 200 are connected via an HDMI cable 300. Note that "HDMI" is a registered trademark. The television receiver 100 is provided with an HDMI terminal 101 connected to an HDMI receiving section (HDMI RX)102 and a high-speed bus interface 103 included in a communication section. The audio amplifier 200 is provided with an HDMI terminal 201 connected to an HDMI transmitting section (HDMI TX)202 and a high-speed bus interface 203 included in a communication section. The HDMI cable 300 has one end connected to the HDMI terminal 101 of the television receiver 100 and the other end connected to the HDMI terminal 201 of the audio amplifier 200.

The television receiver 100 has an HDMI receiving section 102, a high-speed bus interface 103, and an SPDIF transmitting circuit 104. In addition, the television receiver 100 has a system controller 105, a digital broadcast receiving circuit 107, a content reproduction circuit 108, a display section 109, and an ethernet interface 110. Note that "ethernet" is a registered trademark. In addition, in the example shown in the drawings, each component of the image system is appropriately omitted for the sake of simplifying the explanation.

The system controller 105 controls the operation of each component of the television receiver 100. The digital broadcast receiving circuit 107 processes the television broadcast signal input from the receiving antenna 121, and outputs a video signal, a multi-channel audio signal (linear PCM signal), and a predetermined number of channels of tactile vibration signals according to broadcast contents. Here, the multi-channel audio signal includes audio signals of a plurality of channels.

The ethernet interface 110 communicates with an external server via the internet 123, and outputs a video signal, a multi-channel audio signal (linear PCM signal), and a predetermined number of channels of tactile vibration signals according to network contents. By performing the reproduction operation, the BD player 122 outputs a video signal, a multi-channel audio signal (linear PCM signal), and a predetermined number of channels of tactile vibration signals according to the reproduced content.

The content reproduction circuit 108 selectively takes out the video signal, the multi-channel audio signal, and the tactile vibration signal of a predetermined number of channels obtained at the digital broadcast reception circuit 107, the ethernet interface 110, or the BD player 122. Then, the content reproduction circuit 108 transmits the video signal to the display section 109. The display section 109 displays an image of the video signal.

In addition, the content reproduction circuit 108 transmits the multichannel audio signal and the predetermined number of channels of the haptic vibration signal to the SPDIF transmitting circuit 104. The SPDIF transmitting circuit 104 is a circuit that transmits a digital audio transmission signal (hereinafter, referred to as an "SPDIF signal" as appropriate) according to the IEC 60958 standard. The SPDIF transmission circuit 104 is a transmission circuit compliant with IEC 60958 standard. Note that the details of the SPDIF signal are as follows.

The SPDIF transmitting circuit 104 simultaneously transmits a multi-channel audio signal (linear PCM signal) and a predetermined number of channels of tactile vibration signals to the audio amplifier 200. In this case, as the SPDIF signal, transmission signals of respective blocks each including a plurality of frames (here, 192 frames) are sequentially transmitted. Then, the transmission signal includes a multi-channel audio signal (linear PCM signal) and a predetermined number of channels of tactile vibration signals.

Here, the plurality of frames includes a repetition of a multichannel group, each multichannel group including a predetermined number of frames. In each of the multi-channel groups, the multi-channel audio signal and the predetermined number of channels of the haptic vibration signal are separately arranged in all or some of the predetermined number of frames for each channel in a time-division manner.

Configuration information of the multi-channel audio signal and the predetermined number of channels of the haptic vibration signal is added to the transmission signal. The configuration information includes identification information for distinguishing the haptic vibration signal from the audio signal. In addition, the identification information includes information of a vibration position for which each of the predetermined number of channels of the tactile vibration signal is directed. For example, the configuration information is added by using a predetermined channel state bit area formed for each block. In addition, the configuration information is added, for example, by using user data bits of a predetermined number of consecutive frames.

The HDMI receiving section 102 receives video and audio data supplied to the HDMI terminal 101 via the HDMI cable 300 by communication conforming to HDMI. The high-speed bus interface 103 is an interface of a bidirectional communication path including a reserve line and an HPD (hot plug detect) line included in the HDMI cable 300. Note that details of the HDMI receiving section 102 and the high-speed bus interface 103 are mentioned below.

The audio amplifier 200 has an HDMI transmitting section 202, a high-speed bus interface 203, and an SPDIF receiving circuit 204. In addition, the audio amplifier 200 has a system controller 205, an audio amplifier 208, a vibration amplifier 209, and an ethernet interface 210.

The system controller 205 controls the operation of each component of the audio amplifier 200. The HDMI transmitting section 202 transmits video and audio data from the HDMI terminal 201 to the HDMI cable 300 by communication conforming to HDMI. The high-speed bus interface 203 is an interface of a bidirectional communication path including a reserve line and an HPD (hot plug detect) line included in the HDMI cable 300. Note that details of the HDMI transmitting section 202 and the high-speed bus interface 203 are mentioned below.

The SPDIF receiving circuit 204 receives a transmission signal as an SDPIF signal (digital audio signal according to IEC 60958 standard), and acquires a multi-channel audio signal and a predetermined number of channels of tactile vibration signals included in the transmission signal. In this case, the multi-channel audio signal and the predetermined number of channels of the haptic vibration signal are extracted based on the configuration information included in the transmission signal.

The audio amplifier 208 amplifies the multi-channel audio signal taken out at the SPDIF receiving circuit 204 for each channel, and transmits the multi-channel audio signal to the speaker system 250 having speakers corresponding to the respective channels. Thus, audio reproduction from the multi-channel audio signal is performed at the loudspeaker system 250.

In addition, the vibration amplifier 209 amplifies a predetermined number of channels of the tactile vibration signal taken out at the SPDIF receiving circuit 204 for each channel and transmits the predetermined number of channels of the tactile vibration signal to the vibration system 260 having the vibration devices corresponding to the respective channels. Accordingly, vibration reproduction according to the predetermined number of channels of the haptic vibration signal is performed at the vibration system 260. In this case, since the predetermined number of channels of the tactile vibration signal are transmitted simultaneously with the multi-channel audio signal as described above, the vibration reproduction and the audio reproduction become correctly synchronized, and also synchronized with the moving image display on the display section 109 of the television receiver 100.

Fig. 2 shows a comparison between a video signal, an audio signal and a tactile vibration signal with respect to examples of dynamic range, sampling frequency, continuity/discontinuity and dimension. The dynamic range of the video signal is 48 to 96dB, the sampling frequency is 60Hz, and the video signal is a discontinuous two-dimensional or three-dimensional signal. Furthermore, the audio signal has a dynamic range of 96 to 144dB, has a sampling frequency of 48kHz, and is a continuous one-dimensional signal.

The haptic vibration signal then has a dynamic range of 40 to 60dB, has a sampling frequency of 2kHz, and is a continuous one-dimensional signal. Thus, similar to the audio signal, the tactile vibration signal has a high sampling frequency and is a continuous signal. Therefore, as described above, by simultaneously transmitting the haptic vibration signal and the audio signal using the transmission line for the audio signal, the transmission synchronized with the audio signal can be simply and easily achieved.

Note that as described above, the haptic vibration signal is described as having a dynamic range of 40 to 60dB and having a frequency band of DC-1kHz, but similar to an audio signal rather than a video signal. A digital audio interface capable of linear PCM transmission may also transmit haptic vibration signals. In this case, with respect to the DC domain, an expression such as "push" for positive, "pull" or "drag" for negative may be used.

"configuration example of HDMI transmitting/receiving section"

Fig. 3 shows a configuration example of the HDMI receiving section 102 of the television receiver 100 and the HDMI transmitting section 202 of the audio amplifier 200 in the AV system 10 shown in fig. 1.

In a moving image period (hereinafter, referred to as "effective video period" as appropriate) excluding a horizontal blanking period and a vertical blanking period as a period from a vertical synchronizing signal to the next vertical synchronizing signal (hereinafter, referred to as "video field" as appropriate), the HDMI transmitting section 202 unidirectionally transmits a baseband (uncompressed) differential signal corresponding to image data of one screen to the HDMI receiving section 102 through a plurality of channels. In addition, in the horizontal blanking period and the vertical blanking period, the HDMI transmitting section 202 unidirectionally transmits audio data and a Control Packet (Control Packet) accompanying image data to the HDMI receiving section 102 through a plurality of channels, and further transmits a differential signal and the like corresponding to other auxiliary data.

The HDMI transmitting section 202 has the source signal processing section 71 and the HDMI transmitter 72. The source signal processing section 71 is supplied with baseband, uncompressed image (video) and Audio (Audio) data. The source signal processing section 71 performs necessary processing on the supplied image and audio data, and supplies the image and audio data to the HDMI transmitter 72. In addition, the source signal processing section 71 exchanges information for control and status notification information (control/status) and the like with the HDMI transmitter 72 as necessary.

The HDMI transmitter 72 converts the image data supplied from the source signal processing section 71 into corresponding differential signals, and unidirectionally transmits the differential signals to the HDMI receiving section 102 connected via the HDMI cable 300 through the three TMDS channels #0, #1, and #2 as a plurality of channels.

Further, the transmitter 72 converts audio data accompanied by uncompressed image data and control data (control data) such as a vertical synchronizing signal (VSYNC) and a horizontal synchronizing signal (HSYNC) supplied from the source signal processing section 71, control packets, and other auxiliary data (auxiliary data) into corresponding differential signals, and unidirectionally transmits the differential signals to the HDMI receiving section 102 connected via the HDMI cable 300 through the three TMDS channels #0, #1, and # 2.

In addition, the transmitter 72 transmits the pixel clock synchronized with the image data transmitted through the three TMDS channels #0, #1, and #2 to the HDMI receiving section 102 connected via the HDMI cable 300 through the TMDS clock channel.

The HDMI receiving section 102 receives differential signals corresponding to image data unidirectionally transmitted from the HDMI transmitting section 202 through a plurality of channels in the active video period, and receives differential signals corresponding to auxiliary data and control data transmitted from the HDMI transmitting section 202 through a plurality of channels in the horizontal blanking period and the vertical blanking period.

The HDMI receiving section 102 has the HDMI receiver 81 and the synchronization signal processing section 82. The HDMI receiver 81 receives the differential signal corresponding to the image data and the differential signal corresponding to the auxiliary data and the control data, which are unidirectionally transmitted thereto from the HDMI transmitting section 202 connected via the HDMI cable 300 through the TMDS channels #0, #1, and #2, in synchronization with the pixel clock transmitted thereto from the HDMI transmitting section 202 through the TMDS clock channel in the same manner. Further, the HDMI receiver 81 converts the differential signal into corresponding image data, auxiliary data, and control data, and supplies the image data, auxiliary data, and control data to the synchronization signal processing section 82 as necessary.

The synchronization signal processing section 82 performs necessary processing on the data supplied from the HDMI receiver 81, and outputs the data. In addition to this, the synchronization signal processing section 82 exchanges information for control and status notification information (control/status) and the like with the HDMI receiver 81 as necessary.

The HDMI transmission channel includes a transmission channel called DDC (display data channel) 83, and further includes a CEC line 84, in addition to three TMDS channels #0, #1, and #2 for unidirectionally and serially transmitting image data, auxiliary data, and control data from the HDMI transmitting section 202 to the HDMI receiving section 102 in synchronization with a pixel clock, and a TMDS clock channel which is a transmission channel for transmitting the pixel clock.

The DDC 83 includes two lines (signal lines), not shown, included in the HDMI cable 300, and is used by the source device to read out E-EDID (enhanced extended display identification) from the sink device connected via the HDMI cable 300. That is, the sink device has EDIDROM 85. The source device reads out E-EDID stored on the EDIDROM85 from the sink device connected via the HDMI cable 300 via the DDC 83, and identifies the configuration and capacity of the sink device based on the E-EDID.

The CEC line 84 includes one not-shown line included in the HDMI cable 300, and is used to perform bidirectional communication of data for control between the source device and the sink device.

In addition, the HDMI cable 300 includes the line 86 connected to a pin called HPD (hot plug detect). The source device may detect a connection with the sink device by using the line 86. In addition, the HDMI cable 300 includes a line 87 for supplying power from the source device to the sink device. Further, the HDMI cable 300 includes the reserve line 88.

Fig. 4 shows various types of transmission data periods in the case of transmitting image data including 1920 pixels × 1080 lines in the horizontal direction and the vertical direction through a TMDS channel. The video field in which transmission data is transmitted through the three TMDS channels of the HDMI includes three types of periods including a video data period 24, a data island period 25, and a control period 26, which are used according to the type of transmission data.

Here, the video field period is a period from a rising edge (active edge) of the vertical synchronization signal to a rising edge of the next vertical synchronization signal, and is classified into a horizontal blanking period 22 (horizontal blanking), a vertical blanking period 23 (vertical blanking), and an effective pixel period 21 (effective video), the effective pixel period 21 being a period of the video field period excluding the horizontal blanking period and the vertical blanking period.

The video data period 24 is allocated to the effective pixel period 21. In the video data period 24, data corresponding to effective pixels (effective pixels) of 1920 pixels (pixels) × 1080 lines included in uncompressed image data corresponding to one screen is transmitted. The data island period 25 and the control period 26 are allocated to the horizontal blanking period 22 and the vertical blanking period 23. In these data island period 25 and control period 26, auxiliary data (auxiliary data) is transmitted.

That is, the data island period 25 is allocated to the portions of the horizontal blanking period 22 and the vertical blanking period 23. In the data island period 25, for example, an audio data packet or the like which is data included in the auxiliary data and is not related to control is transmitted. The control period 26 is allocated to the other parts of the horizontal blanking period 22 and the vertical blanking period 23. In the control period 26, for example, a vertical synchronization signal, a horizontal synchronization signal, a control packet, or the like, which is data included in the auxiliary data and is related to control, is transmitted.

Fig. 5 shows a pin array of the HDMI connector. This needle array is an example of type a (type a). Two lines as differential lines transmitting the TMDS data # i + and the TMDS data # i, which are differential signals of the TMDS channel # i, are connected to the pins to which the TMDS data # i + is assigned (pins of pin numbers 1, 4, and 7) and the TMDS data # i-is assigned (pins of pin numbers 3, 6, and 9).

In addition, the CEC line 84 for transmitting a CEC signal which is control data is connected to the pin having the pin number 13, and the pin having the pin number 14 is a reserved (reserved) pin. In addition, a line for transmitting an SDA (serial data) signal such as E-EDID is connected to the pin having the pin number 16, and a line for transmitting an SCL (serial clock) signal, which is a clock signal for synchronization when transmitting and receiving the SDA signal, is connected to the pin having the pin number 15. The DDC 83 described above includes a line for transmitting an SDA signal and a line for transmitting an SCL signal.

In addition, the HPD line 86 for the source device to detect connection with the sink device as described above is connected to the pin having the pin number 19. In addition, a power supply line 87 for supplying power as described above is connected to the needle having the needle number 18.

"configuration example of high-speed bus interface"

Fig. 6 shows a configuration example of the high-speed bus interface 103 of the television receiver 100 in the AV system 10 shown in fig. 1. The ethernet interface 110 uses a transmission line including a pair of lines (i.e., a reserve line and an HPD line) among a plurality of lines included in the HDMI cable 300, and performs LAN (local area network) communication, i.e., transmission and reception of ethernet signals. The SPDIF transmitting circuit 104 transmits the SPDIF signal by using a transmission line including the pair of lines described above.

The television receiver 100 has a LAN signal transmitting circuit 441, a terminating resistor 442, AC coupling capacitors 443 and 444, a LAN signal receiving circuit 445, a subtracting circuit 446, adding circuits 449 and 450, and an amplifier 451. These are included in the high-speed bus interface 103. In addition, the television receiver 100 has a choke 461, a resistor 462, and a resistor 463 included in the plug connection transmission circuit 128.

A series circuit of the AC coupling capacitor 443, the termination resistor 442, and the AC coupling capacitor 444 is connected between the 14-pin terminal 521 and the 19-pin terminal 522 of the HDMI terminal 101. In addition, a series circuit of the resistor 462 and the resistor 463 is connected between the power supply line (+5.0V) and the ground line. Then, the connection point between the resistor 462 and the resistor 463 is connected to a connection point Q4 between the 19-pin terminal 522 and the AC coupling capacitor 444 via the choke 461.

A connection point P3 between the AC coupling capacitor 443 and the termination resistor 442 is connected to the output side of the addition circuit 449 and to the positive input side of the LAN signal receiving circuit 445. In addition, a connection point P4 between the AC coupling capacitor 444 and the termination resistor 442 is connected to the output side of the addition circuit 450, and to the negative input side of the LAN signal reception circuit 445.

One input side of the addition circuit 449 is connected to the positive output side of the LAN signal transmission circuit 441, and the other input side of the addition circuit 449 is supplied with the SPDIF signal output from the SPDIF transmission circuit 104 via the amplifier 451. In addition, one input side of the addition circuit 450 is connected to the negative output side of the LAN signal transmission circuit 441, and the other input side of the addition circuit 450 is supplied with the SPDIF signal output from the SPDIF transmission circuit 104 via the amplifier 451.

The input side of the LAN signal transmitting circuit 441 is supplied with a transmission signal (transmission data) SG417 from the ethernet interface 110. Further, output signal SG418 of LAN signal reception circuit 445 is supplied to the positive terminal of subtraction circuit 446, and transmission signal SG417 is supplied to the negative terminal of subtraction circuit 446. At the subtraction circuit 446, the transmission signal SG417 is subtracted from the output signal SG418 of the LAN signal reception circuit 445, and a reception signal (reception data) SG419 is obtained. In the case where a LAN signal (ethernet signal) is transmitted as a differential signal via the reserve line and the HPD line, the reception signal SG419 functions as the LAN signal. The reception signal SG419 is supplied to the ethernet interface 110.

Fig. 7 shows a configuration example of the high-speed bus interface 203 of the audio amplifier 200 in the AV system 10 shown in fig. 1. The ethernet interface 210 uses a transmission line including a pair of lines (i.e., a reserve line and an HPD line) among a plurality of lines included in the HDMI cable 610, and performs LAN (local area network) communication, i.e., transmission and reception of ethernet signals. The SPDIF receiving circuit 204 receives the SPDIF signal by using the transmission line including the pair of lines described above.

The audio amplifier 200 has a LAN signal transmitting circuit 411, a terminating resistor 412, AC coupling capacitors 413 and 414, a LAN signal receiving circuit 415, a subtracting circuit 416, an adding circuit 419, and an amplifier 420. These are included in the high-speed bus interface 203. In addition, the audio amplifier 200 has a pull-down resistor 431, a resistor 432, a capacitor 433, and a comparator 434 included in the plug connection detection circuit 221. Here, the resistor 432 and the capacitor 433 are included in the low-pass filter.

A series circuit of the AC coupling capacitor 413, the termination resistor 412, and the AC coupling capacitor 414 is connected between the 14-pin terminal 511 and the 19-pin terminal 512 of the HDMI terminal 201. A connection point P1 between the AC coupling capacitor 413 and the termination resistor 412 is connected to the positive output side of the LAN signal transmitting circuit 411, and to the positive input side of the LAN signal receiving circuit 415.

A connection point P2 between the AC coupling capacitor 414 and the terminating resistor 412 is connected to the negative output side of the LAN signal transmitting circuit 411, and to the negative input side of the LAN signal receiving circuit 415. The input side of the LAN signal transmission circuit 411 is supplied with a transmission signal (transmission data) SG411 from the ethernet interface 210.

The output signal SG412 of the LAN signal receiving circuit 415 is supplied to the positive terminal of the subtracting circuit 416, and the transmission signal (transmission data) SG411 is supplied to the negative terminal of the subtracting circuit 416. At the subtracting circuit 416, the transmission signal SG411 is subtracted from the output signal SG412 of the LAN signal receiving circuit 415, and a reception signal SG413 is obtained. In the case where a LAN signal (ethernet signal) is transmitted as a differential signal via the reserve line and the HPD line, the reception signal SG413 serves as the LAN signal. The reception signal SG413 is supplied to the ethernet interface 210.

A connection point Q2 between the AC coupling capacitor 414 and the 19-pin terminal 512 is connected to the ground line via a pull-down resistor 431, and is connected to the ground line via a series circuit of a resistor 432 and a capacitor 433. Then, an output signal of the low-pass filter obtained at a connection point between the resistor 432 and the capacitor 433 is supplied to one input terminal of the comparator 434. At the comparator 434, the output signal of the low-pass filter is compared with a reference voltage Vref2(+1.4V) supplied to the other input terminal. The output signal SG415 of the comparator 434 is supplied to a not-shown control section (CPU) of the audio amplifier 200.

In addition, a connection point P1 between the AC coupling capacitor 413 and the termination resistor 412 is connected to one input terminal of the addition circuit 419. In addition, a connection point P2 between the AC coupling capacitor 414 and the termination resistor 412 is connected to the other input terminal of the addition circuit 419. An output signal of the addition circuit 419 is supplied to the SPDIF receiving circuit 204 via the amplifier 420. In the case where the SPDIF signal is transmitted as the in-phase signal via the reserve line and the HPD line, the output signal of the addition circuit 419 serves as the SPDIF signal.

"details of SPDIF signal"

First, an outline of IEC 60958 standard is described. Fig. 8 shows a frame configuration in the IEC 60958 standard. Each frame comprises two sub-frames. In the case of dual channel stereo audio, the first sub-frame comprises a left channel signal and the second sub-frame comprises a right channel signal.

At the beginning of a subframe, a preamble is provided as described below. The left channel signal is given "M" as a preamble, and the right channel signal is given "W" as a preamble. It should be noted, however, that "B" representing the start of the block is given as a preamble to the start of each group 192 of frames. That is, one block includes 192 frames. The block is a unit forming a channel state mentioned below.

Fig. 9 shows a subframe configuration in the IEC 60958 standard. The subframe includes 0 th to 31 th slots, i.e., a total of 32 slots. The 0 th to 3 rd slots represent preambles (synchronization preambles). As described above, the preamble represents any one of "M", "W", and "B" in order to distinguish between the left and right channels or to represent the start position of the block.

The fourth to 27 th slots are main data fields, and represent audio data as a whole in the case of adopting a 24-bit code range. In addition, in the case of adopting a 20-bit code range, the eighth to 27 th slots represent audio data (audio sample words). In the latter case, the fourth to seventh slots may be used as additional information (auxiliary sample bits). The example in the figure shows the latter case.

The 28 th slot is a validity flag (validity flag) of the primary data field. The 29 th slot represents one bit of user data (user data). By accumulating the 29 th slot on each frame, a series of user data can be formed. A message of user data is formed in units of eight bit information units (IU: information units), and one message includes 3 to 129 information units.

There may be 0 to 8 bits of "0" between information units. The beginning of an information unit is identified by a start bit "1". The first seven information units in the message are retained and the user can set the required information in the eighth and subsequent information units. The message is divided by "0" of 8 bits or more.

The 30 th slot represents the channel state (channel state) of one bit. A series of channel states may be formed by accumulating the 30 th time slot over the frames of each block. Note that, as described above, the start position of the block is represented by the preamble of "B" (0 th to 3 rd slots).

The 31 st slot is a parity bit (parity bit). Parity bits are given so that the numbers of "0" s and "1" s included in the fourth to 31 th slots become even numbers.

Fig. 10 shows a signal modulation method in the IEC 60958 standard. The 4 th to 31 th slots in the subframe excluding the preamble are subjected to two-phase mark modulation. In this two-phase mark modulation, a clock twice as fast as the original signal (source coding) is used. If the clock period of the original signal is divided into a first half and a second half, the output of the two-phase mark modulation must be inverted at the edge of the first half clock period. Further, when the original signal represents "1" at the edge of the second half clock cycle, the output is inverted, and when the original signal represents "0" at the edge of the second half clock cycle, the output is not inverted. Thereby, it becomes possible to extract the clock component in the original signal from the signal subjected to the two-phase mark modulation.

Fig. 11 shows the channel coding of the preamble in the IEC 60958 standard. As described above, the 4 th to 31 th slots in the subframe are subjected to two-phase mark modulation. On the other hand, the preambles in the 0 th to 3 rd slots are not subjected to normal two-phase mark modulation, but are handled as bit patterns synchronized with twice as fast a clock. That is, by allocating 2 bits to each of the 0 th to 3 rd slots, an 8-bit pattern similar to that shown in the drawing is obtained.

If the previous state is "0", then "11101000" is assigned to the preamble "B", "11100010" is assigned to the preamble "M", and "1100100" is assigned to the preamble "W". On the other hand, if the previous state is "1", then "00010111" is assigned to the preamble "B", "00011101" is assigned to the preamble "M", and "00011011" is assigned to the preamble "W".

In the present embodiment, a multichannel transmission format based on the IEC 60958 standard is used to simultaneously transmit the above-described multichannel audio signal and a predetermined number of channels of the haptic vibration signal.

First, a multi-channel transmission format is explained. Fig. 12 shows an example of a frame configuration in a multi-channel transmission format. One block includes 192 frames in the IEC 60958 standard, and the 192 frames include repetitions of multichannel groups (multichannel groups), each multichannel group including a predetermined number of subframes. Each subframe portion is included in a multi-channel order (order). How many subframes are included in the multi-channel group can be represented by using a predetermined channel state bit region formed for each block.

In addition, one or more multi-channel sub-groups are formed in the multi-channel group, each sub-group being for transmitting a multi-channel audio signal. The multi-channel subset includes one or more multi-channel orders. The signals of each channel of the multi-channel audio signal are sequentially arranged in each multi-channel order comprised in the multi-channel sub-group. What type of multi-channel sub-group is formed in the multi-channel group can be represented by using a predetermined channel status bit region formed for each block, and can also be represented by using a predetermined number of frames of user data bits.

In the example shown in the figure, one multi-channel group includes eight subframes, i.e., multi-channel orders 1 to 8. Further, four multi-channel subgroups, i.e., multi-channel subgroups 1 to 4, are formed in the multi-channel group.

The multi-channel sub-group 1 includes multi-channel orders 1 to 3, and the signal of each of the three channels of the multi-channel audio signal (the signal of channel number 65, 66, or 67) is sequentially arranged in each multi-channel order. Here, channel number 65 denotes Front Left (FL), channel number 66 denotes Front Right (FR), and channel number 67 denotes Front Center (FC).

In addition, the multi-channel sub-group 2 includes multi-channel orders 4 to 5, and the signal of each of the two channels of the multi-channel audio signal (the signal of channel number 77 or 78) is sequentially arranged in each multi-channel order. Here, the channel number 77 indicates left front High (HFL), and the channel number 78 indicates right front (HFR).

In addition, the multi-channel sub-group 3 includes a multi-channel order 6, and one channel of the multi-channel audio signal (signal of channel number 80) is arranged in the multi-channel order. Here, the lane number 80 indicates the overhead center (OhC).

In addition, the multi-channel sub-group 4 includes multi-channel orders 7 to 8, and two channels of the multi-channel audio signal (signals of channel numbers 65 and 66) are sequentially arranged in the multi-channel order.

The manner in which the multi-channel sub-group formed in the multi-channel group is specified is explained. Examples of the method of specifying the multichannel subgroups include the following first to third methods.

The first method is a method of directly specifying a multi-channel sub-group by using multi-channel configuration information stored in channel status bits 63 to 60 formed for each block. Here, the multi-channel configuration denotes an audio channel set formed by combining predetermined audio channels in advance. In this first method, only an audio channel set formed by combining predetermined audio channels in advance can be specified.

The second method is a method of designating a channel subset by using a multi-channel map stored in channel status bits 165 to 191 formed for each block and setting 1 in a bit corresponding to an applicable channel. In this second method, an audio channel set formed by combining desired audio channels may be specified, but the transmission order becomes the appearance order on the multi-channel map, and cannot be made the desired transmission order.

Fig. 13 schematically shows a channel status format in the IEC 60958 standard. The channel status is the 30 th slot of the subframe accumulated for each block (see fig. 9). In the figure, each line arranged in the vertical direction represents the content of the channel state of one byte, and the bit configuration in each byte is represented in the horizontal direction. Note that in the explanation here, it is assumed that a format of Consumer usage (Consumer use) is used.

The 0 th bit (bit 0) a is set to "0", which indicates the channel status for user use. Further, the first bit (bit 1) b is set to "0", which means that it is a linear PCM sample. Further, the sixth bit and the seventh bit (bits 6 to 7) represent the mode of the channel state.

In addition, the 44 th bit to 47 th bit (bits 44 to 47) form a four-bit field representing "multi-channel count", and represent the number of subframes to be included in a multi-channel group. For example, "0000" represents 2ch LPCM, i.e., indicates that the number of subframes to be included in the multichannel group is 2, "1011" represents 64ch LPCM, i.e., indicates that the number of subframes to be included in the multichannel group is 64, "1100" represents 32ch LPCM, i.e., indicates that the number of subframes to be included in the multichannel group is 32, "1101" represents 16ch LPCM, i.e., indicates that the number of subframes to be included in the multichannel group is 16, "1110" represents 8ch LPCM, i.e., indicates that the number of subframes to be included in the multichannel group is 8, and further "1111" represents 4ch LPCM, i.e., indicates that the number of subframes to be included in the multichannel group is 4.

In addition, the 53 th bit to the 60 th bit form an 8-bit field representing "multichannel configuration value", and represent a multichannel configuration value for specifying a multichannel sub-group according to the first method.

Fig. 14 shows a correspondence between a multichannel configuration value and an audio channel set represented thereby. Each audio channel set is determined according to ISO/IEC 23001 and 82016 and is identified by a multichannel configuration value. Note that, although not shown in fig. 14, an audio channel set specified in ITU-r s.2094-1 and an IEC-specific audio channel set may also be specified.

The multichannel configuration value "10000000" indicates that there is an audio channel set (multichannel subgroup) having a channel configuration 1(ChannelConfiguration 1), and the audio channel set includes only audio channels "67: FC". Further, the multichannel configuration value "01000000" indicates that there is an audio channel set (multichannel subgroup) having the channel configuration 2(ChannelConfiguration 2), and the audio channel set includes audio channels "65: FL" and "66: FR", and these are to be transmitted in this order.

In addition, the multichannel configuration value "11000000" indicates that there is an audio channel set (multichannel subgroup) having a channel configuration 3(ChannelConfiguration 3), and the audio channel set includes audio channels "65: FL", "66: FR" and "67: FC", and the channels are to be transmitted in this order. In addition, the multichannel configuration value "00100000" indicates that there is an audio channel set (multichannel subgroup) having channel configuration 4(ChannelConfiguration 4), and the audio channel set includes audio channels "65: FL", "66: FR", "67: FC", and "184: MS", and the channels are to be transmitted in this order.

In addition, the multichannel configuration value "10100000" indicates that there is an audio channel set (multichannel subgroup) having a channel configuration 5(ChannelConfiguration 5), and the audio channel set includes audio channels "65: FL", "66: FR", "67: FC", "69: LS", and "70: RS", and the channels are to be transmitted in this order.

In addition, the multichannel configuration value "01100000" indicates that there is an audio channel set (multichannel subgroup) having a channel configuration 6(ChannelConfiguration 6), and the audio channel set includes audio channels "65: FL", "66: FR", "67: FC", "68: LFE", "69: LS", and "70: RS", and the channels are to be transmitted in this order.

In addition, the multichannel configuration value "11100000" indicates that there is an audio channel set (multichannel subgroup) having a channel configuration 7(ChannelConfiguration 7), and the audio channel set includes audio channels "65: FL", "66: FR", "67: FC", "68: LFE", "69: LS", "70: RS", "109: FLmid", and "110: FRmid", and the channels are to be transmitted in this order.

Here, the numbers such as 65, 66, 67, 68, 69, 70, 109, and 110 are numbers specific to audio channels determined according to the multi-channel map used in the second method, and each number corresponds to a specific speaker. For example, the left front speaker is given the number 65 and the right front speaker is given the number 66. These numbers are also used for the third method. The location and numbering of these loudspeakers is determined in IEC 62574 based on ITU-R BS.2094-1 and ISO/IEC 23001-8, but this is not a unique example and there may be other uniquely assigned channels. Note that, in the case where the multichannel configuration value is "00000000", this indicates that there is no audio channel set (multichannel subgroup) specified by the first method.

Returning to fig. 13, bit 64 (bit 64) indicates whether the audio channel set (multichannel subgroup) is specified using a multichannel mapping of bit 65 to bit 191. For example, "0" indicates that no audio channel set is specified, and "1" indicates that an audio channel set is specified. In the multi-channel mapping from the 65 th bit to the 191 th bit, the bit number is directly used as the number corresponding to the channel-specific number.

For example, the 65 th bit corresponds to the audio channel "65: FL", and in the case of including the audio channel "65: FL" in the audio channel set specified by the second method, the 65 th bit is set to 1. Although not described in detail, in the case where other audio channels are included in the audio channel set specified by the second method, bits are similarly set.

The third method is a method of designating a multi-channel sub-group by using a predetermined number of user data bits of consecutive frames. In this third method, an audio channel set formed by combining desired audio channels may be specified, and the transmission order of the individual audio channels may also be set as necessary.

In a third method, multi-channel configuration information is packed and embedded by using user data bits. In this case, first, a packet specifying the number of speakers at each height is issued. Fig. 15 shows an example of a packet. Herein, the types of height include "overhead", "high", "middle", "bottom", and "LFE". Specifying how many speakers are arranged in total in each layer. By repeating this mechanism within a packet, multiple multi-channel subgroups may be formed. Next, a packet is issued that specifies which audio channels are to be transmitted in the order of transmission within the multi-channel group. Fig. 16 shows an example of a packet.

This third method has the highest degree of freedom as a method of specifying a set of audio channels (multi-channel sub-group), enables specific audio channels to be transmitted in a specific order, and also enables them to be transmitted multiple times.

Fig. 17 shows a specific example of a method of specifying multichannel groups 1 to 4 in one example of the frame configuration of the multichannel transmission format shown in fig. 12 described above. The multi-channel subset 1 is specified by a first method. In this case, the value "multichannel configuration value" in the 53 th bit to the 60 th bit of the channel state is set to "11000000", and this indicates that there is an audio channel set (multichannel subgroup) including "65: FL", "66: FR", and "67: FC" (see fig. 14).

Further, the multi-channel sub-group 2 is specified by the second method. In this case, the 64 th bit of the channel state is set to "1", and this indicates that there is an audio channel set (multi-channel subgroup) specified by the second method using the multi-channel map. Further, the 77 th bit and the 78 th bit are set to 1, which means that the audio channel set (multi-channel sub-group) has a configuration including audio channels "77: HFL" and "78: HFR" in the listed order.

Further, the multi-channel subgroups 3 and 4 are specified by a third method. In this case, with respect to the multi-channel sub-group 3, the packet specifying the number of speakers at each height (see fig. 15) indicates that the number of included overhead speakers is one, and the packet specifying which audio channel to transmit (see fig. 16) indicates the audio channel "80: OhC".

In addition, with regard to the multi-channel sub-group 4, the packet specifying the number of speakers at each height (see fig. 15) indicates that the number of included bottom speakers is two, and the packet specifying which audio channel to transmit (see fig. 16) indicates the audio channels "65: FL" and "66: FR".

In the present embodiment, the multi-channel subset designated by the above-described first to third methods is used to simultaneously transmit a multi-channel audio signal and a predetermined number of channels of haptic vibration signals. Note that ISO/IEC 23001-82016 currently does not include a definition of a set containing haptic vibration signals. However, if defined in the future, a multi-channel subset for simultaneously transmitting a multi-channel audio signal and a predetermined number of channels of a haptic vibration signal may also be designated by the first method.

In addition, in order to specify a multi-channel sub-group for simultaneously transmitting a multi-channel audio signal and a predetermined number of channels of haptic vibration signals by the second method, the haptic vibration signals may be newly defined in undefined bits among 65 th to 191 th bits included in the channel state multi-channel map. In the present embodiment, for example, as shown in fig. 13, the haptic vibration signal is defined in the 120 th bit to the 122 th bit.

A tactile vibration signal, which is a kind of multimedia signal, is a signal for vibrating an actuator attached to a human body. These tactile vibration signals can be transmitted by using an uncompressed audio signal transmission line, but the signals are not uniformly arranged and are concentrated on a lower frequency band. These signals include a direct current component that in some cases represents pressure.

If these tactile vibration signals are reproduced with a conventional audio amplifier, they cannot be reproduced correctly, the amplifying element is broken due to damage caused by heat or the like, and in the case of connecting a speaker, the voice coil is disconnected in the worst case. To avoid this problem, the haptic vibration signal is assigned a unique channel number and distinguished from the audio channel signal. For example, the right arm vibration signal is given the number 120 and is defined in the 120 th bit of the multi-channel map. In addition, for example, the left arm vibration signal is given the number 121 and defined in the 121 th bit of the multichannel map. In addition, the vibration signals for both legs are given the number 122 and defined in the 122 th bit of the multi-channel map. Note that the tactile vibration signals are not limited to these signals, and other tactile vibration signals only need to be assigned unique numbers and distinguished from the audio channel signals.

Further, it is also possible to use the channel numbers of the haptic vibration signals determined in the above-described second method, thereby specifying a multi-channel sub-group for simultaneously transmitting a multi-channel audio signal and a predetermined number of channels of haptic vibration signals by the third method. Alternatively, it is also possible to uniquely determine the channel number of the haptic vibration signal by the third method and uniquely perform the operation according to a specific rule.

Note that the manner in which the multi-channel sub-group for simultaneously transmitting the multi-channel audio signal and the predetermined number of channels of the haptic vibration signal is designated may be changed for each block (192 frames), and by adopting time division, it is also possible to transmit the haptic vibration signals of the same number of channels or a larger number of channels than the number of channels of the haptic vibration signal assigned to the multi-channel sub-group. For example, possible cases include a case where many vibration units are attached to the entire body of the user and vibrate one per second from the lowest vibration unit to the higher vibration unit, and other cases.

Fig. 18 shows one example of a frame configuration of a multi-channel transmission format in the case of simultaneously transmitting a multi-channel audio signal and a predetermined number of channels of haptic vibration signals. Although not illustrated in detail, the frame configuration shown in fig. 18 is generally similar to the frame configuration shown in fig. 12.

In this example, one multichannel sub-group of multichannel sub-group 1 is formed in a multichannel group including eight sub-frames (i.e., multichannel order 1 to 8). This example is then an example of one multi-channel subset transmitting 5.1 channels of audio and two channels of haptic vibration signals, such as those shown in fig. 19.

Each channel of the multi-channel audio signal and a signal of the predetermined channel number of the haptic vibration signal (signal of channel number 65, 66, 67, 68, 69, 78, 120, or 121) are sequentially arranged in a multi-channel order 1 to 8 included in the multi-channel sub-group 1.

Here, channel numbers 65 to 70 indicate respective audio channels included in a multi-channel audio signal, "65" indicates Front Left (FL), "66" indicates Front Right (FR), "67" indicates Front Center (FC), "68" indicates LFE, "69" indicates left surround, and "70" indicates right surround. In addition, channel numbers 120 and 121 represent respective channels of the haptic vibration signal, "120" represents the left hand (right arm vibration signal), and "121" represents the right hand (left arm signal).

Note that although one multi-channel sub-group is formed in the multi-channel group in the example shown in the frame configuration shown in fig. 18, a plurality of multi-channel sub-groups may be formed in the multi-channel group, and other possible cases include not only a case where a multi-channel audio signal and a signal of each channel of a predetermined number of channels of a haptic vibration signal are sequentially arranged in all the multi-channel sub-groups but also a case where only a signal of each channel of a multi-channel audio signal is arranged in some multi-channel sub-groups or a case where only a signal of each channel of a predetermined number of channels of a haptic vibration signal is arranged in some multi-channel sub-groups.

The multi-channel sub-group in which the signals of each channel of the multi-channel audio signal and the predetermined number of channels of the haptic vibration signal are sequentially arranged may be designated by the above-described first to third methods. The designation information in this case is also used as configuration information of the multi-channel audio signal and the predetermined number of channels of the tactile vibration signal. The configuration information includes identification information for distinguishing the haptic vibration signal from the audio signal. In addition, the identification information includes information of a vibration position for which each of the predetermined number of channels of the tactile vibration signal is directed.

Fig. 20 shows a case where the multi-channel sub-group 1 is specified by the second method in one example of the frame configuration of the multi-channel transmission format shown in fig. 18 described above. In this case, the 64 th bit (see fig. 13) of the channel state is set to "1", and this indicates that there is a multichannel sub-group specified by the second method using the multichannel map.

Then, the 65 th bit to the 70 th bit, and the 120 th bit to the 121 th bit of the channel status are set to 1, and this means that the multi-channel subset has a configuration of channels including the audio channels "65: FL", "66: FR", "67: FC", "68: LFE", "69: LS", and "70: RS" in the listed order, and also including the haptic vibration signals of "120: left hand" and "121: left hand" in the listed order.

As described above, in the AV system 10 shown in fig. 1, a signal including a predetermined number of channels of audio signals and a predetermined number of channels of haptic vibration signals and for each block including 192 frames is transmitted from the television receiver 100 to the audio amplifier 200 via the HDMI cable 300. Accordingly, the haptic vibration signal may be advantageously transmitted from the television receiver 100 to the audio amplifier 200 in synchronization with the audio signal.

In addition, in the AV system 10 shown in fig. 1, 192 frames included in a block are repetitions of multi-channel groups each including a predetermined number of sub-frames, a multi-channel audio signal (audio signal of a predetermined channel number) and a signal of each channel of a tactile vibration signal of a predetermined channel number are sequentially arranged in a multi-channel subgroup having a configuration specified by a predetermined channel state bit region or a predetermined number of consecutive user data bits formed in the multi-channel group, and the signals are transmitted. Therefore, the audio amplifier 200 as the receiver side can simply and appropriately acquire the predetermined channel number of audio signals and the predetermined channel number of tactile vibration signals based on the configuration information acquired from the predetermined channel state bit region or the predetermined number of consecutive user data bits.

In addition, in the AV system 10 shown in fig. 1, the above-described configuration information includes identification information that enables discrimination between a multi-channel audio signal and a predetermined number of channels of tactile vibration signals that are simultaneously transmitted. Accordingly, the audio amplifier 200 as the receiver side can acquire respective signals from the multi-channel audio signal and the predetermined number of channels of tactile vibration signals transmitted simultaneously while distinguishing them, and thus, for example, it is possible to prevent an operation error of erroneously providing the tactile vibration signals to the audio signal reproducing system and to prevent other errors.

In addition, in the AV system 10 shown in fig. 1, in the case where tactile vibration signals of a plurality of channels are to be transmitted, the above-described configuration information includes information of vibration positions targeted by the respective channels of the tactile vibration signals. Therefore, the audio amplifier 200 as the receiver side becomes able to appropriately vibrate the vibration device at the vibration position targeted by each channel of the tactile vibration signal.

Note that the advantages described in this specification are given for illustrative purposes only, and do not limit the advantages of the present technology. Other advantages may also be present.

<2. modified example >

Note that, in the above-described embodiment, the tactile vibration signal transmitted to the audio amplifier 200 by the television receiver 100 is a signal included in broadcast content, network content, or reproduced content. However, in the case where the haptic vibration signal is not included in the contents, a media signal (e.g., an audio signal and a video signal included in the contents) associated with the audio signal may be analyzed to generate the haptic vibration signal, and the haptic vibration signal may be used.

Fig. 21 shows a configuration example of the AV system 10A in this case. In fig. 21, portions having their counterparts in fig. 1 are given the same reference characters, and detailed descriptions thereof are appropriately omitted. The television receiver 100 also has a tactile vibration signal generation section 111. The tactile vibration signal generation section 111 analyzes the audio signal and the video signal input from the content reproduction circuit 108 to generate a tactile vibration signal, and supplies the tactile vibration signal to the SPDIF transmission circuit 104. In other respects, the television receiver 100 has a configuration similar to the television receiver 100 of the AV system 10 shown in fig. 1.

Note that, for example, in the case where the content includes vibration indication signals such as those generated by MIDI (musical instrument digital interface), the tactile vibration signal generation section 111 may generate a tactile vibration signal based on these vibration indication signals.

Further, although not mentioned above, the tactile vibration signal itself may be a multi-dimensional signal. For example, in the case where vibration data of X, Y, and Z axes included in a haptic vibration signal (see fig. 22) is to be transmitted, each piece of data is digitized into 8-bit data and may be transmitted by allocating the data to 24-bit slots in a subframe according to IEC 60958-1, as shown in fig. 23. A total of 24 bits from bit 4 to bit 27 in a subframe are used for audio channel transmission in linear PCM, and these bits are used by being divided into three groups of eight bits. Note that, for example, the Z axis is defined as being perpendicular to the skin, and the X axis and the Y axis are defined as being parallel to the skin. Further, the bit allocation may be weighted and may be non-uniformly allocated, e.g., 10 bits to the Z-axis and 7 bits to each of the X-axis and the Y-axis.

In the case of using a 24-bit slot by being divided into three as shown in fig. 23, even if the used device is driven only along the Z-axis, some bits (i.e., lower bits in the 24-bit data) are regarded as noise, and driving can be performed in a manner compatible with the case of one-dimensional driving. In addition, in this case, the 24-bit time slot may be divided such that a channel is assigned to each finger or a smaller contact surface is formed.

In addition, although not mentioned above, as shown in fig. 24, a haptic vibration signal covering each of vertices a to h of an imaginary cubic space of a user may be representatively transmitted, and a haptic vibration signal at an actual driving point included in the cubic space may be determined by linear interpolation or the like from the haptic vibration signal of each vertex. The signal name of the tactile vibration signal of each vertex in this case may be the front upper right corner, the rear lower left corner, or the like.

In addition, although not mentioned above, if the apparatus used supports recording and reproducing signals in the multi-channel transmission format shown in fig. 12, signals of the multi-channel transmission format including the multi-channel audio signal shown in fig. 18 and a predetermined number of channels of the tactile vibration signal can be similarly recorded and reproduced.

Further, in the example shown in the above embodiment, the tactile vibration signal is transmitted simultaneously with the audio signal. Similarly, the present techniques may also be applied to situations where various types of sensor signals are packaged in and transmitted simultaneously in a speech-enabled robotic machine control signal or audio microphone signal. In addition, the technology can also be applied to batch synchronous transmission of automobile engine sound, temperature sensor data and the like.

Note that although HDMI ARC is used as an IEC 60958 transmission line in the example shown in the above-described embodiment, a coaxial cable or an optical cable is used as the IEC 60958 transmission line in one possible example. Additionally, in another possible example, an HDMI transmission line may be used as an IEC 60958 transmission line. In this case, the SPDIF signal (IEC 60958 signal) is mapped into audio sample packets (audio sample packets) and transmitted in the same forward direction as the video transmission direction. Similarly, in another possible example, an IEC 61883-6 transmission line, an MHL transmission line, a display port transmission line (DP transmission line), etc. may be used as the IEC 60958 transmission line. In these cases, the SPDIF signal (IEC 60958 signal) is also mapped into audio sample packets (audio sample packets), and transmitted in the same forward direction as the video transmission direction.

In addition, although appropriate embodiments of the present disclosure are described in detail while referring to the drawings, the technical scope of the present disclosure is not limited to these examples. It is apparent that those skilled in the art of the present disclosure can conceive various types of modification examples or correction examples within the technical spirit range described in the claims, and it should be understood that various types of modification examples or correction examples naturally also belong to the technical scope of the present disclosure.

Further, the present technology may have a configuration as described below.

(1) A transmitting apparatus, comprising:

a transmission section sequentially transmitting transmission signals of respective blocks each including a plurality of frames to a receiver side via a predetermined transmission line, wherein

The transmission signal includes an audio signal of a predetermined number of channels and a haptic vibration signal of a predetermined number of channels.

(2) The transmission apparatus according to (1), further comprising:

an information adding section that adds configuration information of the predetermined number of channels of audio signals and the predetermined number of channels of tactile vibration signals to a transmission signal.

(3) The transmission apparatus according to (2), wherein the configuration information includes identification information for distinguishing the haptic vibration signal from the audio signal.

(4) The transmission apparatus according to (3), wherein the identification information includes information of a vibration position of the object in each of the predetermined number of channels of the tactile vibration signal.

(5) The transmission apparatus according to any one of (2) to (4), wherein the information adding means adds the configuration information by using a predetermined channel state bit region formed for each of the blocks.

(6) The transmission apparatus according to any one of (2) to (5), wherein the information adding means adds the configuration information by using user data bits of a predetermined number of consecutive frames.

(7) The transmission apparatus according to any one of (1) to (6), wherein

The plurality of frames includes repetitions of multi-channel groups, each multi-channel group including a predetermined number of frames, an

The transmitting means transmits the predetermined number of channels of audio signals and the predetermined number of channels of haptic vibration signals in a state where the predetermined number of channels of audio signals and the predetermined number of channels of haptic vibration signals are separately arranged in all or some of the predetermined number of frames in a time-division manner for each of the multi-channel groups.

(8) The transmission apparatus according to any one of (1) to (7), further comprising:

a processing component that generates a haptic vibration signal based on a media signal associated with the audio signal.

(9) The transmission apparatus according to any one of (1) to (8), wherein the predetermined transmission line is a coaxial cable, an optical cable, an Ethernet (IEC 61883-6) cable, an HDMI cable, an MHL cable, or a displayport cable.

(10) A transmission method, comprising:

a step of sequentially transmitting transmission signals each including respective blocks of a plurality of frames to a receiver side via a predetermined transmission line, wherein

The transmission signal includes an audio signal of a predetermined number of channels and a haptic vibration signal of a predetermined number of channels.

(11) A receiving apparatus, comprising:

a receiving section sequentially receiving transmission signals of respective blocks each including a plurality of frames from a transmitter side via a predetermined transmission line, wherein

The transmission signal includes an audio signal of a predetermined number of channels and a haptic vibration signal of a predetermined number of channels.

(12) The reception apparatus according to (11), further comprising:

a processing part which processes the transmission signal and outputs the predetermined number of channels of audio signals and the predetermined number of channels of haptic vibration signals.

(13) The receiving apparatus according to (12), wherein

The transmission signal includes configuration information of the audio signal of the predetermined number of channels and the haptic vibration signal of the predetermined number of channels, an

The processing section processes the transmission signal based on the configuration information and outputs the predetermined number of channels of audio signals and the predetermined number of channels of tactile vibration signals.

(14) The reception apparatus according to (13), wherein the configuration information is added by using a predetermined channel state bit region formed for each block.

(15) The reception apparatus according to (13) or (14), wherein the configuration information is added by using user data bits of a predetermined number of consecutive frames.

(16) The reception apparatus according to any one of (11) to (15), wherein

The plurality of frames includes repetitions of multi-channel groups, each multi-channel group including a predetermined number of frames, an

The predetermined number of channels of audio signals and the predetermined number of channels of tactile vibration signals are arranged in all or some of the predetermined number of frames in a time-division manner by channels for each of the multi-channel groups.

(17) The reception apparatus according to any one of (11) to (16), wherein the predetermined transmission line is a coaxial cable, an optical cable, an Ethernet (IEC 61883-6) cable, an HDMI cable, an MHL cable, or a displayport cable.

(18) A receiving method, comprising:

a step of sequentially receiving transmission signals each including respective blocks of a plurality of frames from a transmitter side via a predetermined transmission line, wherein

The transmission signal includes an audio signal of a predetermined number of channels and a haptic vibration signal of a predetermined number of channels.

[ List of identifiers ]

10, 10A AV system

100: television receiver

101 HDMI terminal

102 HDMI reception part

103: high speed bus interface

SPDIF transmitting circuit

105: system controller

107: digital broadcast receiving circuit

108: content reproduction circuit

109 display unit

110: ethernet interface

111: haptic vibration signal generation component

121: receiving antenna

122 BD Player

123 internet

200: audio amplifier

201 HDMI terminal

202 HDMI transmitting part

203: high speed bus interface

204 SPDIF receiving circuit

205: system controller

208: audio amplifier

209: vibration amplifier

210: ethernet interface

250: loudspeaker system

260: vibration system

300: HDMI cable