Method and apparatus for binaural rendering audio signal using variable order filtering in frequency domain

{
  "publication_number": "US10580417B2",
  "country": "US",
  "kind": "B2",
  "title": "Method and apparatus for binaural rendering audio signal using variable order filtering in frequency domain",
  "abstract": "The present invention relates to a method and an apparatus for binaural rendering an audio signal using variable order filtering in frequency domain. To this end, provided are a method for processing an audio signal including: receiving an input audio signal; receiving a set of truncated subband filter coefficients for filtering each subband signal of the input audio signal, the set of truncated subband filter coefficients being constituted by one or more FFT filter coefficients generated by performing FFT by a predetermined block size; generating at least one subframe for each subband; generating at least one filtered subframe for each subband; performing inverse FFT on the filtered subframe for each subband; and generating a filtered subband signal by overlap-adding the transformed subframe for each subband and an apparatus for processing an audio signal using the same.",
  "claims": [
    "1. A method for binaural rendering an audio signal, comprising: receiving an input audio signal; receiving a set of truncated subband filter coefficients for filtering each subband signal of the input audio signal, the set of truncated subband filter coefficients being at least a portion of a corresponding set of subband filter coefficients obtained from binaural room impulse response (BRIR) filter coefficients for binaural filtering of the input audio signal, a length of the set of truncated subband filter coefficients being individually determined for each subband based on characteristic information extracted from the corresponding set of subband filter coefficients, the length of the set of truncated subband filter coefficients being determined to be variable in a frequency domain, and the set of truncated subband filter coefficients being constituted by one or more FFT filter coefficients generated by performing fast Fourier transform (FFT) by a predetermined block size in a corresponding subband; generating at least one subframe for each subband by performing fast Fourier transform of each subband signal based on a predetermined subframe size; generating at least one filtered subframe for each subband, each filtered subframe being generated by multiplying a corresponding subframe and the FFT filter coefficients; inverse fast Fourier transforming the at least one filtered subframe for each subband; and generating a filtered subband signal by overlap-adding the at least one inverse fast Fourier transformed subframe for each subband.",
    "2. The method of claim 1, wherein the characteristic information includes reverberation time information of the corresponding set of subband filter coefficients.",
    "3. The method of claim 1, wherein a length of a set of truncated subband filter coefficients of at least one subband is different from a length of a set of truncated subband filter coefficients of another subband.",
    "4. The method of claim 1, wherein the predetermined block size and the predetermined subframe size have values of power of 2.",
    "5. The method of claim 1, wherein the predetermined subframe size is determined based on the predetermined block size in the corresponding subband.",
    "6. The method of claim 5, the performing of the fast Fourier transform of each subband signal comprises: partitioning each subband signal by the predetermined subframe size; generating a temporary subframe including a first half part constituted by the partitioned subband signal and a second half part constituted by zero-padded values; and fast Fourier transforming the generated temporary subframe.",
    "7. An apparatus for processing an audio signal, which is used for performing binaural rendering of input audio signals, each input audio signal including a plurality of subband signals, the apparatus comprising: a processor configured to perform rendering of a direct sound and early reflections sound parts for each subband signal, wherein the processor is further configured to: receive an input audio signal; receive a set of truncated subband filter coefficients for filtering each subband signal of the input audio signal, the set of truncated subband filter coefficients being at least a portion of a corresponding set of subband filter coefficients obtained from binaural room impulse response (BRIR) filter coefficients for binaural filtering of the input audio signal, a length of the set of truncated subband filter coefficients being individually determined for each subband based on characteristic information extracted from the corresponding set of subband filter coefficients, the length of the set of truncated subband filter coefficients being determined to be variable in a frequency domain, and the set of truncated subband filter coefficients being constituted by one or more FFT filter coefficients generated by performing fast Fourier transform (FFT) by a predetermined block size in a corresponding subband; generate at least one subframe for each subband by performing fast Fourier transform of each subband signal based on a predetermined subframe size; generate at least one filtered subframe for each subband, each filtered subframe being generated by multiplying a corresponding subframe and the FFT filter coefficients; inverse fast Fourier transform the at least one filtered subframe for each subband; and generate a filtered subband signal by overlap-adding the at least one inverse fast Fourier transformed subframe for each subband.",
    "8. The apparatus of claim 7, wherein the characteristic information includes reverberation time information of the corresponding set of subband filter coefficients.",
    "9. The apparatus of claim 7, wherein a length of a set of truncated subband filter coefficients of at least one subband is different from a length of a set of truncated subband filter coefficients of another subband.",
    "10. The apparatus of claim 7, wherein the predetermined block size and the predetermined subframe size have values of power of 2.",
    "11. The apparatus of claim 7, wherein the predetermined subframe size is determined based on the predetermined block size in the corresponding subband.",
    "12. The apparatus of claim 11, the performing of the fast Fourier transform of each subband signal comprises: partitioning each subband signal by the predetermined subframe size; generating a temporary subframe including a first half part constituted by the partitioned subband signal and a second half part constituted by zero-padded values; and fast Fourier transforming the generated temporary subframe."
  ],
  "cpc": [
    "G10L 19/008",
    "G10H 2250/111",
    "G10H 2250/145",
    "H03H 17/06",
    "H04R 3/00",
    "H04R 5/033",
    "H04S 2400/01",
    "H04S 2420/01",
    "H04S 2420/03",
    "H04S 3/00",
    "H04S 3/002",
    "H04S 3/004",
    "H04S 3/008"
  ],
  "assignees": [
    "UNIV YONSEI IACF",
    "WILUS INST STANDARDS & TECH INC",
    "ELECTRONICS & TELECOMMUNICATIONS RES INST"
  ],
  "filing_date": "2014-10-22",
  "publication_date": "2020-03-03",
  "grant_date": "2020-03-03",
  "priority_date": "2013-10-22",
  "application_number": "US-201415031275-A",
  "family_id": "52993176",
  "citations": [
    "EP2541542A1",
    "JP2009261022A",
    "JP2009531906A",
    "JP5084264B2",
    "KR100754220B1",
    "KR100924576B1",
    "KR100971700B1",
    "KR101146841B1",
    "KR101304797B1",
    "KR20050123396A",
    "KR20080076691A",
    "KR20080078882A",
    "KR20080098307A",
    "KR20080107422A",
    "KR20090020813A",
    "KR20090047341A",
    "KR20100062784A",
    "KR20100063113A",
    "KR20110002491A",
    "KR20120006060A",
    "KR20120013893A",
    "KR20130045414A",
    "KR20130081290A",
    "US2005117762A1",
    "US2007071249A1",
    "US2007100612A1",
    "US2007172086A1",
    "US2008008342A1",
    "US2008025519A1",
    "US2008033730A1",
    "US2008192941A1",
    "US2008205658A1",
    "US2008253578A1",
    "US2009012638A1",
    "US2009041263A1",
    "US2009043591A1",
    "US2009103738A1",
    "US2009252356A1",
    "US2009319283A1",
    "US2010017195A1",
    "US2010080112A1",
    "US2010169104A1",
    "US2010246832A1",
    "US2010246851A1",
    "US2010322431A1",
    "US2011170721A1",
    "US2011211702A1",
    "US2011261948A1",
    "US2011264456A1",
    "US2011305345A1",
    "US2012014528A1",
    "US2012039477A1",
    "US2012243713A1",
    "US2013028427A1",
    "US2013090933A1",
    "US2013182870A1",
    "US2013208902A1",
    "US2013272526A1",
    "US2013272527A1",
    "US2014006037A1",
    "US2014088978A1",
    "US2014355796A1",
    "US2015030160A1",
    "US2015223002A1",
    "US2016189723A1",
    "US2016198281A1",
    "US2016249149A1",
    "US2016275956A1",
    "US5329587A",
    "US5371799A",
    "US5544249A",
    "US5757931A",
    "US6108626A",
    "US7715575B1",
    "US8265284B2",
    "US8515104B2",
    "US8788554B2",
    "US9319764B2",
    "US9319794B2",
    "US9432790B2",
    "US9578437B2",
    "US9832585B2",
    "WO2008003467A1",
    "WO2009046223A2",
    "WO2011115430A2",
    "WO2012023864A1",
    "WO2015041476A1"
  ]
}