Samsung application US20110074989 proposes the integration of ToF IR pixels with RGB or RGB-W ones in a single array. One example of the pixel arrangement assumes quite big structure repeating itself across the array (black area transmits IR light):
The cross-section along the lines A-A is:
ToF portion seems to be based on Kawahito ToF approach with in-phase and out-of-phase integration nodes, controlled by electric current flow, Fig 5A and B respectively:
At the same time RGB-W pixels are protected from IR ToF illumination by a p+ potential barrier:
The sensor seems to be aimed to mobile applications.
Update: A separate Samsung application US20110085063 talks about IR-RGB color filter arrangement and RGB interpolation for that case.