The image forming process in a CdTe detector is both a function of the X-ray interaction in the material, including scattering and fluorescence, and the charge transport in the material [2]-[4]. The response of individual photons has been investigated using two pixellated CdTe image detectors with pixel pitches of 55 mu m and 110 mu m. The detectors were bonded to TIMEPIX [5] readout chips and operated in time over threshold mode (ToT). We have illuminated the sensors with monoengertic photons generated by X-ray fluorescence in metal sheets and with gamma photons from Am-241 and Cs-137. Results shows a large degradation in energy resolution caused by charge sharing and fluorescence. By summing pixels together we can correct for the charge sharing and some, but not all fluorescence.