Hybrid pixel detectors like the Medipix andTIMEPIX developed by the Medipix collaboration combinedwith high-z materials are of growing interest. In particular theTIMEPIX detector can be operated in photon counting mode andtime-over-threshold mode (ToT) to obtain spectral information.Previous studies showed that 110 μm pixel sizes obtain a betterenergy resolution than 55 μm pixel sizes. Furthermore, thresholdscans obtained a better spectral resolution than operation in ToTmode. In this work the influence of noise sources in differentmeasurement approaches on the spectral response of a TIMEPIXchip bump-bonded to CdTe sensor are presented. Two 1mmthick CdTe sensors with pixel sizes of 55 μm and 110 μm,bump-bonded to a TIMEPIX readout chip, were evaluated atthe Diamond Light Source synchrotron. A finely collimated,perpendicular pencil beam with x-ray energies of 25 keV and79 keV was used to investigate single pixels. A small area of 10x10pixels was investigated in ToT-mode and compared to a thresholdscan of the same pixels on both detectors. The measurementsare compared to an analytical SPICE/Python simulation thatemulates photon counting and time-over-threshold mode.