Constraints on the primordial spectrum and inflationary potential from cosmological observations