We applied a polarization analysis of InSight seismic data to estimate temporal variation and frequency dependence of the Martian ambient noise field. An autocorrelation analysis suggests that a lithological boundary beneath the seismometer influences ambient noise characteristics. High-frequency (4–8 Hz) P-waves show a diurnal variation in the dominant back-azimuth that appears to be related to wind and direction of sunlight in a distant area. High-frequency Rayleigh waves (4–8 Hz) also show diurnal variation and a dominant back-azimuth related to wind direction in a nearby area. Rayleigh waves of <2 Hz show diurnal variations. However, the dominant back-azimuths of P-waves of <4 Hz and Rayleigh waves of 2–4 Hz are constant. Therefore, the higher frequency signal could be derived mainly from wind. These results point to the presence of several ambient noise sources as well as site amplification effects related to geologic structure at the InSight landing site.