We present the characteristics of far-infrared (FIR) brightness fluctuations at 90 μm and 170 μm in the Lockman Hole, which were surveyed with the ISOPHOT instrument aboard the Infrared Space Observatory (ISO), and give constraints on the galaxy number counts down to 30 mJy at 90 μm and 50 mJy at 170 μm. The fluctuation power spectra of the FIR images are not dominated by IR cirrus, and are instead most likely due to star-forming galaxies. This analysis indicates the existence of strong evolution in the counts. Especially at 90 μm, the source density is much larger than that expected from the currently available galaxy count models. The galaxies responsible for the fluctuations also significantly contribute to the cosmic infrared background radiation recently derived from an analysis of the COBE data.