A good number of people have blamed fasting for slowing their metabolism.
The mechanism that may accomplish this is an upregulation of the enzyme SCD1, which converts saturated fat into monounsaturated fat. Unsaturated fats slow cellular metabolism down, and is one key way that animals get the signal to slow down their metabolism for winter when food is less available.
How are you measuring your calories burned?