interchange of the expected value and summation

The expectation of a sum of nonnegative random variables indexed by the integers is equal to the sum of the expectations, whether the resulting number is finite or infinite. This follows from Fubini's theorem for nonnegative functions (often called Tonelli's theorem) applied to the product measure which is the product of P by the counting measure on the integers.