Initiated by Roger Fenton and founded in London as the Photographic Society of London with Fenton as its first Secretary. The inaugural meeting was held at the, then, Society of Arts. Received Royal patronage in 1854.
The society was based in London until 1980 when it moved to Bath. Wikipedia has a list of the London addresses.