Worried about abscess is inflammatory cancer

Hi I wonder if any one can give me any advice.

I had a swollen breast, lump, dimpling, redness about 3 months ago. I had two courses if antibiotics and they didn't work and was sent too a breast clinic. They suspected breast abscess, ultrasound and drained it.they sent the pus off for testing to see what antibiotics I needed. They discharged me. 

The redness has gone but the lump, pain hasn't. Its been 3 months. 

I didn't have a mammogram at the time. 

I saw a gyne for something else who said that it was, "very unusual in a non lactating older woman, I'm 52.

My mother had inflammatory breast cancer last year.

Any advice, do you think it was just a abscess or should I go back to my G. P.