YOU SAID:

I was going to the party with my brother

INTO JAPANESE

私は兄と一緒にパーティーに行きました

BACK INTO ENGLISH

I went to a party with my brother

INTO JAPANESE

兄とパーティーに行ってきました

BACK INTO ENGLISH

I went to a party with my brother