Whelp I was able to do it but I feel like i can improve my efficiency or there is a better way to do it.
Attached is the screenshot of my final shapes. The green right side I tracked the side building with translate and then drew my shape also in green of the inner building. I linked the shape to the track but I found I had to do a lot of keyframing to match up parts.
When I went to try and do it the left side, I tried maybe tracking the inner part with skew and perspective on but it didnt work.
I ended up just tracking the shape directly upper and lower (in red) rather than linking it to any other tracks. I still had to keyframe but it wasnt as bad.
Thoughts on how I went about it and if there is an even better way?