I have had various cysts, including what the doctor suspects are corpus luteum cysts. For me, they have not been a problem and always go away on their own. My bigger issue is that I have now developed two borderline (pre-cancerous) ovarian cysts. One grew so large that I lost an ovary to it, and the 2nd one (last year) never grew large but continued looking suspicious on imaging, so I had to have surgery to remove it. We monitored it via ultrasounds, then MRI and CT scan over the course of 7 months before surgery, and I had at least one other "simple" cyst show up and subsequently go away in that time. The doctors were never concerned about that one, as they can usually tell from imaging what type of cyst it is (simple or complex). Due to my history, I require ultrasounds of my ovary every 6 months, most likely for the rest of my life.
I had my first ultrasound around 6.5 weeks this pregnancy, as a follow up to my last surgery, and I had another corpus luteum cyst. They are very common during pregnancy and regular ovulation, from everything I have read. My doctor (a gyn oncologist) noted it but is not concerned about it. Prior to that ultrasound, I had kind of suspected there was a cyst, since I had been having some dull aching and pulling on that side. I don't notice it anymore, so I'm assuming it has gone away by now. I have never had one burst with pain, thankfully, but sometimes I notice a bit of spotting when I think they are going away (or it's complete coincidence).
If your cyst does not go away by your next ultrasound, or grows or starts looking differently, there might be some concern about it. But for now it sounds like no big deal and should dissolve on its own, if it hasn't already.