In Vitro Fertilization (IVF) technology is used to help couple that have problem in their reproduction organs. However, the success rate of IVF is just 30%, so it is a challenging task to increase that success rate. In this paper, we proposed an ellipse detection method on single and multiple embryo image by modifying the ArcPSO method on ellipse fitting process and the process on extract the arc segment for ellipse detection. The experiment results on single embryo data showed that the proposed method has a 24% better on F-Measure, 21% better on precision, and 28% better on recall as compared to the original ArcPSO method. While the experiment results on multi embryo data showed that the proposed method has a 7% better on F-Measure, 11% better on Precision, and 2% better on Recall as compared to the original ArcPSO method.