Hi,
Thanks for sharing this awesome work.
I have a question on COCO image captioning benchmark. The BLEU4 scores in Table 6 is around 40, but my implementation shows BLEU4 score around 4.0. The score evaluation code is fine because it shows similar performance for CLIP-cap or BLIP.
As a default setting in demo, I'm using scale 7.5 and ddim_eta=0, but it doesn't improve when I change scale=2.0 and ddim_eta=1 following the Table 12. Is there anything I can do to produce comparable BLEU4 score for COCO dataset?
Here's the example result I made.
Hi,
Thanks for sharing this awesome work.
I have a question on COCO image captioning benchmark. The BLEU4 scores in Table 6 is around 40, but my implementation shows BLEU4 score around 4.0. The score evaluation code is fine because it shows similar performance for CLIP-cap or BLIP.
As a default setting in demo, I'm using scale 7.5 and ddim_eta=0, but it doesn't improve when I change scale=2.0 and ddim_eta=1 following the Table 12. Is there anything I can do to produce comparable BLEU4 score for COCO dataset?
Here's the example result I made.