nan error

[wickcode]

Hi,

Thanks for the code.

I am getting nan error, but it seems like you have a message "keep running". Did you face this issue? I am running this without Bert. Apart from removing bert from config, does it need any other changes?

What effect this has: https://github.com/headacheboy/IGSQL/blob/main/model/schema_interaction_model.py#L578?

Thanks

[headacheboy]

Hi,

I didn't try my model without Bert. I used to face this issue, but it seems fixed when I add 1e-8 before the torch.log() funtion.

Codes are in compute_loss() in https://github.com/headacheboy/IGSQL/blob/5cdbdbf5e530be14ff6441d2a4a514f3546d76ba/model/torch_utils.py

Maybe you can try the model with Bert embedding?

[wickcode]

Ok thank you. I am not sure how this is related to embeddings I will try other parameter maybe.
I am unable to use bert as it goes out of memory.