openai-nodejs-cli

NodeJS CLI tool for submitting fine-tuning jobs to OpenAI. This toll can also generate stub code for GPT plugins. Please refer to the OpenAI documentation for a detailed explanation of the plugin manifest and architecture.

Options:

-cft --create-fine-tune-job [specFile, trainingData, validationData]
specFile - relative path (from current directory) to the job spec json file.
trainingData - relative path (from current directory) to the job training data json file.
validationData - relative path (from current directory) to the validation data json file.
-gjb --get-job [jobId]
jobId - The id of the job returned in the create call.
-h --help
Prints the help menu.

Example Usage

node index -cft ./specFile.json ./trainingData.jsonl ./validationData.jsonl

IMPORTANT: don't forget to add your .env file!

OPENAI_API_KEY=<YOUR_SECRET>
DEBUG=openai-nodejs-cli

Note the referenced files are included in this repo. Please refer to the OpenAI Fine-Tuning guide for more information about the file format and settings.

Below is a typical response with the identifiers replaced with xxx

{
"object": "fine_tuning.job",
"id": "ftjob-1234",
"model": "gpt-4o-mini-2024-07-18",
"created_at": 1733604278,
"finished_at": null,
"fine_tuned_model": null,
"organization_id": "org-1234",
"result_files": [],
"status": "validating_files",
"validation_file": null,
"training_file": "file-1234",
"hyperparameters": {
"n_epochs": 1
},
"trained_tokens": null,
"error": {},
"user_provided_suffix": null,
"seed": 2139682031,
"estimated_finish": null,
"integrations": []
}

You can use the returned id property to poll the API:

node index -gjb ft-PSUaVtJNV3JzJAhUuAFh7g6M

IMPORTANT: it can take anywhere from 20-30 minutes for a job to succeed or days depending on OpenAI service health.

There is a command under ./commands/pollFineTuningJob.js that will poll the API, but I have not implemented it due to the long response times