Evaluation Parameters

Required Evaluation Parameters

Name	Type	Default value	Description
batchSize	int	64	Batch size per GPU.
numWorkers	int	1	Number of data loader workers per GPU.
leftKeys	list[str]	['text']	List of column names for the left features, typically text fields.
rightKeys	list[str]	['image_local', 'title']	List of column names for the right features. The first field should be an image, and the others should be text fields.
imgOrTxt	str	[["txt"], ["img", "txt"]]	CSV column name used to represent weights.
leftWeights	list[str]	""	List of weights for the left features.
rightWeights	list[float]	""	List of weights for the right features.
contextLength	str	""	List (represented as a string) that indicates the context length.

Example

evaluate_task_params = {
    "batch-size": 32,
    "num_workers": 4,
    "left-keys": ["query"],
    "right-keys": ["my_image", "my_text"],
    "img-or-txt": [["txt"], ["img", "txt"]],
    "left-weights": [1],
    "right-weights": [0.9, 0.1],
    "context-length": [[77], [0, 77]]
}