Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[mieb] royokong/e5-v on EDIST2ITRetrieval 'NoneType' object has no attribute 'dtype' #1455

Open
Muennighoff opened this issue Nov 14, 2024 · 0 comments
Labels
mieb The image extension of MTEB

Comments

@Muennighoff
Copy link
Contributor

ERROR:mteb.evaluation.MTEB:Error while evaluating EDIST2ITRetrieval: 'NoneType' object has no attribute 'dtype'
Traceback (most recent call last):
File "/data/niklas/mieb/mteb/scripts/run_mieb.py", line 91, in
results = evaluation.run(model, output_folder="/data/niklas/mieb/results-mieb-final", batch_size=32)
File "/data/niklas/mieb/mteb/mteb/evaluation/MTEB.py", line 464, in run
raise e
File "/data/niklas/mieb/mteb/mteb/evaluation/MTEB.py", line 425, in run
results, tick, tock = self._run_eval(
File "/data/niklas/mieb/mteb/mteb/evaluation/MTEB.py", line 300, in _run_eval
results = task.evaluate(
File "/data/niklas/mieb/mteb/mteb/abstasks/Image/AbsTaskAny2AnyRetrieval.py", line 269, in evaluate
scores[hf_subset] = self._evaluate_subset(
File "/data/niklas/mieb/mteb/mteb/abstasks/Image/AbsTaskAny2AnyRetrieval.py", line 278, in _evaluate_subset
results = retriever(corpus, queries)
File "/data/niklas/mieb/mteb/mteb/evaluation/evaluators/Image/Any2AnyRetrievalEvaluator.py", line 290, in call
return self.retriever.search(
File "/data/niklas/mieb/mteb/mteb/evaluation/evaluators/Image/Any2AnyRetrievalEvaluator.py", line 123, in search
query_embeddings = self.model.get_text_embeddings(
File "/data/niklas/mieb/mteb/mteb/models/e5_v.py", line 56, in get_text_embeddings
text_outputs = self.model(
File "/env/lib/conda/gritkto4/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1553, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
File "/env/lib/conda/gritkto4/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1562, in _call_impl
return forward_call(*args, **kwargs)
File "/env/lib/conda/gritkto4/lib/python3.10/site-packages/accelerate/hooks.py", line 170, in new_forward
output = module._old_forward(*args, **kwargs)
File "/env/lib/conda/gritkto4/lib/python3.10/site-packages/transformers/models/llava_next/modeling_llava_next.py", line 874, in forward
inputs_embeds = inputs_embeds.to(image_features.dtype)
AttributeError: 'NoneType' object has no attribute 'dtype'

@Muennighoff Muennighoff changed the title [mieb] EDIST2ITRetrieval 'NoneType' object has no attribute 'dtype' [mieb] royokong/e5-v on EDIST2ITRetrieval 'NoneType' object has no attribute 'dtype' Nov 14, 2024
@isaac-chung isaac-chung added the mieb The image extension of MTEB label Nov 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
mieb The image extension of MTEB
Projects
None yet
Development

No branches or pull requests

2 participants