Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Duplicate VGG19 models #93

Closed
lutzroeder opened this issue Sep 8, 2018 · 18 comments
Closed

Duplicate VGG19 models #93

lutzroeder opened this issue Sep 8, 2018 · 18 comments

Comments

@lutzroeder
Copy link
Member

There are two different VGG19 models in the model zoo. Can the files be consolidated or renamed so users referring to "VGG19 in the model zoo" will be less ambiguous.

https://github.com/onnx/models/tree/master/vgg19
https://github.com/onnx/models/tree/master/models/image_classification/vgg

@snnn
Copy link
Contributor

snnn commented Sep 11, 2018

"The VGG19 in the model zoo generated from caffe2"
"The VGG19 in the model zoo generated from mxnet"

That would be enough.

@houseroad
Copy link
Member

@snnn thanks for the explanation

@prasanthpul
Copy link
Member

That's pretty confusing for the users of the zoo to have 2 different versions of the model. Which one should they use and why?

@prasanthpul prasanthpul reopened this Sep 20, 2018
@houseroad
Copy link
Member

probably we can have some evaluation. And only keep one.

@prasanthpul
Copy link
Member

we don't even link to both from the TOC so one of the models is "hidden".

@crahrig
Copy link

crahrig commented Oct 1, 2018

Adding on here that this is also captured by #82

@ankkhedia
Copy link
Contributor

@prasanthpul @crahrig The models listed #82 were in the model zoo before the need for all the artifacts was standardized. Previous models :
https://github.com/onnx/models/tree/master/squeezenet
https://github.com/onnx/models/tree/master/resnet50
https://github.com/onnx/models/tree/master/vgg19
They do not meet all the requirements of reporting pre-processing, post-processing and accuracy numbers.
However, since the models are generated from different frameworks, they are still coexisting.

@snnn
Copy link
Contributor

snnn commented Oct 2, 2018

Hi @ankkhedia ,

Is there any update on this bug: #91 ? Does it only affect the resnet100 model?

Thanks.

@ankkhedia
Copy link
Contributor

@snnn got a little busy and was not able to look into the issue #91, I will try to address the issue by next week. Sorry for the inconvenience.

@snnn
Copy link
Contributor

snnn commented Oct 2, 2018

Thank you @ankkhedia

@mx-iao
Copy link
Contributor

mx-iao commented Nov 1, 2018

@snnn @ankkhedia @prasanthpul @houseroad have we reached consensus on this? either 1) merge and keep only one model or 2) keep both, group in same folder, and differentiate based on training framework used ?

@snnn
Copy link
Contributor

snnn commented Nov 6, 2018

The VGG19 model from mxnet seems having some problems. The input of a GEMM op is not a 2-D tensor.

@vandanavk
Copy link

The VGG19 model from mxnet seems having some problems. The input of a GEMM op is not a 2-D tensor.

This should be fixed with PR apache/mxnet#13356.

@snnn
Copy link
Contributor

snnn commented Jan 9, 2019

The VGG19 model from mxnet seems having some problems. The input of a GEMM op is not a 2-D tensor.

This should be fixed with PR apache/incubator-mxnet#13356.

So, someone will update the models here?

@ankkhedia
Copy link
Contributor

@snnn I will update the models after generating them with this fix.

@lutzroeder
Copy link
Member Author

The actual issue seems to be there are duplicate VGG19 models in the zoo (see above). How does "updating" the files resolve this issue? Shouldn't one set be removed or the README.md files be updated to clarify?

@ankkhedia
Copy link
Contributor

ankkhedia commented Jan 10, 2019

@lutzroeder This is about @snnn comment about issues with MXNet generated models.
Regarding duplicate models, the models have been generated from different frameworks and there is no clear consensus as to remove the models or keep both in same folder and differentiate on basis of names

@prasanthpul any thoughts on the same?

@ankkhedia
Copy link
Contributor

ankkhedia commented Jan 15, 2019

@snnn The models has been uploaded after the fix. Please feel free to verify and let us know in case of any issues

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

8 participants