[BUG] '{}' is not of type 'array' when using sam model.

[ShylockGao]

Describe the bug
Unable to use the "sam" model in cli.
rembg i -m sam -x '{ "sam_prompt": [{"type": "point", "data": [724, 740], "label": 1}] }' .\1305696_1704870215425_1705054411.png xxx.png
Getting error: '{}' is not of type 'array'

jsonschema.exceptions.ValidationError: '{}' is not of type 'array'

Failed validating 'type' in schema:
    {'items': {'properties': {'data': {'items': {'type': 'number'},
                                       'type': 'array'},
                              'label': {'type': 'integer'},
                              'type': {'type': 'string'}},
               'type': 'object'},
     'type': 'array'}

On instance:
    '{}'

To Reproduce
rembg i -m sam -x '{ "sam_prompt": [{"type": "point", "data": [724, 740], "label": 1}] }' .\1305696_1704870215425_1705054411.png xxx.png

OS Version:
window 11

Rembg version:
v2.0.53

[zhengxiongli08]

Hi, Gao. Have you solved this problem yet? I think I have the same problem with you.

[ShylockGao]

Hi, Gao. Have you solved this problem yet? I think I have the same problem with you.

not solved

[AbakirH]

Does anyone know why this is happening?

[Loewen-Hob]

I have the same problem. Have you solved it?

[jalsop24]

I think it stems from the default being wrong here -

rembg/rembg/sessions/sam.py

Line 153 in 0dcdb08

prompt = kwargs.get("sam_prompt", "{}")

This is also relevant to #577

[God-damnit-all]

This is a character escaping issue. If you are running this from the cmd prompt, it should look like this:

rembg i -m sam -x "{ \"sam_prompt\": [{\"type\": \"point\", \"data\": [724, 740], \"label\": 1}] }" .\1305696_1704870215425_1705054411.png xxx.png

If you're running from PowerShell 5.1, it should look like this:

rembg i -m sam -x '{ \"sam_prompt\": [{\"type\": \"point\", \"data\": [724, 740], \"label\": 1}] }' .\1305696_1704870215425_1705054411.png xxx.png

If you're running from PowerShell 7.4, it should look like this:

rembg i -m sam -x '{ "sam_prompt": [{"type": "point", "data": [724, 740], "label": 1}] }' .\1305696_1704870215425_1705054411.png xxx.png

[yuxi-liu-wired]

I got the same error on the HTTP server.

How to solve this when using it interactively on the HTTP server?

[hanqingL-bjtu]

The error reporting location should be located in
Link Text
It means there is a problem with the json format input of your prompt.

[kerberosargos]

Hello, is anybody help me "how to to use SAM model with library usage".

I am trying to handle as following code line but I am getting error.

bg_cleaned_image = remove(data=my_image, session=rembg.new_session("sam", sam_prompt=[{"type": "point", "data": [724, 740], "label": 1}])

Error

raise error
jsonschema.exceptions.ValidationError: '{}' is not of type 'array'

Failed validating 'type' in schema:
                                       'type': 'array'},
                              'type': {'type': 'string'}},
               'type': 'object'},
     'type': 'array'}

On instance:
    '{}'

[aloeb-gh]

Hello, is anybody help me "how to to use SAM model with library usage".

I am trying to handle as following code line but I am getting error.

bg_cleaned_image = remove(data=my_image, session=rembg.new_session("sam", sam_prompt=[{"type": "point", "data": [724, 740], "label": 1}])

Error

raise error
jsonschema.exceptions.ValidationError: '{}' is not of type 'array'

Failed validating 'type' in schema:
                                       'type': 'array'},
                              'type': {'type': 'string'}},
               'type': 'object'},
     'type': 'array'}

On instance:
    '{}'

Hello,
Try with sam_prompt outside of the session argument.
For me it works with the following code :

session_rmbg = new_session(model_name="sam")
input ect...
output = remove(input, session=session_rmbg, sam_prompt=[{"type": 'point', "data": [1600, 2400], "label": 1}])

[github-actions]

This issue is stale because it has been open for 30 days with no activity.

[fuaneng]

jsonschema.exceptions.ValidationError: '{}' is not of type 'array'

Failed validating 'type' in schema:
{'items': {'properties': {'data': {'items': {'type': 'number'},
'type': 'array'},
'label': {'type': 'integer'},
'type': {'type': 'string'}},
'type': 'object'},
'type': 'array'}

On instance:
'{}'

这里的 prompt={} 应该改为一个数组

from rembg import remove

prompt = [{'type': 'label', 'data': [0.5, 0.5], 'label': 1}]
output = remove(input, prompt=prompt)

[Suvoo]

Describe the bug Unable to use the "sam" model in cli. rembg i -m sam -x '{ "sam_prompt": [{"type": "point", "data": [724, 740], "label": 1}] }' .\1305696_1704870215425_1705054411.png xxx.png Getting error: '{}' is not of type 'array'

jsonschema.exceptions.ValidationError: '{}' is not of type 'array'

Failed validating 'type' in schema:
    {'items': {'properties': {'data': {'items': {'type': 'number'},
                                       'type': 'array'},
                              'label': {'type': 'integer'},
                              'type': {'type': 'string'}},
               'type': 'object'},
     'type': 'array'}

On instance:
    '{}'

To Reproduce rembg i -m sam -x '{ "sam_prompt": [{"type": "point", "data": [724, 740], "label": 1}] }' .\1305696_1704870215425_1705054411.png xxx.png

OS Version: window 11

Rembg version: v2.0.53

Did you find a solution? I am unable to run "sam" in a python file as well? Like the library approach also failed @kerberosargos @aloeb-gh

[Suvoo]

Hello, is anybody help me "how to to use SAM model with library usage".
I am trying to handle as following code line but I am getting error.
bg_cleaned_image = remove(data=my_image, session=rembg.new_session("sam", sam_prompt=[{"type": "point", "data": [724, 740], "label": 1}])
Error

raise error
jsonschema.exceptions.ValidationError: '{}' is not of type 'array'

Failed validating 'type' in schema:
                                       'type': 'array'},
                              'type': {'type': 'string'}},
               'type': 'object'},
     'type': 'array'}

On instance:
    '{}'

Hello, Try with sam_prompt outside of the session argument. For me it works with the following code :

session_rmbg = new_session(model_name="sam") input ect... output = remove(input, session=session_rmbg, sam_prompt=[{"type": 'point', "data": [1600, 2400], "label": 1}])

I am getting the same issue, but I feel prompt is not the problem here :

input = Image.open(input_path)
model_name = "sam"
session = new_session(model_name)
output = remove(input, session=session)
output.save(output_path)

reproduces the same error

[github-actions]

This issue is stale because it has been open for 30 days with no activity.

[github-actions]

This issue was closed because it has been inactive for 14 days since being marked as stale.

[manindertaggar]

@Suvoo You are getting that error because sam_prompt is a mandatory field.
See sam.py, Line 145

Try passing the input_labels and data as follows, should work.

input = Image.open(input_path)

output = remove(input,
                session=new_session("sam"),
                sam_prompt=[{"type": "point", "data": [10, 10], "label": 0}])
output.save(output_path)