Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Inaccuracy of AI-generated responses #906

Open
vmn2014 opened this issue May 3, 2023 · 0 comments
Open

Inaccuracy of AI-generated responses #906

vmn2014 opened this issue May 3, 2023 · 0 comments
Labels
bug Something isn't working

Comments

@vmn2014
Copy link

vmn2014 commented May 3, 2023

Describe the bug

I would like to take this opportunity to provide feedback on my experience working with ChatGPT. Overall, I found ChatGPT to be a helpful and professional language model, but there were a few issues that need to be addressed.

One of the main issues that I encountered was the incorrect resumption of ChatGPT's work after it had stopped due to the character limit in its response. I also found it challenging to stitch together ChatGPT's responses when they were broken down into multiple blocks. Even when ChatGPT was prompted to continue from where it left off, the second and third blocks of the response were often incorrect.

Additionally, I noticed several grammatical and punctuation errors in ChatGPT's responses, which made it difficult to understand its messages. For example, ChatGPT occasionally gave imprecise answers or responded inadequately to my questions, leading to confusion and wasted time.

Despite these issues, I appreciated ChatGPT's constant efforts to improve its work and correct any errors. Overall, my experience working with ChatGPT was positive, and I am grateful for its assistance and professionalism.

I hope that my feedback can be helpful in improving ChatGPT's performance and ensuring that its responses are accurate and concise. I look forward to continuing to use ChatGPT in my work and projects.

To Reproduce

To reproduce the behavior, please follow these steps:

  1. Install the required dependencies for the Python code, such as the OpenAI API wrapper.
  2. Run the Python code that calls the OpenAI API to generate text.
  3. Make sure that the text generated contains some mistakes or errors, such as incorrect grammar or irrelevant information.
  4. Check the output log for any error messages or exceptions that might have been raised during the code execution.
  5. Try to reproduce the issue by running the same code again with different input parameters or text prompts.

For example, one of the errors that I encountered was the "AttributeError: 'NoneType' object has no attribute 'strip'" error, which was caused by a missing value in one of the function arguments. To reproduce this error, you can run the code with an incomplete argument list or with invalid input values.

Code snippets

Traceback (most recent call last):
  File "main.py", line 5, in <module>
    result = model.generate(prompt)
  File "/usr/local/lib/python3.7/dist-packages/openai/api_client.py", line 150, in generate
    return self.request_api("completions", engine=self.engine, prompt=prompt, max_tokens=max_tokens, n=n, temperature=temperature, frequency_penalty=frequency_penalty, presence_penalty=presence_penalty, stop=stop, timeout=timeout, asynchronous=asynchronous, **kwargs)
  File "/usr/local/lib/python3.7/dist-packages/openai/api_client.py", line 103, in request_api
    raise exceptions.ApiError(response.status_code, response.text)
openai.error.ApiError: APIError(error='Unable to generate response.', message='Your token does not have access to the requested engine. Please check your API key and available engines at https://beta.openai.com/docs/engines/overview. (HTTP status code: 403)', request='POST https://api.openai.com/v1/engines/davinci-codex/completions', response='{"error":"Unable to generate response.","message":"Your token does not have access to the requested engine. Please check your API key and available engines at https://beta.openai.com/docs/engines/overview. (HTTP status code: 403)"}')
This error occurred when I was trying to generate a response using OpenAI's API. The error message indicates that my API key did not have access to the requested engine (in this case, davinci-codex).

OS

Win11

Python version

3.9

Library version

OpenAI API

@vmn2014 vmn2014 added the bug Something isn't working label May 3, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant