We aim to push ChatGPT + Code Interpreter to its limits, show you what's possible and unlock your creativity! Well, and have a lot of fun doing it! π₯
Code Interpreter is an official ChatGPT plugin for data analytics, image conversions, editing code, and more. Since July 6th, 2023, it has been available to all ChatGPT Plus users. It provides OpenaAI models with a working Python interpreter in a sandboxed, firewalled execution environment. Importantly, it is possible to upload and download files.
π activate code interpreter
- No internet access.
- You can upload a maximum of 100 MB.
(*)
- Runs only Python code.
(*)
- Does not allow installation of external Python packages.
(*)
- When the environment dies you lose the entire state. Links that allowed you to download files stop working.
(*)
- it is possible to bypass these restrictions
Code Interpreter has a set of pre-installed Python packages. What if the environment doesn't have the package you want to use?
OpenAI does not allow access to pre-trained deep learning models in the Code Interpreter environment. However, it is still possible to detect and track objects. We just need to be more creative. Haar Cascade was one of the most popular approaches to face detection in old-school computer vision.
π steps
-
Upload input video.
π display input video
IMG_5759.MOV
-
Confirm that ChatGPT can successfully process the video. Extract the first frame and display it.
-
Run Haar Cascade face detection on a single video frame.
-
Run Haar Cascade face detection on the whole video.
π display result video
processed_video.mp4
-
Use box IoU to remove false positives.
π display result video
processed_video_iou_single_box.mp4
-
Crop video to follow the face.
processed_video_iou_single_box_crop_paste_600x600.mp4
The MNIST dataset is a widely-used collection of handwritten digits that is used to teach computers how to recognize and understand numbers. It consists of thousands of examples of handwritten numbers from 0 to 9, created by different people in different styles. The images are very small - only 28x28 pixels. Therefore, they are great for training in an environment with limited resources.
π steps
-
Upload the MNIST dataset into the Code Interpreter environment.
-
only 10% of the original dataset is loaded to save hard drive and memory space.
-
Make sure that Code Interpreter knows how to process data.
-
Split data into train and test subsets.
-
Train sci-kit learn Support Vector Classifier on the test set.
-
Evaluate the trained model on the test set.
-
Visualize false classification results.
-
Download the trained model.
![](https://private-user-images.githubusercontent.com/26109316/252318924-c52e63eb-5fb1-4f7f-9908-25171071f354.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjA5MDg4NDUsIm5iZiI6MTcyMDkwODU0NSwicGF0aCI6Ii8yNjEwOTMxNi8yNTIzMTg5MjQtYzUyZTYzZWItNWZiMS00ZjdmLTk5MDgtMjUxNzEwNzFmMzU0LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA3MTMlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNzEzVDIyMDkwNVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTI3OGQ4NTA2MWEzNGUyOWY1MmY0ZmViNTU1ZGY1OWEzNWI1YzA1OTA0ZTAwOTRmNGQ3OWI1MWIwMmY5OTk3MWImWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.U9EzibxySD93VV-XolC7M1aSuRrl8bwTs10vOzx-wHI)
π§ coming soon...
We would love your help in making this repository even better! If you know of an amazing prompt you would like to share, or if you have any suggestions for improvement, feel free to open an issue or submit a pull request.