Alex Volkov (@altryne) on X

From here on own, the thread is my running contemporaneous notes: So far the limitations are, it cannot install packages it doesn't have, and doesn't have access to the web, so here's my game plan, will use

as my running notes, let's go 👇

Right so, we have a problem, #CodeInterpreterCan (not) install from pip. So we need... to package chroma. I'm currently not sure if wheels include other requirements or nah, so checking w/ chatGPT real quick by uploading the whole repo 😂

Sometimes it doesn't know it's own strength, so it struggles, and needs encouragement, just like a junior dev would!

Ok but making sure I have chroma is not enough right? we need to do some... data analysis. For that, we need, some embeddings! I have my tweets.json with all my tweets, and I've asked #codeinterpreterCan to .. generate a python file that will run this via

ada-002 👀

While it generates, I will tell you, that the mere fact you can upload and download files is such a game changer! So so good!

Ok so we have chroma running, but #codeinterpreter always forgets haha, a neat trick is to scroll up to a point it remembers, edit your message, and it'll effectively "fork" the conversation from there. Another neat trick is, after you've done so, generate a share link.

One additional thing to note, the environment and files often reset! Especially if you refreshed the page etc so make sure to ask chatGPT if it has the right files, otherwise it'll tell you it can't do things, but often won't know to tell you that it's because the file are gone!

Btw, it's been an hour or so and I'm still fighting the different error states, I know we can run

,but I am unable to get chatGPT to instantiate it properly and persistently so I can actually... use it. 😅 Oh ok finally , we golden!

Now let's load the f-ing embeddings! ... It's a constant struggle with env. reset, the model forgetting it can do it, and me getting tired and not being familiar with

(and GPT not knowing about all the capabilities) I think I can so something w/ collections? 🤔

I downloaded the API cheatsheet from chroma github, and will feed all of it to chatGPT to see if it can learn, cause I'm gettin tired and my kids won't drive themselves from daycare! It seems... like it works, using

amazing notalk;justgo bitchslap of a trick

Interestingly, I seem to have noticed a strong confabulation issue, so things need to be double checked! These are NOT my tweets and the error had a huge print, so it likely exceeded the context window of the model 👀

Ok kids in bed, it was a fun hang, but now back to pacifying this ... babyAGI 😂 My trick from before works, editing my message from a previous state where things were ok, asking #codeinterpreter to verify that all directories exist (they were deleted!) and then re-uploading LFG

Allrighty, we have a collection confirmed. And hopefully persisted to disk via persist_directory="/path/to/persist/directory" It needed some convincing to ask #codeinterpreter to save it somewhere we have write access, let's try to actually load some embeddings!

YES! Victory! Embeddings are in the

collection we were able to list them, count them and.... could not query them 😂 Wamp Wamp, but I still declare a success! We can't query because I also need to embed my query, and the environment doesn't have internet access DOH

You can read the unrolled version of this thread here:

This thread kicked my butt, I knew this would be interesting to folks stretching the limits of what #CodeInterpreter can do, and so I really tried to take "notes" in tweets to show you my process If you got this far, give a RT to the main tweet, twitter algo is a fickle bitch 🫡