In this video, an innovative new development from OpenAI, known as GPT 4.0 omni, is introduced. This model's advanced capabilities include the ability to process text, audio, and images to generate text, audio, and image outputs. Especially noted for its enhanced vision and audio understanding, GPT 4.0 is showcased in a setup with a Python program to interact with stock market data and provide automated technical analysis, a major step forward in simplifying complex financial processes.

The video further explores how a Python-based desktop application utilizes GPT 4.0's vision abilities to automatically analyze stock charts. These charts are compiled alongside technical indicators, with GPT 4.0 delivering rich markdown descriptions and insights that would typically require a trained analyst. This real-time analysis capability is enhanced by integrating OpenAI's services and highlights GPT 4.0's sophistication compared to previous models.

Please remember to turn on the CC button to view the subtitles.

Key Vocabularies and Common Phrases:

1. omni [ˈɑmni] - (noun) - Implying all-encompassing or all-knowing. - Synonyms: (all-inclusive, universal, comprehensive)

A couple of hours ago, OpenAI released a new model called GPT four O. The O stands for omni.

2. vision [ˈvɪʒən] - (noun) - The ability to see, or an instance of seeing, especially in a significant way. - Synonyms: (sight, image perception, visual sense)

GPT 4.0 is especially better at vision and audio understanding compared to existing models.

3. technical analysis [ˈtɛknɪkəl əˈnæləsɪs] - (noun) - A methodology for forecasting the direction of prices through the study of past market data. - Synonyms: (chart analysis, market prediction, stock analysis)

So I'm gonna click screenshot. You'll see it saves a screenshot to my screenshots directory of how the chart looked. And then you see right here, what I'm doing is telling GPT 4.0 to actually do technical analysis on that chart by just looking at it.

4. api [eɪ piː ˈaɪ] - (noun) - Application Programming Interface, a set of tools and protocols for building software and applications. - Synonyms: (web service, interface, software bridge)

...a python program that interacts with the interactive brokers TWS api and is able to pull data on stocks.

5. encode [ɪnˈkoʊd] - (verb) - To convert information into a particular form, usually for security or compression. - Synonyms: (convert, transform, encrypt)

Now the key to using this, if you've used GPT four vision, is you need to actually base 64, encode the image...

6. trajectory [trəˈdʒɛktəri] - (noun) - The path or course taken by a moving object, often used figuratively for trends or developments. - Synonyms: (path, course, route)

It appears to be a multi hour chart. It's been on upward trajectory for most of the session.

7. sophisticated [səˈfɪstɪˌkeɪtɪd] - (adjective) - Having a refined knowledge or complexity in design or function. - Synonyms: (complex, advanced, refined)

It can actually look at this heat map and describe it, this ETF chart from Finviz, and then also another chart I was looking at as well. And so just to show you the. A heat map example. Yeah. You can see how it's able to look at this very sophisticated heat map.

8. real time [ˈriːəl taɪm] - (noun) - The actual time during which a process or event occurs, often with updates as they happen. - Synonyms: (instantaneous, immediate, live)

And you see right there, I have the analysis from GPT four o in real time displays price action for the symbol AMC.

9. sector analysis [ˈsɛktər əˈnæləsɪs] - (noun) - The review and evaluation of individual market sectors within the economy or stock market. - Synonyms: (industry analysis, market analysis, economic evaluation)

So I have like a heat map here. So for sector analysis right here.

10. integrated [ˈɪntəˌɡreɪtɪd] - (adjective) - Combined with other parts to form a whole, especially to promote efficiency or harmonization. - Synonyms: (combined, unified, incorporated)

I know I had to make a program for this, but I expect all of it to be very integrated into your desktop.

Revolutionizing Technical Analysis with GPT 4.0 Unveiling Future Insights

A couple of hours ago, OpenAI released a new model called GPT four O. The O stands for omni. So what this model allows you to do is to input text, audio and images, and generate audio, text and image outputs in return. And so the note here is that GPT 4.0 is especially better at vision and audio understanding compared to existing models. I suggest you watch all the demos here. There's a lot of great capabilities, but I just wanted to make something quickly to see if I even had access to this. And it turns out I do. So what I wanted to do was test out either the audio or vision capabilities. Now, since yesterday I just posted a video on programming my brokerage account and saving a different charge from that. I thought I would test the vision functionality of TPT 4.0.

And so if you didn't watch my video yesterday, it looks like this. So I can run this. And what this does, this is a python program that interacts with the interactive brokers TWS api and is able to pull data on stocks. And so here you see I have a chart for Taiwan semiconductor right here. But this also scans and automatically pulls up the most popular stocks for today. So you can see AMC and GMe are very active. So I click GME and of course roaring kitty came back to twitter and GME just spiked right there. So what does this have to do with GPT 4.0? Well, I thought I would just throw on an AI feature to this little desktop app that I've created. And so one thing I did in the previous video is I added this screenshot functionality.

And so what I can do is when I pull up my charts, so if I click on AMC here, pulls up that chart, if I click on GME, pulls up that chart, and then I can pull up a particular timeframe like the 1 hour. And so this is interacting with my brokerage account. And now what I want to do is take a screenshot. So I'm gonna click screenshot. You'll see it saves a screenshot to my screenshots directory of how the chart looked. And then you see right here, what I'm doing is telling GPT 4.0 to actually do technical analysis on that chart by just looking at it. And so you can see every time I take a screenshot now, it gives me a complete markdown description of that chart.

So let's say I'm just saving charts throughout my day. I automatically get a log of some analysis in text format of that chart. And so I don't even necessarily have to look at it, it just pretend you're saving some type of journal, it's automatic for you. And so I click. So I took screenshot of GME and it says a short term movement shows a significant spike in the price of GME. And it shows it peaked at 3820. And then it talks about the volume that's on that chart. It talks about a support and resistance level and the indicators that I had on the chart. So how does this actually work in Python code?

Well, if you followed my tutorial yesterday, there is a function called take screenshot. So when I click this button, I'm automatically triggering and saving a screenshot to a particular directory. So all I did was add on to this function. So I had a chart file name and I was writing the image right there. So all I need to do is write a little call to GPT four that actually analyzes this chart. And so after I write the image to the file system, I have this little analyze chart function. So I created a new file here that I just call GPT four o technical analyst. Just like with my other OpenAI tutorials, you need to pass in an OpenAI key.

You can set it as an environment variable. When you initialize the OpenAI client, you can give it a default organization. Or in my case, I'm part of many organizations, so I need to pass in an organization id to make sure I'm billing this to the right organization, which is mine. So I have this analyze chart function and all it does is accept the path to an image. And so since I'm saving each screenshot and timestamping it to a screenshots directory right here, I'm just, as soon as I write that file name, I'm passing the path over to analyze chart and to call the OpenAI GPT 4.0 model, you just need to pass in the new model name, assuming you have access to it.

So I have access to GPT 4.0 and I just use the OpenAI client here to create a chat completion. And I can just give it a user role here and just say analyze this chart, include the symbol and discuss the price action. You can make this more and more sophisticated if you want to focus on particular elements. So let's say you want to act as a trend follower or someone that's looking for mean reversion, or you can, you can really specify how you want the analysis to be done. Now the key to using this, if you've used GPT four vision, is you need to actually base 64, encode the image, and so you can see in my chart path here, I have this function called encode image.

And so what you do is import, you import base 64 here and you can base 64 encode that image. And once you do that, you can actually pass this as part of the message. And so instead of a normal like URL you would request on the web, you can pass it this special data URL with a base 64 encoded image. And then you just return back the response. And so it just returns a normal chat completion right there. And then you can see right here in my analyze chart. I'm returning the analysis as a text here and printing it out on the screen. And then I also output all that text to a file, usually just basic Python, open a new text file and I'm just saving it to a markdown file right here.

And so you'll notice if I pull up one more chart here. Let's just do this one more time. I can even probably make it analyze my drawings here. And so yesterday I added this ability to draw a trend line, for instance, on here. And so I can draw a little trend line here and, you know, see how it would interpret this in real time. So I'm gonna do screenshot right there. And you see it's saving a screenshot of AMC exactly as it looked with my trend line right in place. And you see right there, I have the analysis from GPT four o in real time displays price action for the symbol AMC.

It appears to be a multi hour chart. It's been on upward trajectory for most of the session. And then, yeah, you see it proceeds to give some analysis. And let's see if it mentions. Yeah, a strong upward trend initially with a pullback and, yeah, and so it's interpreting the chart just as I've drawn it right there. And let's see if it even mentions. Yeah, it says after reaching 588. And so if you watched yesterday, I calculated the high of the day and had it automatically draw a horizontal line and it just detects that as well. So yeah, that's my first experience with GPT 4.0.

You might say you were able to analyze images with GPT four vision in the past, but one thing I'm noticing is the analysis provided by GPT 4.0 is already much better. So the quality of that analysis I just showed you is far superior to what I had done with GPT four vision in the past. Oh, and I forgot to show that. I've actually been testing this out in other contexts. So I have like a heat map here. So for sector analysis right here. It can actually look at this heat map and describe it, this ETF chart from Finviz, and then also another chart I was looking at as well.

And so just to show you the. A heat map example. Yeah. You can see how it's able to look at this very sophisticated heat map. Not that sophisticated, but there's lots of details and many different symbols on this heat map. It can do it a lot faster than I can as a human. So you can see how I can pinpoint what's going on in energy. Tesla, Amazon, all those things are very small on this chart, and it's able to pick up all the individual percentage moves. And so if I look on technology here, you see Apple up by 2.05%. It read that off the chart Nvidia, so it can actually see what's going on.

So, yeah, I expect a lot of this stuff. I know I had to make a program for this, but I expect all of it to be very integrated into your desktop. They just released a desktop application as well that can see your screen. And so you can imagine where we're headed here, where, you know, the big tech company is going to be watching everything you're doing on your computer and analyzing it in real time.

And so, yeah, so is this all going to be obsolete? Do I need to teach anyone how to program when GPT four can listen to you and answer all of your questions? Yeah, maybe we're all obsolete. Definitely. All the technical analysts are kind of obsolete. We don't need anyone to talk about charts and visualizations necessarily, if this thing gets really, really good over time.

So, yeah, I'm excited about the possibilities, but also it's kind of blows my mind, some of the things that were shown in this demo. So I'll post this code somewhere. Hopefully. This was interesting. I'm going to be having some fun with this, and hopefully we'll share more in the coming weeks and months. All right, take it easy. Bye.

Technology, Innovation, AI, Stock Analysis, Programming, Automation