This is also a super interesting take on AI
https://habla.news/u/[email protected]/1755292995242
Tl;dr AI, or more specifically LLMs, are really just another form of capital, and like all capital only leverages human potential.
Anyway, well worth a read (especially if you have an Austrian bent)
This is a banger of an article. And well worth a read if you're someone like me that gets easily carried away with new technology:
Microsoft has released a fascinating insight into the progress of AI in medical diagnosis, which you can access here.
What's the tldr?
Using what they call a diagnostic orchestrator (MAI-DxO), an AI-only diagnosis could be made with more than four times the accuracy of experienced clinicians (5-20 years experience) and at a lower cost (fewer tests).
How did they test this?
Sequential diagnosis. They took real life complex cases and gave the orchestrator an initial presentation, from which it then drilled down on aspects of patient history and would then request tests. As it receives incrementally more information it can include or exclude differentials to come to an eventual diagnosis.
To an extent this method of testing is incorporated in the real world by what medical students in many countries would know as the ubiquitous OSCEs.
Is this new?
I think the magnitude of the outperformance is. I saw an earlier study, in which AI-only was tested against clinicians-only and also clinicians who had access to LLMs (I can't remember which but probably ChatGPT). While the latter outperformed humans only (as expected), AI-only outperformed both (not expected), but not to this extent. They found clinicians with AI tended to use it as a browser, rather than a direct aid. The Microsoft article includes a short video, where you can see the orchestrator change tack from its initial line of reasoning, after receiving a particular scan. This lack of anchoring bias is something that many think gives AI an inherent advantage over humans. Of course, instant access to encyclopedic data doesn't hurt either.
You said lower cost?
Yeah, in the video you can see that a cost is applied to each test and so an overall cost of diagnosis is estimated. On average it was better at identifying unnecessary tests. Given the cost of healthcare around the world, particularly the US, that may be as consequential as the accuracy of diagnosis.
The orchestrator can be configured to optimise testing for a particular cost ceiling. However, the higher the ceiling the more accurate it is. I'm going to guess that optimising testing for factors other than just accuracy is something the AI might not excel at. For instance, does it account for testing invasiveness, patient outlook etc.?
Time to hang up the stethoscope?
Microsoft doesn't think so. They see it as complementary. They may be right but I'm a bit more fatalist in the long term. If I was a school leaver today I'd be going to TAFE.
This is an investing platform, what's the relevance?
Other than AI being an - THE - investing megatrend, Microsoft is obviously listed. Of course, Microsoft doesn't have its own LLM and this orchestrator piggy backs on others, like ChatGPT, Claude, Grok etc. Of those you can invest in I'd pick Meta as the best placed to win, but I'd pick OpenAI ahead of all if I could. But I can't.
What about these tokens of OpenAI and SpaceX that Robinhood has been spruiking?
Smooth segway. So in theory these things give you blockchain-based ownership of Special Purpose Vehicles that do own some of these companies. But there's a few issues. You don't actually own the SPV, Robinhood does. If they go belly up, so does your dough. Also the tokens only in theory trade in direct correlation to the last funding round valuation. In practice they can go all over the joint. If those two weren't hard red flags then the fact they're currently only available to EU residents is.
So not really an option.
If you've been anything like me and spending way too much time trying to understand where AI is going and the potential investment implications, you might find this (AI 2027) predictive future interesting. I'm not sure how much it helps from an investing perspective and being a forecast that tries to be as granular as possible, it's about as reliable as one of my DCFs. However, the authors do have some cred and I've read plenty from Daniel Kokotajlo and Scott Alexander in the past.
The pace of change over the next 5-10 years is the real standout for me and is consistent with what I've been reading i.e. once AI reaching a point that it's researching and developing more AI, the pace of change will grow exponentially. It might sound hyperbolic but more I read about this stuff the more I believe the next 20 years is going to be the most extraordinary period of change in all of history.
Here's a bio of the authors of the piece:
