• 2 Posts
  • 262 Comments
Joined 2 years ago
cake
Cake day: December 9th, 2023

help-circle


  • The elephant in the room is 42% “we bought this and it didn’t do shit”.

    It depends on whether the cost of adopting AI was included or not; if it was, then buying AI did not hurt, which could theoretically be cited as justifying additional experimentation with it. If buying AI was not included in the costs, then arguably this box is simply wrong because it did increase costs.

    (But again, given that this is just a survey of CEOs, it’s not like there is anything rigorous about any of this…)



  • They were referring to the original article that The Register is citing: https://www.pwc.com/gx/en/issues/c-suite-insights/ceo-survey.html

    Scroll down to the 3x3 grid, and you will see that the percentages in the green squares (corresponding to benefits) add up to more than the percentages in the red squares (corresponding to drawbacks). You can see from this that The Register cherry-picked the numbers to tell a particular narrative. For the sake of illustration, were one trying to push the opposite narrative, one could just as accurately have said that only 13% of companies experienced worse outcomes as a result of using AI, whereas 87% experienced neutral or better outcomes!

    (Just to be clear, though, I do think that a survey of the prevailing attitudes of CEOs is not a great way of obtaining an objective metric for anything other than the prevailing attitude of CEOs.)











  • The researchers in the academic field of machine learning who came up with LLMs are certainly aware of their limitations and are exploring other possibilities, but unfortunately what happened in industry is that people noticed that one particular approach was good enough to look impressive and then everyone jumped on that bandwagon.