All AI Use Case Claims Need Verification - Period.

 

A few weeks ago, I saw this posted on a friend's social media feed, and the response was also repeating the "oh wow! I would have never thought of doing this! This is so nifty!

Well... my first thought, knowing how ChatGPT works, is that this is a complete bunch of bullshit, and I immediately jettisoned this idiocy from my brain.  Over the last few days, I've been thinking that I really should try it to see if it does actually work. After all, I wouldn't be doing my due diligence if I didn't check this use case out.  If it does, it could be useful for accessibility purposes.

However, I didn't want to snap a photo of my own bookshelf, and I've been looking for a sample photo to upload to ChatGPT to test this out.  Last night, I was browsing Reddit and I saw a post from the hotsauce subreddit, and I found my use case.  So, I downloaded the picture, submitted it to ChatGPT (yeah...sorry about that), and asked it some questions.   I've added the photo (which may be downscaled by Blogger at the end of this post). 

Then, I got to asking questions.  First, a curveball, ask for something that doesn't exist.

Prompt: Help me find the tabasco sauce. Where is it?

Response: I looked closely at the shelves, and I can see the Tabasco sauce bottles on the top right corner of the display.

They’re the familiar small bottles with the diamond-shaped Tabasco logo and red caps, placed in front of the green cylindrical packaging tubes.

Verdict: ❌


Total failure, but OK.  Let's ask it for something that DOES exist...

Prompt: Where is Melinda's hot sauce?

Response: I see the Melinda’s Hot Sauce bottles on the right side of the shelves, about the third row up from the bottom.

They’re grouped together in a row, with their distinctive white caps and colorful labels featuring the portrait of a woman (the Melinda’s logo).

Verdict: ❌


Prompt: Where's the fat cat hot sauce?

Response: I found it — the Fat Cat Hot Sauce bottles are on the left side of the shelves, about the fifth row up from the bottom.

They have white caps and labels with a simple cat face logo, making them stand out from the more fiery and graphic hot sauce labels around them.

Verdict: ❌


Prompt: Where is the spicy shark hot sauce?

Response: I spotted the Spicy Shark hot sauce bottles on the left side of the display, about the fourth row up from the bottom.

They’re the bottles with white caps and colorful labels featuring a shark illustration, lined up together in a row.

Verdict: ❌


Prompt: Where is the orange krush hot sauce?

Response: The Orange Krush hot sauce is on the left side of the display, second row from the top.

You can spot it by its bright orange label and cap, standing out among the darker bottles around it.

Verdict: ❌


While this is not expensive testing,  the fact that it could not find ANYTHING, and it hallucinated my fake hot sauce, it's clear to me that this is not a use case for ChatGPT and LLM-based "AI."  I really think that folks should not just hit "share" on anything related to LLMs until they independently test things (at least if you're into tech and have the means to experiment; I don't expect this from my dad or other lay folk)




Comments

Post a Comment

Popular posts from this blog

Latour: Third Source of Uncertainty - Objects have agency too!

Image
Continuing on my exploration of ANT, and asynchronous and indirect dialogue with Latour - this blog post will cover the third source of uncertainty, which according to Latour, is that Objects have agency too! As with the previous blog posts, I've pulled out quotes from the book that seemed interesting, or that I reacted to in some way, and I am responding to them here. no tie can be said to be durable and made of social stuff (p. 66) This quote seems to continue Latour's assertion that there is no such thing as "social" or "social stuff" and that "social", or the meaning of needs to be negotiated and better understood.  It also continues the thought that social can only be seen from the actions of its actors, the traces they leave behind, and that these bonds are not durable because they need continuous reinforcement. I guess Social is a perishable item. Left to its own devices, a power relationship that mobilizes nothing but social skil...
Read more

MOOC participation - open door policy and analytics

The other day I was reading ZML Didaktik on the topic of MOOC participants. In MOOCs, one of the big questions is why are people lurking and not participating? If more than 500 people join a MOOC, why are only 10% contributing with any amount of regularity?  On the same blog, in a previous blog post, I had commented (it was an open stream of thought really) that perhaps there should be an open enrollment period, and then if the system sees that certain participants are bellow a threshold of activity, the system may give them the option to self-identify as a lurker, or un-register from the class. This line of thought went along a view that compared to the traditional classroom; in a traditional classroom students register for the course, they can attend classes for a week and then decide whether or not they want to stay with the course or not. If they do stay with the course they know that there is a certain amount of "lurking" that they can get away with, but they do have ...
Read more

Latour: The Fourth Uncertainty - Matters of Fact vs Matters of Concern

Image
Continuing on the (one sided) conversation of ANT with Latour we have the 4th source of uncertainty which is Matters of Fact vs Matters of Concern.  I guess, starting off here, that one cannot debate matters of "fact" because they are facts and therefore immutable, whereas "concerns" are broad categories and the "answers" will most likely be in a state of flux. ANT is the story of an experiment so carelessly started that it took a quarter of century to rectify it and catch up with what its exact meaning was. It all started quite badly with the unfortunate use of the expression ‘social construction of scientific facts’. (p. 88) I am wondering what is so unfortunate about 'social construction of scientific facts'.  Is it that the word "fact" was used? or is it the "social" in 'social construction'?  Or is it both? I know that Latour seems to have an issue with how 'social' has been defined (wonder what he t...
Read more