Can confirm; I teach statistics and allow take home exams. I don’t even really need guardrails on the math-- if you cheat via LLM, your answer is almost always hilariously wrong.
Yesterday I literally had to count 14 thousand pounds of fire extinguishers (as in count each extinguisher in a bunch of crates), one of my coworkers came over and said “Why don’t you just use AI to count them.” They then pulled out their phone, took a picture, asked AI to count them, and was off buy almost 60% on the first crate. Then went “oh, well that’s just one example,”
They then tried 4 more times, being between 75% and 50% off each time. They then went “Oh, well, ummm, nevermind.” and wandered off again.
(I had to count the extinguishers to make a Bill of Lading for them for shipping them out, you need an accurate count otherwise it will be held by the shipping company until you provide a correct BoL with the correct count due to legal reasons. I couldn’t just weigh them and divide the total wieght by the weight of a single extinguisher as they were a bunch of different sizes mixed together. NGL it was the easiest money I’ve ever made at the at job.)
Oh it sucked for sure, I kept getting interrupted which meant whatever crate I was counting at the time had to be started over.
But the biggest perk was not having to deal with the other idiots on our loading dock for the entire time I was counting.
Though I’ve joked about it in the past I really should get a shirt that says “I’m trying to focus on my job, please don’t distract me” or something like that.
I know this is a meme, but for the record math is one of the things LLMs are famously worst at
Can confirm; I teach statistics and allow take home exams. I don’t even really need guardrails on the math-- if you cheat via LLM, your answer is almost always hilariously wrong.
I’ve not used gpt for quite a while, but can’t you ask to python script the evaluation?
Yesterday I literally had to count 14 thousand pounds of fire extinguishers (as in count each extinguisher in a bunch of crates), one of my coworkers came over and said “Why don’t you just use AI to count them.” They then pulled out their phone, took a picture, asked AI to count them, and was off buy almost 60% on the first crate. Then went “oh, well that’s just one example,”
They then tried 4 more times, being between 75% and 50% off each time. They then went “Oh, well, ummm, nevermind.” and wandered off again.
(I had to count the extinguishers to make a Bill of Lading for them for shipping them out, you need an accurate count otherwise it will be held by the shipping company until you provide a correct BoL with the correct count due to legal reasons. I couldn’t just weigh them and divide the total wieght by the weight of a single extinguisher as they were a bunch of different sizes mixed together. NGL it was the easiest money I’ve ever made at the at job.)
$10 says they still think AI is great at counting things.
Easy money for you. For me that work would have been torture.
Oh it sucked for sure, I kept getting interrupted which meant whatever crate I was counting at the time had to be started over.
But the biggest perk was not having to deal with the other idiots on our loading dock for the entire time I was counting.
Though I’ve joked about it in the past I really should get a shirt that says “I’m trying to focus on my job, please don’t distract me” or something like that.
Every single damn time someone tries to do this, its the same result. its so annoying.
The moment someone starts a sentence with “why dont you just” JUDO CHOP is usually the best answer.
were before they started just writing a mini-python script for every calculation and executing that.