Can we trust AI with car repair diagnosis and advice?
New analysis from FixMyCar finds ChatGPT can be useful for diagnosing possible car problems.
But mechanic warns drivers that it’s advice should not be used to assist with at-home repairs.
Around 1 in 6 drivers have used AI tools to get information about car problems in the last 12 months.
A new analysis from FixMyCar has assessed how useful ChatGPT is as a tool for drivers looking to understand what is wrong with their car and how to fix it.
Recruiting the help of a London-based mechanic, Inderjit Matharu from Mobile Mechanics and Tyres in London, the company analysed ChatGPT responses to common car problem prompts and its repair advice.
The prompts included:
1. My car is having trouble changing gears, there is a grinding sound. What could the diagnosis be?
2. My car is making a knocking sound when driving. What could the diagnosis be?
3. My car has a smell of burning rubber when driving. What could the diagnosis be?
Inderjit Matharu, mechanic at Mobile Mechanics and Tyres, had this to say: “Overall, the responses are broadly accurate and cover common and realistic causes for the symptoms described. It follows a logical diagnostic flow that a professional technician would recognise. Most importantly though, nothing listed by ChatGPT is inherently inaccurate or dangerous. However, it is worth noting that some steps (such as checking transmission fluid, clutch evaluation, or internal transmission issues) require proper tools, access, and experience to diagnose correctly.”
When asked what drivers should be cautious of regarding ChatGPT’s responses Matharu says:
“ChatGPT is suitable for understanding possible causes, but not for assisting self-repair. It correctly implies that further professional inspection may be required and drivers should be aware that a clutch system inspection, transmission fluid checks, linkage adjustments and any internal gearbox or synchroniser work should not be attempted by an untrained person. These tasks should be carried out by a qualified mechanic to avoid damage or safety risks.”
Finally, FixMyCar asked whether, in his professional opinion, drivers could trust ChatGPT on this subject, Matharu says:
“Yes, to a point. ChatGPT provides a reasonable overview that could help drivers better understand possible issues, but it does not replace professional diagnosis. Drivers should treat this information as general guidance only. Professional inspection and confirmation by a qualified technician is always recommended.”
In a recent survey of over 2,500 drivers visiting FixMyCar’s site, around 1 in 6 (16%) drivers confirmed they’ve used AI, like ChatGPT, to get information about car problems or repairs in the last 12 months.
A further poll of over 950 drivers found that 1 in 5 (20%) believe they can fully trust information or advice given by ChatGPT on car repairs or maintenance. A third (33%) are unsure whether they trust or distrust ChatGPT for this purpose and only 12% said they fully distrust ChatGPT for this advice.
Matt Wrankmore, Head of Garage Networks at FixMyCar, said this of the analysis:
"It’s not surprising, given the rising popularity of AI tools, that drivers are turning to ChatGPT for advice about their cars. Our analysis shows that ChatGPT can be trusted to provide guidance on car problems and to fairly accurately suggest the repair steps required. But just as you should trust a doctor’s expert opinion over what you find on Google, I advise drivers to trust a professional mechanic’s diagnosis before taking action based on ChatGPT’s advice.”
“Road and vehicle safety is of the upmost importance and will always be the priority for trained mechanics who will use both experience and training to assess and repair your car with a critical eye."