AquaTech is a government defence contracting firm specialising in manufacturing robotic systems for police and military use. It is known for producing bomb-defusing robots and working on other classified projects. One critical project involved developing a robot capable of sweeping minefields and detecting hidden explosives. The project had a stringent seven-month deadline to produce a working prototype for a demonstration to top defence ministry officials. The project encountered delays due to staff shortages and other unforeseen issues, resulting in a two-week lag. As the deadline loomed, the project leader pressured the team to work extended hours with minimal rest. Despite these challenges, the team managed to complete the prototype on time for the demonstration. During the demonstration, the robot was deployed in an active minefield to detect mines and mark them with a spray. Initially, the robot performed as expected, identifying mines. However, instead of marking the sites, it triggered explosions, causing fatal injuries to the operating engineer. The demonstration was immediately halted, and an inquiry was launched. The investigation revealed that a software flaw caused the malfunction, leading to the tragic accident. The software development team argued that the operator issued mixed commands, which contributed to the malfunction. Overall, each team kept deflecting responsibility, but somebody or a team had to be made accountable for the fatal errors. (a) If you are the ethics officer of AquaTech enquiring, who will you hold responsible for the fatality? Why? (b) Discuss some common ethical issues that arise while using artificial intelligence.
Divyank Gupta, AIR 21, 2024
(a) As an ethics officer
1. I will mainly hold the leader of the project as responsible since - a. he only focused on the deadline b. forgot the potential threat of backfiring in defence project c. put the safety of his employees at risk d. didn't ask for timeline extension like DRDO asks government 2. But others are also responsible since a. Aquatech board of governors didn't understand the sensitivity b. the project members didn't show courage of conviction to stop the project lead c. Government didn't understand the realities of timeline and went ahead with experiment
(b) Common ethical issues with AI
1. Threat of being used in defence purpose 2. Inequality among nation - eg Africa doesn't have resources 3. Racial biases against ethnic minorities 4. Mainly driven by west based agenda 5. Doesn't have good ethical system to check 6. There are threats of cyber hacking and frauds 7. Deepfakes being misused by people and government 8. People's employability at risk since AI could replace 30-40% of workforce 9. People's livelihood at threat 10. Fast pace of development doesn't provide opportunity to check the deep pace 11. Threat of its misuse in old people who don't know how to use it
Through this the world can harness the goodness of AI and achieve Aristotle's Summum Bonum.