data integrity – Mitch’s Open Notebook

Tesla's Autopilot: Beta Testing In Public, So Open the Data

<![CDATA[At the end of June, after the first death in an accident involving the Tesla auto-pilot system, the company said in a press release: “This is the first known fatality in just over 130 million miles where Autopilot was activated. Among all vehicles in the US, there is a fatality every 94 million miles.” Sounds safe, sure, but data without context is generally misleading.
The company goes on to position the death as a rarity that confirms the overall safety of the Tesla auto-pilot:

Worldwide, there is a fatality approximately every 60 million miles. It is important to emphasize that the NHTSA action is simply a preliminary evaluation to determine whether the system worked according to expectations.

Tesla doesn’t provide sources for its U.S. driving fatality per miles driven, nor the lower global average of one fatality per 60 million miles. Safety data generated by the auto-pilot testing should be opened for customers to review before buying and using the system.
Consider:
1.39 trillion miles were driven during 2014 in the United States, according to the National Highway Traffic Safety Administration. At that rate, Tesla’s 130-million-miles-without-a-death figure suggests that if everyone drove on Tesla auto-pilot, 10,739.2 people would die annually in the U.S. On the face of it, certainly better than human drivers.
2014 saw a historic low in U.S. driving fatalities, 32,675 deaths, after progressively better results over many years: 10.8 deaths per 100,0000 people, according to the Center For Disease Control’s National Center for Health Statistics. Death rates were headed up almost 10 percent in 2015.
The Tesla auto-pilot seems to perform more safely than average people when measured in terms of fatalities. We don’t know if the system has blind spots that engineers are seeking to plug. We don’t know if it makes more or fewer small, non-fatal mistakes than a driver. If three people had died in the fatal Florida Tesla accident in June, Tesla’s average deaths per miles driven would be just average, only as safe as ordinary simple human drivers.
It’s also important to understand that the 130 million miles of auto-pilot driving Tesla points to is active beta testing with their customers lives in the balance. It’s not like we’re all test pilots in the Chuck Yeager vein, but the fact that the company is sending car owners out with an active auto-pilot system still in the testing stages should concern us.
If the company has broken securities law, which appears may be the case — at least an SEC investigation is said to be underway — its a conservative decision to assume the safety filings may not reflect the full risk the auto-pilot involves. Tesla should take action to increase transparency now.
This is a situation in which all auto-pilot data should be exposed for public inspection, so that customers don’t need to rely on Tesla’s assurances. A corps of data scientists would give consumers a better risk evaluation than a company seeking to lower its liability risk profile. Tesla could make an important contribution to co-development of products with informed customers by opening its beta-stage auto-pilot data to public scrutiny. ]]>

<![CDATA[Whomever you support for president, I hope you'll consider joining me in asking the candidates for a pledge that they will enforce data integrity policies at least as rigorous as expected of publicly traded companies, and that they'll open their administration to public scrutiny of most public policy.
After eight years of an presidency that considers itself immune to the simplest email storage requirements, the United States could use some insight into how decisions are made at the White House. More than 1,000 days worth of email are missing from the Bush years, in some cases entire weeks’ worth of mail relating to the leaking of CIA operative Virgina Plame’s identity and the application of torture have disappeared. With Bush Administration officials continuing to drag their feet on implementation of email archiving systems, we are threatened with another four or eight years of government operating in the shadows, because an incoming president could blame the faulty storage systems they found for future omissions.
Granted, the Clinton administration hasn’t thrown open the doors to its archives, but, at least, they maintained a record of intra-administration communication, even at a time when email was barely mature and archival requirements were uncertain. It’s a standard we should expect of every administration, more so now that there are well-known best practices for records-retention available for public companies, investment banks and government agencies.
“I don’t want you reading my personal stuff,” President Bush has told the press when asked about why his administration has failed to comply with records-retention laws during his time in office. Unfortunately, Mr. President, nothing you do at your desk, or in the airplanes, cars and buildings we give you to use as president, is “your personal stuff.” It is the property of the people. As voters, we must demand greater accountability of the next president.
Just as a company needs to be able to review its internal communications to find out why it made mistakes, the U.S. government should be able to benefit from the experience of previous administrations, as well as the scholarly study of records, so that we constantly improve the handling of day-to-day and crisis situations. Democracy demands that we have the ability to review what our leaders have discussed as they decide on our behalf how money will be spent, what policies will be enforced and why and when we go to war.
So, let’s pull together as Americans and demand more of our political leaders. Join me in urging the candidates to commit to store all email and documents created or used by their staffs during their tenure in the White House. Regardless of the winner in the upcoming election, the infrastructure for the people’s participation in, and review of, executive decisions is ready for a president that will honor the people’s right to know what has been done in their name.
Logon to your candidate’s site to urge them to take the data integrity and transparency pledge:
John McCain. Mike Huckabee. Ron Paul. Barack Obama. Hillary Clinton.]]>