Pros and cons of synthetic data
Artificial intelligence (AI) depends on massive amounts of data being available. As many countries have tightened privacy protection measures, therefore, synthetic data that does not violate personal privacy regulations has emerged. It is estimated that its cost is only 1% of that from real data, which is attractive to enterprises.
Real data may not reflect the truth due to different apportioning arising from races and nationality specifics, while synthetic data can reduce bias. Besides, synthetic version provides more diverse data including rare cases, making up for the difficulty of obtaining such information from real situations.
This kind of data can be in the form of text, media (video, image, sound) and tabular synthetic data. According to the content of real data, it can be roughly divided into three categories: fully synthetic, partially and hybrid.
Today, it is used in a variety of industries, ranging from banking, medicine to self-driving cars.
The American Express is reported to have begun testing with deepfake videos and fake data for two years, such as credit card transactions, in order to improve the ability of AI algorithms to detect fraudulent behaviors. JPMorgan Chase also used synthetic data to detect anti-money laundering, as well as to develop innovative products and services when historical data may not meet the needs.
In the medical field, Roche, the Swiss pharmaceutical company in partner with a startup, uses synthetic data instead of patient’s in clinical research to improve analytical ability. While in Germany, the Charité Lab for Artificial Intelligence in Medicine (CLAIM) which has been involving in stroke research, pointed out that each patient's brain structure is unique, and the anonymising images are of little significance. Therefore, they generated synthetic data while preserving its statistical and predictive properties.
For the past two years, the self-driving company Waymo, owned by Alphabet, has been using synthetic data to generate lifelike driving datasets, including complex and diverse scenarios, such as involving cyclists, or adjusting the speed of approaching vehicles to test Waymo’s reaction.
Synthetic data is better suited for straightforward problems, like fraud detection or credit scoring, according to industry insiders. However, it cannot cope with complex and changeable situations. The Economist gave an example. In the past, purchase of one-way air ticket would be regarded as an obvious predictor of fraud by the automatic detection model, but under the COVID-19 epidemic, many customers are forced to do so. Another example is face recognition, which is difficult to function when wearing a mask becomes the norm.
Further, synthetic data may not be adequate to serve the purpose when accurate and real data is needed for detailed planning. In the U.S., the American community survey (ACS) is distributed to 1% of the population once a year to study the relationship between education, health, income, demographics and geography. The authority is criticised for attempting to replace real data with synthetic one, while it may be good for creating large-scale estimates, poor and small communities with limited resources would suffer.
Synthetic data is an emerging industry, it depends on different industries and startups to jointly explore its potential.
-- Contact us at [email protected]
-
Is certainty a sin？ Brian YS Wong
A few weeks back, I watched one of the most widely anticipated releases of 2024 – Conclave, a riveting political thriller directed by Edward Berger. Without giving too much away, I would settle for
-
Why Carpe Diem Brian YS Wong
“Carpe Diem” – we are told. To seize the day, is a moral prerogative. We must expend each and every hour, minute, and second with due care and caution, paying conscientious heed to the fact that our
-
British doctor’s autobiography describes remarkable life in HK Mark O'Neill
Dr John Mackay arrived in Hong Kong in 1963 and has lived here ever since. For 30 years. he was one of the city’s most respected physicians in one of the largest medical practices and then chose a
-
To build Hong Kong into an AI training base Dr. Winnie Tang
Since 2022, the Government has introduced a number of measures to compete for talents, and this year's Policy Address has made more persistent efforts to nurture local and lure I&T talent from all
-
Correlation between emotional health and academic performance Dr. Winnie Tang
What can we learn from the latest research which shows a positive relationship between mental health and academic achievement? In view of the sharp increase in student suicide cases in recent years,
