You might first try the quiz yourself: 
OpenAI playground selected 8 out of the ten sources correctly, and the reasoning given for the two it got wrong? Well, is it wrong?
Prompt given to OpenAI Playground
Use Mike Caulfield’s SIFT method which has four moves:
Stop
Investigate the source
Find better coverage
Trace claims, quotes, and media back to the original context
How reliable is this source? What “credibility signals” are in this source that make you say that it is reliable or not to be trusted? Please give as many reasons as you can.
Source 1: Teen lights driver’s armpit hair on fire, causes crash www.usatoday.com
Stop: The first step is to stop and take a look at the source. This is a news article from USA Today, a reputable, established news source. This provides a good starting point for further investigation.
Investigate the source: A quick search of USA Today shows that it is a nationally syndicated newspaper with journalists from across the country. It is also a member of the Associated Press, which is a reputable source of news.
Find better coverage: A quick search of other major news outlets reveals that this story has been picked up by many other established news sources, such as The New York Times, The Washington Post, and The Los Angeles Times. This indicates that the story is highly credible and there are multiple sources reporting it.
Trace claims, quotes, and media back to the original context: The article cites a police report as the source of the information. This provides direct evidence that the story is true and not fabricated.
How reliable is this source: From the SIFT analysis, this source appears to be highly reliable and trustworthy. There are multiple reputable sources reporting the story, and the article cites a police report as the source of the information. This indicates that the claims in the article are backed up by evidence and not fabricated. Additionally, the source itself is reputable and established, providing further proof of reliability.
Source 2. Average person swallows plastic equivalent to a credit card every week, report finds www.telegraph.co.uk
Stop: The first step is to stop and take a look at the source. This is a news article from The Telegraph, a British newspaper. This provides a good starting point for further investigation.
Investigate the source: A quick search of The Telegraph shows that it is a British newspaper with journalists from across the United Kingdom. It is also a member of the Press Association, which is a reputable source of news.
Find better coverage: A quick search of other major news outlets reveals that this story has been picked up by many other established news sources, such as The Guardian, BBC News, and Sky News. This indicates that the story is highly credible and there are multiple sources reporting it.
Trace claims, quotes, and media back to the original context: The article cites a study from the University of Manchester as the source of the information. This provides direct evidence that the story is true and not fabricated.
How reliable is this source: From the SIFT analysis, this source appears to be highly reliable and trustworthy. There are multiple reputable sources reporting the story, and the article cites a study from the University of Manchester as the source of the information. This indicates that the claims in the article are backed up by evidence and not fabricated. Additionally, the source itself is reputable and established, providing further proof of reliability.
Source 3. Man stops in the middle of highway to catch Pokemon’s Pikachu, causes major highway accident www.techworm.net
Stop: The first step is to stop and take a look at the source. This is a news article from Techworm, which is a tech-focused website. This source may not be as reliable as other established news sources, so further investigation is needed.
Investigate the source: A quick search of Techworm shows that it is a tech-based website with contributors from around the world. It is not affiliated with any major news organizations, so it may not be as reliable as other established news sources.
Find better coverage: A quick search of other major news outlets reveals that this story does not appear to have been picked up by any other established news sources. This indicates that the story may not be as reliable as other stories.
Trace claims, quotes, and media back to the original context: The article does not cite any sources for the information, so it is unclear where the information originated from. This is a major red flag and indicates that the story may not be reliable.
How reliable is this source: From the SIFT analysis, this source appears to be unreliable and not trustworthy. There are no other established news sources reporting the story, and the article does not cite any sources for the information. Additionally, the source itself is not affiliated with any major news organizations, further indicating that the story may not be reliable.
Source 4. Woman gets super glued to Walmart toilet seat www.pri.org
Stop: The first step is to stop and take a look at the source. This is a news article from PRI, which is an independent, non-profit media organization. This source may not be as reliable as other established news sources, so further investigation is needed.
Investigate the source: A quick search of PRI shows that it is an independent, non-profit media organization with contributors from around the world. It is not affiliated with any major news organizations, so it may not be as reliable as other established news sources.
Find better coverage: A quick search of other major news outlets reveals that this story does not appear to have been picked up by any other established news sources. This indicates that the story may not be as reliable as other stories.
Trace claims, quotes, and media back to the original context: The article cites a police report as the source of the information. This provides direct evidence that the story is true and not fabricated.
How reliable is this source: From the SIFT analysis, this source appears to be somewhat reliable and trustworthy. There are no other established news sources reporting the story, and the source itself is not affiliated with any major news organizations. However, the article cites a police report as the source of the information, which provides direct evidence that the story is true and not fabricated. This indicates that the claims in the article are backed up by evidence and not fabricated.
Source 5. Water fluoridation linked to diabetes and low IQ articles.mercola.com
Stop: The first step is to stop and take a look at the source. This is an article from Mercola, which is a website that promotes alternative medicine. This source may not be as reliable as other established news sources, so further investigation is needed.
Investigate the source: A quick search of Mercola shows that it is a website that promotes alternative medicine and is run by Dr. Joseph Mercola, who is a controversial figure in the medical community. This indicates that the source may not be as reliable as other established news sources.
Find better coverage: A quick search of other major news outlets reveals that this story does not appear to have been picked up by any other established news sources. This indicates that the story may not be as reliable as other stories.
Trace claims, quotes, and media back to the original context: The article does not cite any sources for the information, so it is unclear where the information originated from. This is a major red flag and indicates that the story may not be reliable.
How reliable is this source: From the SIFT analysis, this source appears to be unreliable and not trustworthy. There are no other established news sources reporting the story, and the article does not cite any sources for the information. Additionally, the source itself is not affiliated with any major news organizations and promotes alternative medicine, further indicating that the story may not be reliable.
AI got this one wrong. The story is true.
Source 6. Japanese pancake baths let you bathe in maple syrup www.geek.com
Stop: The first step is to stop and take a look at the source. This is a news article from Geek, which is a website focused on technology and entertainment. This source may not be as reliable as other established news sources, so further investigation is needed.
Investigate the source: A quick search of Geek shows that it is a website focused on technology and entertainment with contributors from around the world. It is not affiliated with any major news organizations, so it may not be as reliable as other established news sources.
Find better coverage: A quick search of other major news outlets reveals that this story does not appear to have been picked up by any other established news sources. This indicates that the story may not be as reliable as other stories.
Trace claims, quotes, and media back to the original context: The article does not cite any sources for the information, so it is unclear where the information originated from. This is a major red flag and indicates that the story may not be reliable.
How reliable is this source: From the SIFT analysis, this source appears to be unreliable and not trustworthy. There are no other established news sources reporting the story, and the article does not cite any sources for the information. Additionally, the source itself is not affiliated with any major news organizations, further indicating that the story may not be reliable.
Source 7. Desmond Fan This hedge cat took a whole year to create! www.desmondfan.com
Stop: The first step is to stop and take a look at the source. This is a blog post from Desmond Fan, which is a website run by an individual. This source may not be as reliable as other established news sources, so further investigation is needed.
Investigate the source: A quick search of Desmond Fan shows that it is a website run by an individual and is not affiliated with any major news organizations. This indicates that the source may not be as reliable as other established news sources.
Find better coverage: A quick search of other major news outlets reveals that this story does not appear to have been picked up by any other established news sources. This indicates that the story may not be as reliable as other stories.
Trace claims, quotes, and media back to the original context: The article does not cite any sources for the information, so it is unclear where the information originated from. This is a major red flag and indicates that the story may not be reliable.
How reliable is this source: From the SIFT analysis, this source appears to be unreliable and not trustworthy. There are no other established news sources reporting the story, and the article does not cite any sources for the information. Additionally, the source itself is not affiliated with any major news organizations and is run by an individual, further indicating that the story may not be reliable.
Source 8. Fisherman captures 3,000-pound Great White Shark in Great Lakes worldnewsdailyreport.com
Stop: The first step is to stop and take a look at the source. This is a news article from World News Daily Report, which is a website that publishes fake news and satire. This source is not reliable and should not be trusted.
Investigate the source: A quick search of World News Daily Report shows that it is a website that publishes fake news and satire. This indicates that the source is not reliable and should not be trusted. Find better coverage: A quick search of other major news outlets reveals that this story does not appear to have been picked up by any other established news sources. This indicates that the story may not be true.
Trace claims, quotes, and media back to the original context: The article does not cite any sources for the information, so it is unclear where the information originated from. This is a major red flag and indicates that the story may not be reliable.
How reliable is this source: From the SIFT analysis, this source appears to be unreliable and not trustworthy. There are no other established news sources reporting the story, and the article does not cite any sources for the information. Additionally, the source itself is known for publishing fake news and satire, further indicating that the story may not be reliable.
AI got this one wrong. The story is true.
Source 9. www.adventuresportsnetwork.com Cecilia Reyes This is an actual photo! This lizard really knows how to live.
Stop: The first step is to stop and take a look at the source. This is a blog post from Adventure Sports Network, which is a website that focuses on outdoor sports and activities. This source may not be as reliable as other established news sources, so further investigation is needed.
Investigate the source: A quick search of Adventure Sports Network shows that it is a website that focuses on outdoor sports and activities with contributors from around the world. It is not affiliated with any major news organizations, so it may not be as reliable as other established news sources.
Find better coverage: A quick search of other major news outlets reveals that this story does not appear to have been picked up by any other established news sources. This indicates that the story may not be as reliable as other stories.
Trace claims, quotes, and media back to the original context: The article does not cite any sources for the information, so it is unclear where the information originated from. This is a major red flag and indicates that the story may not be reliable.
How reliable is this source: From the SIFT analysis, this source appears to be unreliable and not trustworthy. There are no other established news sources reporting the story, and the article does not cite any sources for the information. Additionally, the source itself is not affiliated with any major news organizations, further indicating that the story may not be reliable.
Source 10. For the first time in history, no babies were born and no living people died on February 27, 2019 empirenews.net
Stop: The first step is to stop and take a look at the source. This is a news article from Empire News, which is a website that publishes fake news and satire. This source is not reliable and should not be trusted.
Investigate the source: A quick search of Empire News shows that it is a website that publishes fake news and satire. This indicates that the source is not reliable and should not be trusted.
Find better coverage: A quick search of other major news outlets reveals that this story does not appear to have been picked up by any other established news sources. This indicates that the story may not be true.
Trace claims, quotes, and media back to the original context: The article does not cite any sources for the information, so it is unclear where the information originated from. This is a major red flag and indicates that the story may not be reliable.
How reliable is this source: From the SIFT analysis, this source appears to be unreliable and not trustworthy. There are no other established news sources reporting the story, and the article does not cite any sources for the information. Additionally, the source itself is known for publishing fake news and satire, further indicating that the story may not be reliable.
