Evaluating Online Sources
As any student who's ever started a paper the night before it's due will tell you, good research takes time. If you are writing an academic paper, you should look for peer-reviewed academic sources, not corporate press releases or articles from online magazines or newspapers.
Start With Good Academic Sources
A reference librarian is specially trained to help patrons find the best sources. An Internet search engine, on the other hand, will show you plenty of sources that will waste your time.
An Internet Search Engine Will Show You...
- newspaper or magazine articles (written by professional writers who are not experts in the subject matter, such as brain surgery or international politics),
- commercial or activist web pages (written by people who are trying to sell you a thing or an idea, and have no interest in giving you a balaced and accurate overview of a complex issue),
- instructional web pages (such as this one) or student projects (neither of which have been approved by the peer review process)
- spoof web pages that are posted by pranksters; or creative works that imitate scholarly websites .
Don't Trust Everything You Read Online!
See the creative hoax "History of a Victorian Era Robot," which looks more professional than my own page on "Rossum's Universal Robots." My page states (correctly) that the word "robot" didn't even exist until decades after the Victorian era ended.
See also this article on prankster Joey Skaggs, an artist who makes a career out of tricking gullible journalists.
A Free Search Engine Won't Emphasize...
- meticulously-researched articles,
- written by full-time researchers (who spend several months on each article, while a journalist may have to write several different stories each day),
- screened by an academic journal's panel of experts, and
- published as a service to the academic community.
- Having said that, scholar.google.com is a specialty page that gives prominence to resources that look like academic articles. (The site is not perfect -- some projects that students wrote for my undergraduate classes get high prominence in scholar.google.com, but that doesn't mean they are credible academic sources.)
Finding Academic Articles
The best place to start is by talking to the human being working the reference desk at your local library. If it's currently two AM and your paper is due tomorrow, you may still be able to find some sources online, but you have to start in a library database, not in Google or Yahoo!.
See:
- Finding Academic Articles with EbscoHost (one of many library databases)
- Difference Between Academic Articles and Magazines
Beginning Your Research
Find a recent academic article that seems at least somewhat related to your topic. For example, if you want to write about pioneer women of Wisconsin, you might find a review of a recent scholarly book on the pioneer tradition of America
- Plunder the "Works Cited" page. Even if the article itself is of little use to you, it may point you towards books or other articles that will be more valuable. (If there is no list of works cited, then you aren't reading an academic source.)
- Scan books on related topics. You will probably not find a whole book that examines the specific set of questions I am asking here. You may have to look at chapter or sections of different books, and piece together your own argument.
- Walk to that section of the library that has books on your topic, and look on the shelf for similar books. books. Open each book up and scan the table of contents at first; if you're looking for something in particular, scan the index. If a book looks promising, set it aside; otherwise, put it back and keep looking
Using Your Materials
Avoid summary. If you don't have a clear thesis, you will be tempted to fill up lines, either by making random observations or by quoting long passages from your source texts.
Are you falling into a pattern of spending a paragraph on each outside source, and then starting a new paragraph to introduce a new source? If so, you are probably summarizing other arguments, instead of developing your own. Refer only to those components of the outside author's text that help you to construct your own argument.
Documenting Evidence
Back up your claims by quoting reputable sources. If you write, "Recent research shows that..." or "Many authors believe that...", you are making a claim. You will have to back it up with authoritative evidence. This means that the body of your paper must include references to the specific page numbers where you got your outside information. (If your document doesn't have page numbers, you can give a section title or you can count the number of paragraphs.)
Avoid using words like "always" or "never," since all it takes is a single example to the contrary to disprove your claim. Likewise, be careful with words of causation and proof.
For example, consider the claim that "television causes violence in kids."
- The evidence might be that kids who commit crimes typically watch more television than kids who don't.
- But maybe the reason kids watch more television is that they've dropped out of school, and are unsupervised at home.
- An unsupervised kid who doesn't watch much television might still commit more crimes than a supervised kid who doesn't watch much television.
- If you really do have evidence like that described above, then claiming that television causes crime confuses association with causation.
To Cite... or not to Cite?
You do not need to cite common facts or observations such as "a circle has 360 degrees" or "8-tracks and vinyl records are out of date," but you would need to cite specific claims such as "circles have religious and philosophical significance in many cultures" or "the sales of 8-track tapes never approached those of vinyl records."
Anything that takes time is valuable. And things that are valuable generally cost money; that's why you won't usually find the best articles through free search engines. Does this mean you will have to pay to find good sources? Not directly... your university or public library probably subscribes to dozens or hundreds of databases, all of which are free to their patrons. And a growing number of journals publish their full contents online, in order to reach a wider audience. But a site like www.findarticles.com will emphasize the sites that want to sell their content to you.
Nearly any library database will include some way for you to limit your searches to "peer-reviewed", "scholarly" or "juried" sources. But some periodicals include editorials, letters to the editor, and opinion columns; further, some periodicals that identify themselves as peer-reviewed are not necessarily scholarly.
For instance, a search for "Scholarly (Peer Reviewed" Journals" in the "Academic Search Elite" regularly turns up articles from a periodical titled, The Humanist: A Magazine of Critical Inquiry and Social Concern. The word "magazine" in the title should be enough to make a researcher suspicious. Further, the authors of these articles write like magazine authors -- they don't fully cite their sources (giving the page number where they got each fact; instead the author will call up an expert on the phone and print what he or she says), and magazine articles don't include a scholarly reference list.
The authors of aritcles in The Humanst do not appear to be scholars, but rather political activists. There is of course nothing wrong with referring to a political opinion in an academic paper, but on the website for The Humanist you will find the following statements: "The Humanist is a non-profit magazine of opinion. The Humanist has a distinctive slant and therefore does not publish all viewpoints" ("Submission Guidelines for The Humanist"). Student researchers who do not distinguish between opinion and fact in their sources will probably have a hard time separating them in their own writing, so I do not recommend The Humanist as a source for freshman research papers.
Note: It's perfectly permissible for an academic paper to cite non-scholarly sources. For instance, if you wanted to argue that Britney Spears is a commercial product designed to appeal to the anxieties of preteen girls, you would probably be expected to quote song lyrics, analyze a brief transcript from a chat room, and refer to a news report that described a recent Spears concert. But such a paper wouldn't be a researched academic essay, unless it was also grounded in recent research on such subjects as mass marketing, child psychology, popular culture, and gender studies.
This checklist will help you determine whether a source you find online is scholarly. This checklist won't cover every possible situation, but it will offer some clear criteria that you can use to judge your sources for yourself.
Did you find the source by instructing a library
database to display only results from "peer reviewed"
publications?
|
You may very well find scholarly sources through
an ordinary web search engine (such as Google or Yahoo!), but your
chances are much better if you use one of the databases provided
by a library.
|
|||||||||||
Does the article conclude with a bibliography?
|
If your source documents its claims, it is probably
a scholarly document.
Note: Even if a source does document its claims, it may not be a credible, peer-reviewed article. If you found your source through a web search engine, there's a good chance that you found a student paper. Telltale signs of a student paper:
|
|||||||||||
Does the source specify the author, publisher, and date? | A peer-reviewed academic source will always include
this information. If you can't find all three, then you
aren't looking at a good academic source.
|
|||||||||||
Does the author support his or her argument by citing academic articles? |
|
The author of an academic article will almost always
position his or her document against recent related academic
publications. After the initial thesis paragraph,
look for a short section that refers to a large number
of scholarly sources.
If your source claims that "recent studies have shown" or "some people say" something, but the article does not actually specify any such studies or quote people who have actually published such claims, it is not a reliable academic source. |
||||||||||
Does the source have a long, dry title? |
|
Academic Research on Current Events
Finding academic articles devoted to emerging issues or cutting-edge technology may be difficult. While you may find dozens of newspaper reports and a good handful of magazine articles, you may not be able to find a peer-reviewed academic article devoted to your topic.
Find academic articles on related or historical topics, and fill in the gaps by citing the non-scholarly sources.
You might find it hard to locate academic sources that examine current events, or the latest developments in computer technology or Internet culture. If so, you can quote from older studies of related topics, and connect the dots. Point out where the conclusions of those earlier researchers did or did not predict the issues that emerge when you examine the new technology.
The the Internet will probably serve up dozens or hundreds of news reports, magazine articles, and corporate public relations materials surrounding a current event or an emerging technology. But everything that happens in the world is the result of a complex network of causes and effects. We can learn quite a bit about the current war in Afghanistan by examining scholarly analyses of the years that the Soviet Union spent fighting (and ultimately losing) under very similar conditions. While you might never find a whole article devoted to the specific issue you wish to cover, you can still find peer-reviewed academic sources that will give you a solid historical, cultural, scientific, or global background. Where else in the world, and when else in history, has a similar thing happened? How is the situation you wish to examine different from those other instances?
Sidebar |
Current Event: 9/11 Terrorist Attacks. Just a few weeks after the Sept. 11, 2001 attacks on the World Trade Center, opinion pieces and current events analyses began showing up in the peer-reviewed periodicals indexed by the "Academic Search Elite" database. These may be very useful and informative, but at the time they first started turning up, in late 2001, they weren't academic articles. Since many academic journals only come out two or three times per year, and many of those authors will have spent a year or more taking their articles from conception to publication, it will be some time before student researchers will be able to find many good, full-length academic articles on issues surrounding any recent event. Nevertheless, even before the first academic studies of the WTC
attacks began appearing, the database already listed
a review of a recent book about the World Trade Center
(Technology & Culture, January 2001); a critique
of the architectural style of the designer of the WTC
(Amerasia Journal 2000/2001); and an article
called "Mental Health Response to the [1993] World
Trade Center Bombing" (Journal of Mental Health
Counseling, July 1995). These are all
credible sources that could be used, in connection with
recent news coverage, to examine a current event. |
Emerging Technology: Teens and Text Messaging. |
If you wanted to write a paper on how youth culture has been affected by text messaging over mobile phones, you could look up studies of teens and telephones, teens and computers, and teens and writing. You could then refer to news articles, magazine articles, newsgroup postings, or e-mails and text messages from your friends in order to illustrate the specific ways in which your take on teens and text messaging covers ground that has not already been covered before in academic sources. |