School of Information Resources and Library Science

University of Arizona

LIS 506: Research Methods I

Summer, 1997: Seavey

 

Email: seavey@u.arizona.edu

520-621-3957 (office)

520-621-3279 (fax)

 

 

COURSE INFORMATION

 

"We must discover the laws on which our profession rests, and not invent them."

Anonymous, n.d.

 

"Research is fundamentally a state of mind involving continual reexamination of the doctrines and axioms upon which current thought and action are based. It is, therefore, critical of existing practices."

Theobald Smith, 1929

 

The maddening thing about research was that most answers just meant more questions....

"Corian Trevanni"
Wintermind
Marvin Kaye and Parke Godwin, 1982

 

 

Here is the link to the spreadsheet tutorial

Here is the link to the Chi Square/Spreadsheet tutorial.

Here is the link to the answers for the first stats quiz.

Here is the link to the second stats quiz.

Here is the link to the guest lectures for Wednesday, August 6th

Here is the link to the stats1 grades.

Here is the link to the stats2 answers

Here is the link to the stats2 grades.

Here is the link to the final grades and some commentary.

Course Information

Intro- Web version:

This is the web version of the syllabus for LIS506, second summer session, 1997. This contains the entire version that will be available in paper from the book store. It does not contain the readings, nor some additional unpublished material which will be in the readings package. It should give you an idea of what is going to happen in class.

 

Here is a link to the Prof's home page so you can get some ideas about the guy in front of the class.

 

Here's a link to an archived copy of the syllabus for the last time I taught this course, which was as a WWW (virtual) course in the Fall of 1996. Use the archive copy as an information source for clues as to what might happen.

What is Research??

Please note that research, as taught in this class, does not mean finding things in a library. Research is a process of theory building and hypothesis testing, the sifting and winnowing of ideas that leads to new knowledge, and new interpretations of old knowledge. In the end it is a search for truth.

 

The course will consist of lectures and discussion of common readings. Heavy emphasis will be placed on the student's ability to analyze and critique published research in the field. Participation in class discussion sessions is essential.

 

STATISTICS EXERCISES: Students will solve two sets of statistical problems, outside of class. One set will involve the use of calculators, the other a spreadsheet program. In general I can read almost any version of Excel or QuattroPro. Work done on Microsoft Works for reasons that are totally mysterious to me, are difficult to translate. There is a plethora of computer labs on campus in addition to the machines in the School. Guidelines attached.

 

ARTICLE EVALUATIONS: Four research articles in our field are included in the readings package. Students will evaluate three (3) of these articles as works of research. Guidelines are attached. The articles to be used for this exercise are:

 

Buttlar, Lois, and William Caynon "Recruitment of Librarians Into the Profession: The Minority Perspective" Library and Information Science Research volume 14, (1992) pages 259-280.

Williams, Robert V. "Public Library Development in the United States, 1850-1870: An Empirical Analysis" Journal of Library History 21/1 (Winter, 1986) pages 177-201.

"Bibliographic Instruction and the Online Catalog: An Experiment" manuscript of a submitted article, no author, no date.

Wiegand, Wayne A. "Oregon's Public Libraries during the First World War" Oregon Historical Quarterly 90/1 (Spring, 1989) pages 39-63. (46-53 are all illustrations and are not in the readings package.)

 

JOURNAL EVALUATION: Each student will evaluate the eight most recent issues of a research journal in our field. Basic Guidelines are the same as above. It is important that the student think of these articles as evidence in a research paper you are writing. How do you describe them? Are they reliable, valid, relevant?

The evaluations are due in this order: journal, articles. There is a progression in the level of analysis required. As you go through the course you are acquiring more and more tools with which to evaluate research. By the time you write the journal review, you will have had a heavy dose of research theory, and some statistics. You can apply those tools to the journal at which you are looking. By the time the articles come along you will have either read in the text, or heard from me, everything you need to evaluate in detail the strengths and/or weaknesses of the articles in question. I don't exactly drop clues along the way about the articles, but there you have already seen material that is relevant to the article evaluations.

 

The main thing to remember here: the journal and the articles are evidence evidence evidence evidence evidence evidence. I am not interested in the stories they collectively tell- I am interested in how you dissect each item as evidence. Think of the things you are reading as your unit of analysis- you are a researcher asking questions, the journals and articles are the evidence you have collected. What can you tell me about each? Look at the evidence- how do you describe it? What questions does it answer? The research evaluation guide below provides at least one possible framework for an approach. With 8 issues of a journal, I don't expect a detailed analysis of each article... how do you characterize those 8 issues without writing a young Russian novel? After we do a little bit on descriptive statistics this may become a little more clear. Not because I expect you to use descriptive statistics, although you would be hard put to describe the beast without using some numbers, but because of the ideas involved...

 

EVALUATION

Students will be evaulated on the following:

Class Participation: 10%
Journal Reviews: 35%

Article Evaluations: 35%
Statistics Assignments: 20% taken together

All material will be graded on a numerical basis. The following standards apply in assigning final grades:

A= 92
B= 83-92
C= 73-82
D= 63-72
E= <63

Numerical scores are not rounded up when computing grades.

 

A word on grading. This is graduate school. Simply doing the work on time in a reasonable fashion earns a grade of "B." The grade of "A" is reserved for work that shows evidence of going beyond the mere requirements of completing the assignment. Heavy emphasis will be placed on the student's ability to analyze and critique published research in the field- in other words, critical thinking is a must. Participation in class discussion sessions, be it on the list, or in whatever interactive method we settle on, is essential.

 

Text and Readings

The text for this course is:

 

Sprinthall, Richard. Basic Statistical Analysis 5th ed. Allyn & Bacon, 1997.

 

You can probably use the 4th edition should you find one, although there are a number of typos in that version. In truth the third edition will probably work as well....

 

There is a required readings package containing both published articles, and unpublished supplemental information of use to the student. Both are available at the bookstore.

 

Tentative Schedule of Events and Readings

I use the word "tentative" in its true sense. The following schedule is fairly firm for probably the first week- after that it is anyone's guess as to how this class will go. Think of this as a melody line upon which we will improvise, sometimes at great length

Schedule of Topics

Week 1, Monday, July 14- Friday July 18.

 

Introduction to the class, research, the history of inquiry, etc
Research in L&IS: Background and the Present
Paradigms and Hegemony

 

Hoover, Kenneth R. "Thinking Scientifically" chapter 1 of his The Elements of Social Scientific Thinking. St Martin's Press, 1980.

Shera, Jesse "Darwin, Bacon, and Research in Librarianship" Library Trends 13:141-149 (1964). pp. 141-141.

Lynch, Mary Jo "Research and Librarianship: An Uneasy Connection" Library Trends 32/4(1984) pp 367-383.

Johnson, Richard D. "Current Trends in Library Journal Editing" Library Trends 36 (Spring, 1988) 659-672

Harris, Michael H. "State, Class, and Cultural Reproduction: Toward a Theory of Library Service in the United States" Advances in Librarianship vol 14. Academic Press, 1986, pp 211-252.

Bergen, Dan. "Editorial" Library and Information Science Research 9:71-75 (1987).

Budd, John M. "An Epistemological Foundation for Library and Information Science" Library Quarterly 65/3, July, 1995, pp. 295-318.

 

Week 2, Monday, July 21- Friday, July 25.

Theories and Hypotheses; Evidence and Variables

Research Design

Intro to Statistics

Descriptive Statistics I

 

 

Campbell, Donald T. and Julian C. Stanley Experimen-tal and Quasi Experimental Designs for Research Houghton Mifflin Co., 1963, or chapter 5 of N.L. Gage (ed.) Handbook of Research on Teaching Rand McNally, 1963. The version included here is from the Houghton Mifflin edition, pages 1-24.

Mark H. Maier "Demography" chapter 2 of his The Data Game: Controversy in Social Science Statistics M.E. Sharpe, 1991, pages 9-28.

Gottschalk, Louis "What Are 'History' and 'Historical Sources'?" chapter 3 of his Understanding History Alfred Knopf, 1969. pp. 41-61.

Blalock, Hubert M. "Introduction to Inductive Statistics" chapter 8 of his Social Statistics 2nd ed. McGraw Hill, 1979, pp. 105-113.

 

Week 3, Monday July 28- Friday, August 1.

Descriptive Statistics II

Thinking About History

More on the Historical Method

Curves and Probability

 

 

Moran, Barbara "Survey Research for Librarians" Southeastern Librarian 35 (fall, 1985), 78-81.

Bookstein, Abraham "Questionnaire Research in a Library Setting" Journal of Academic Librarianship 11 (march, 1985) 24-28.

Bloch, Marc "Historical Observation" chapter 2 of his The Historian's Craft Vintage Books, 1953, pp. 48-78.

Beringer, Richard E. "Quantitative History" of his Historical Analysis: Contemporary Approaches to Clio's Craft Robert E. Krieger Publishing, 1986. pages 193-201.

Kammen, Michael "Historical Knowledge and Understanding" chapter 1 of his Selvages and Biases; The Fabric of History in American Culture Cornell University Press, 1987, pp 3-63.

 

Week 4, Monday, August 4- Friday, August 8.

Introduction to Inferential Statistics

Inferential Statistics II

Guest shot: Faculty research

Guest shot: Doc student research

 

 

O'Connor, Daniel O. and Henry Voos "Empirical Laws, Theory Construction, and Bibliometrics" Library Trends 30 (Summer, 1981) pp. 53-64.

Smith, Linda C. "Citation Analysis" Library Trends 30 (summer, 1981) 83-106.

 

O'Connor and Smith are FYI articles about some widely used methodologies in our field.

 

Weekette 5, Monday, August 11- Wednesday, August 13

 

Last bit on inferential statistics

Final thoughts, wrap up, etc.

 

 

Guidelines for the Statistical Exercises

 

I. The first stats exercise is essentially descriptive in nature. I'll provide you with some data and some relatively simple questions involving descriptive statistics. You answer the questions, and everything is fine.

 

RULE 1: Do your own work. This is not a committee, or team assignment.

RULE 2: You may use a calculator, abacus, ouija board, whatever, but no computers.

RULE 3: Lay out all your work and all your calculations in a reasonably neat fashion so I can figure out what went wrong if you come up with the wrong answer. I tend to give a lot of partial credit for these things, but I have to see what mistakes you made in order to figure out how much you know, or don't know, about what is going on.

II. The second stats exercise is more complex. Questions, and data, will be provided. In this case you will have to work out the answers on a spreadsheet. We'll work out delivery mechanism when we get to that part of the course.

RULES:

Rules 1-3 apply here except for the bit about no computers.

 

LIS 506

Criteria for Evaluating Research Reports

The following is presented as a guideline only. Not all of it will apply to all research pieces, nor are these the only possible criteria that should be addressed. Each piece will require additional thought on the part of the evaluator.

I. Report of Prior Research:

Is the literature cited relevant?
Is the literature cited significant?
Is the literature cited sufficiently identified so that you could retrieve it?

II. Purpose and Justification

Is it sufficient, logical, and convincing?
Is there a general problem area identified?
Is a specific problem evident?
Are definitions given and are they clearly operationalized?
Are assumptions stated?
Hypotheses: Are they stated- implied, clear, precise? Are they directional?
Is lack of an hypothesis accounted for?

III. Sampling (if appropriate):

Is the population clearly described, implied?
Is the sample clearly described?
Is it representative, random, adequate in size?
Are limitations on generalizability presented?

IV. Instrumentation:

Adequately described?
Reliable?
Valid for the purpose?

V. Procedures:

Are they clearly described?
Are extraneous variables controlled?
Is procedural bias controlled?

VI. Data Analysis:

Are statistical methods appropriate?
Are limitations pointed out?

VII. Results

Clearly presented?
Written description consistent with data?
Are there a minimum of inferences?
Are they debatable?

VIII. Interpretation:

Is it consistent with the results?
Relevant to the purpose?
Does it place the study in a broader perspective?
What does it signal?

 

LIS 506: Research Methods I

Fall, 1996 Syllabus

Code of Academic Integrity

The following policy applies to work done for this class:

 

Students assume full responsibility for the content and integrity of the academic work they submit. The guiding principle of academic integrity shall be that a student's submitted work, examinations, reports or projects must be that student's own work. Actions constituting a violation of the Code shall include those outlined below. Students shall be guilty of violating the Code and be subject to proceedings under it if they:

a. Represent the work of others as their own.
b. Use or obtain unauthorized assistance in any academic work.
c. Give unauthorized assistance to other students.
d. Modify, without faculty approval, an examination, paper, record, or report for the purpose of obtaining additional credit.
e. Fail to meet other conditions for academic integrity as required by a faculty member for a specific course.

 

This is excerpted from the University of Arizona "Code of Academic Integrity" as printed in University Handbook for Appointed Personnel There are also excerpts from the "Code" in the SIRLS Student Handbook If you are not sure what any of this means, find out. I interpret this very strictly. Unless specific permission is granted for group, or team projects, I expect that your work will reflect only your own efforts.

 

 

Communications

 

This is, for reasons that escape me, a 7 a.m. class. Kindly do not ask me anything about anything until we are at least an hour into class J . The best time to catch me is right after class in my office. If your class schedule is such that you cannot get to me until later in the day, please ask for an appointment- I intend to spend afternoons working on some long-delayed journal articles, and am discouraging walk-ins.

 

About appointments: The best way of asking me for an appointment is via email- that way I have my calendar available on the computer and can schedule you right away. My email is seavey@u.arizona.edu.

 

There is a class listserv, LIS506. Send the usual subscription message to

Listserv@listserv.arizona.edu. I expect you to be on the listserv by the third day of class.

 

There will be some web based material available to you. I have a couple of spreadsheet tutorials, and I may include some other items as well. By the time class starts the School will have decided where all this stuff is going to live.