GROUP+4

Group 4 members:
 * Marek, Jennifer
 * Phillips, Amanda
 * Plese, Joshua


 * __1. Use the DISCUSSION tab above to find your discussion questions and/or tasks.__**


 * __2. POST YOUR GROUP CONSENSUS HERE (The group leader for these 4 Binary Choice activities will be the member whose first name comes earliest in alphabetical order.):__**

Binary Choice Item # 1 - flaw(s)? We agreed that the flaw in this statement lies in its inclusion of more than one concept. Instead of providing activities pushing teachers to understand ALL relevant aims, the focus should be on one or two curricular aims (concepts). When the district administrators provide so many activities, it could lead to confusion, and therefore, should be avoided. __Evidence:__ Per the Item Writing Guidelines, items which involve more than one concept should be avoided (categories should be balanced).

__Binary Choice Item # 2 - flaw(s)?__ We agreed that the flaw in this statement lies in the use of vocabulary that is more advanced than the audience. Vocabulary should be suitable for those taking the test. The wording in Item #2 would only lead to confusion. Talking above your audience can leave them in a state of disinterest and the feeling of being "talked down to." By using language appropriate for your audience and by keeping it brief/simple, one has a better chance of their audience grasping/understanding the topic at hand.

__Evidence__: This is supported by the 5th Commandment: Thou shall not use vocabulary that is more advanced than your audience.

Binary Choice Item # 3 - flaw(s)? We agreed that the flaw in Item #3 lies in the use of an absolute qualifier through with use of the words "almost impossible." "Almost impossible" creates a tricky statement.

__Evidence:__ Per the 3rd Commandment, absolute qualifiers, such as never or always, should not be used in true/false statements. Within the 3rd commandment, it is stated: "the focus of a good assessment should be on finding out what students know and do not know... not on trick questions."

__Binary Choice Item # 4 - flaw(s)?__ One of us felt that the flaw in this statement lies in the use of too many negatives. Item #4 makes use of the following negative wording: avoid, fail (2x's), never, and incorrect. Another one of us felt that "absolute qualifiers such as never and always often appear in true false tests" and should not be used in such manner. In this item, the word "never" is used.

__Evidence__: Per the Writing Guidelines for Binary Choice Assessments, the use of negatives should be minimized.


 * 3. POST YOUR GROUP PRODUCT HERE - Multiple Binary-Choice assessment item (the group member whose birthday is closest to Christmas will be the leader for this Multiple Binary-Choice activity :**

Question: Picture this: A man is stranded in the desert with. He needs certain things to survive, such as food, water, and shelter. He has shelter. He has no food and no water. He can find these things in the desert. Look at each sentence and decide whether decide if it is true or false.
 * Multiple binary-choice assessment item created for assessment after a lesson on the desert.

1. The man needs water so he looks for the many lakes he can find in the desert. 2. The man needs water so he eats the pulp of a cactus for water. 3. The man needs water so he looks for plants and then digs under them. 4.The man needs food so he eats any plant he can find. 5. The man needs food so he catches and eats chickens. 6. The man needs food so he catches and eats mice.


 * 4. POST YOUR GROUP CONSENSUS HERE (The group leader for these 4 Multiple Choice activities will be the member whose last name comes earliest in alphabetical order.):**

Multiple-Choice Item # 1 - flaw(s)? We both agreed that the flaw in this item lies in the use of a negatively stated stem (first part of the multiple choice item: 'An "instructionally supportive" test need NOT'), which is supported by the Writing Guidelines for Multiple Choice Assessments. The guidelines state to avoid negatively stated stems as a rule (i.e. stems which make use of the word "not" or "never"). Use of such statements can lead to confusion for the students.

Evidence: The Writing Guidelines for Multiple Choice Assessments state one should avoid negatively stated stems as a rule (i.e. stems which make use of the word "not" or "never").

Multiple-Choice Item # 2 - flaw(s)? One of us felt that the flaw in this statement lies in the use of an unintended clue which points to the answer. By using the word "an," a student who knows their grammar may know to pick the answer that begins with a vowel. Also, the use of (A.) Academic "Content Standard" and (B.) "Content Standard" is also misleading. Use of the same wording in more than one answer can lead to confusion. Another one of us felt that all alternatives here are not the same length. The letter D is one word where letters C, B, and A are two and three words. This could hint towards the correct answer. Also, the length of a multiple choice item can give an unintended clue to the wrong answer according to the guidelines for Multiple Choice Assessments.

Evidence: This is supported by Commandment #3 (Thou shall not provide students with unintended clues regarding appropriate responses).

The length of a multiple choice item can give an unintended clue to the wrong answer according to the guidelines for Multiple Choice Assessments.

Multiple-Choice Item # 3 - flaw(s)? We agreed that the flaw in this statement lies in the use of item alternatives (a.k.a. answer options) which include the option of "all-of-the-above." Per the Writing Guidelines for Multiple Choice Assessments, one should consider using "... of the above" alternatives carefully. If a student knows two options are correct, then the student can be sure that the rest are correct.

Evidence: Per the Writing Guidelines for Multiple Choice Assessments, one should consider using "... of the above" alternatives carefully. Also, per these guidelines, 'When you include “all-of-the above” – a student who knows only two of the alternatives are correct can guess that the other two are correct as well.'

Multiple-Choice Item # 4 - flaw(s)? We agreed that the flaw in this statement lies in the use of one lengthy alternative. All alternatives should be about the same length per the Item Writing Guidelines for Multiple Choice Assessments. The length of a specific alternative may stand out to a student as special, and therefore, giving the student an unintended clue to the correct answer.

Evidence: All alternatives should be about the same length per the Item Writing Guidelines for Multiple Choice Assessments.

//“Find the flaws. . . use evidence from the ‘5 Commandments and/or the Item Writing Guidelines to support your answers.”//** //On the line to the left of each measurement concept listed in Column A, please write the letter of the most relevant measurement procedure in Column B.//
 * 5. POST YOUR GROUP CONSENSUS HERE (The group leader for this Matching Item activity will be the member whose birthday is closest to Valentine's Day.):**
 * Column A || Column B ||
 * 1. Bias-Detection || A. Determining DIF indices ||
 * 2. Item Difficulty || B. Computing K-R formula ||
 * 3. Reliability || C. Evaluating curricular alignment ||
 * 4. Score Interpretation || D. Deriving percentiles ||
 * 5. Validity || E. Calculating p// - values ||
 * 5. Validity || E. Calculating p// - values ||

Matching Item # 1 - flaw(s)? We both seemed to believe that the flaw in the matching item lies in a couple areas. According to the Writing Guidelines, there should be a few extra responses (i.e. in Column B)and responses should be ordered logically. A student who knows 80% of the matches may be able to figure out those remaining matches not through what he knows, but through guessing or the process of elimination. Also, responses should be ordered logically (i.e. in alphabetical order). Column A (the premise) is alphabetized and doesn't need to be. Column B (the responses) should have been alphabetized instead.

Evidence: According to the Writing Guidelines, there should be a few extra responses (i.e. in Column B)and responses should be ordered logically.