Back to Newsletter Homepage...

______________________________________________________________________________________________________________
In This Issue
News from CAMECD president ... CAMECD legacy of contributions to measurement, assessment, evaluation and research ... News from CAMECD president-elect ... 2003 CACD-ACA convention ...
______________________________________________________________________________________________________________

April 2002

Assessment
Today

California Association for Measurement and Evaluation in
Counseling and Development ~~ 714/871-6460 ~~ fax 714/871-5132

______________________________________________________________________________________________________________

News from CAMECD president Dr. Lisa Lee

Once again, thank you for allowing me to represent CAMECD as your president this past year. At the recent CACD Convention in San Mateo, President-Elect Dr. Kathy Green and I spoke at the CAMECD breakfast.  I presented a summary of information from the Computer-Based Testing Conference sponsored by the Association of Test Publishers.

Summary of Computer-Based Testing Conference

Computer-based testing (CBT) has a wide variety of applications, but, to date, has not completely replaced paper-pencil testing (PPT). One of the issues discussed at the conference was that of the delivery method of CBT. Browser-based delivery can be useful because it will allow for individual and immediate assessment. Some of the problems with this method are the difference in availability of the Internet to particular sites and individuals. Some examinees may have very slow Internet access, while others have high-speed access.

In addition to the time allowed the examinee based on browser speed, there are issues of how to make accommodations when the Internet goes down for some examinees and not others. One solution to this application is Internet-based testing in which assessments are downloaded to a specific site or server and are administered in a more controlled setting. This alleviates some of the security concerns of protection of test items as well as confirmation of the identity of the client.

Many CBT tests are administered for credentialing purposes, and there are issues with verification of the examinee. If an examinee has to travel to a particular testing site and carry identification that can be verified by a trained proctor, some of these security issues can be avoided. In the future, it may be possible to verify examinee information through retinal imaging or fingerprints. While these methods have not been perfected, they most likely will be available in the future.

Many of the concerns of CBT are the same as those PPT, for example, security of item banks and verification of examinees. A new wrinkle in the development of CBT is that of comparability studies. Many CBT's are new, and validity studies need to be conducted. There are assumptions that a straight conversion of PPT to CBT is equivalent; certainly, for some types of testing this is true, but in many types of testing situations there will need to be extensive validation to verify equivalency.

Some of the strong points of CBT are the ease of use by the examinee and the speed with which scoring and reporting can be provided. While CBT is not the complete answer for measurement, it is certainly going to have an effect on assessment, and it is the wave of the future.

Counselor Licensure Coalition

Some members of the divisions of CACD are interested in forming a coalition to pursue counselor licensure in California. The coalition is in its formative stages, and I would like to hear form CAMECD members regarding this issue. Do you think CAMECD should support licensure? While licensure may not be an issue for many of us, it will involve measurement of some kind, and many of our members would be qualified to help to develop such assessments. I would like to hear from you so that we may share this information with other members. Please contact me at edits@k-online.com or Lisa Lee, P.O. Box 7234, San Diego, CA 92167. In future newsletters we will provide an update.

CAMECD Web Site

CAMECD President-Elect Kathy Green and I will be working on a web site for CAMECD. Tentatively, we are considering posting past newsletters as well as membership information. A list of past presidents and maybe a short history might also be of interest to include. If you have any ideas or would like to participate in this effort, please contact Dr. Kathy Green at 949/583-0540, or me.

______________________________________________________________________________________________________________

The CAMECD Legacy of Professional Contributions

The California Association for Measurement and Evaluation of Counseling and Development has a rich legacy of professional contributions to measurement, assessment, evaluation, and research. Here are a few benchmarks from the early years of CAMECD (then CAMEG), as reported in newsletters of the time:

_____________________________________________________________________________________________________________

News from CAMECD president-elect Dr. Kathryn Green

    At the 2002 CACD Convention, the focus of my presentation at the CAMECD breakfast was "Accountability and Assessment Systems."

    Assessment in the school system has always been a concern. President George W. Bush recently signed the "No Child Left Behind Act of 2001," which sets standards for achievement in school systems, and requires school systems to create a system of accountability to measure results. As can be imagined, this will have a direct impact on assessment. In a recent article on assessment, Dr. Sylvia Charp, editor-in-chief of the T.H.E. Journal, reported that, if teacher evaluation and compensation and school funding depend on assessment results, teachers will teach to the test. As measurement experts, we are aware that can create problems with instruction.

    Charp's statements are supported by William Huitt, who proposed four concepts that influence the teaching/learning process in his model of Teaching and Learning (http://chiron.valdosta.edu/whuitt/materials/mditp.html):

    • Context: all factors outside the classroom that might influence teaching and learning.
    • Input: qualities or characteristics that teachers and students bring with them to the classroom
    • Classroom Processes: behaviors of teachers and students and climate in the classroom.
    • Output: measures of student learning taken apart from the normal instructional process.

    Huitt points out that the output is extremely important, and if the desired outcome measure is a score on a standardized test, the instructional method most likely to impact the measure positively is direct instruction.

    Standarized Tests and Evaluation

    Obviously, standardized tests are one of the easiest methods of evaluation. They can be administered to a large number of students concurrently, and they lend themselves to computerized and online scoring and analysis. However, as test developers and users, we know that there are limitations of standardized testing. It behooves us as testing specialists to keep abreast of the legislation and the impact of testing in the schools, as well as current trends in the testing field.

    Online Testing Resources

    Some online testing resources are listed below. Some contain information for online testing, and some are actual online test. It is hoped you might find this list useful in your professional lives. If you have any sites that you find useful, please contact me.

    Please send review comments on computer-based testing, and we will include them in the next newsletter.

______________________________________________________________________________________________________________

~~ F.Y.I. ~~

The 2003 CACD-ACA Convention
Co-Sponsored by CACD and ACA
Anaheim, California
March 20-24, 2003

______________________________________________________________________________________________________________

CAMECD Membership Survey

I hope you will have the time to complete this brief survey regarding CAMECD and give some input into how CAMECD can meet the needs of our membership.
Please print this questionnaire, fill it out and mail it to the address below.
Thank you.

  1. Would you be interested in a CAMECD web site? ____ Yes ____ No
    Any suggestions for items to be included in a web site?
    __________________________________________________________
    __________________________________________________________
    __________________________________________________________

  2. Do you have any suggestions for how CAMECD can meet some of your
    counseling needs, for example, newsletters more often, web site, et cetera?
    Suggestions:
    __________________________________________________________
    __________________________________________________________
    __________________________________________________________

  3. As was mentioned in the newsletter, some members and associations within
    CACD are interested in participating in a counselor licensure coalition.
    I would like to know your views on licensure, and ask you to complete several
    questions regarding licensure.

______________________________________________________________________________________________________________