Home   Request A Demo   Login
Technical Reports: Reliability and Validity*
Internal CDI Tech Report - October 2004
Samples Sample size
College and University students 2,788
Working adults 2,469
High School students 2,314
Statistical Methods Used
Item-scale correlations and item-factor analyses were calculated for all samples.
Reliability Measures: Two measures of reliability were computed, one for internal reliability (Alpha coefficient), and one for stability (test-retest).
Validity Measures: Content Validity and Construct Validity were assessed for all sets of items.
Content validity was established by (1) examining the "face validity" of items (2) reviewing the theoretical models and methods used to develop the items, and (3) item-scale correlations
Construct Validity: Construct validity was established by comparing the results of the factor analysis across the 3 different samples. The essential question was, did the factor structure remain the same across the three different population samples i.e., (1) College and University Students, (2) Working Adults, and (3) High School Students
Results of Statistical Analysis
Interest Inventory: The original pool of items consisted of 75 questions. Item-scale correlations and item-factor analyses were calculated for each of the 3 population samples. The results yielded 6 factor scales with 6 items per scale. A content validity analysis showed the factors to be equivalent to the Holland RIASEC type factors. All items had factor analysis loadings above .67 on their respective factors. Two measures of reliability were computed, one for internal reliability (Alpha coefficient), and one for stability (test-retest). The reliability coefficients for all items reached or exceeded .85. Close inspection of the factor structure across the 3 samples gives support to the construct validity
Personality Items: The original pool of items consisted of 82 items. Item-scale correlations and item-factor analyses were calculated for each of the 3 population samples. The results yielded 4 factor scales with 10 items per scale. A content validity analysis showed the factors to approximate the key scales described in the Myers-Briggs Type Indicator inventory and in C. G. Jung's theories of Psychological Types. All items had factor analysis loadings above .68 on their respective factors. Two measures of reliability were computed, one for internal reliability (Alpha coefficient), and one for stability (test-retest). The reliability coefficients for all items reached or exceeded .86. Close inspection of the factor structure across the 3 samples gives support to the construct validity.
Skills Inventory: The skills used are drawn from the US Department of Labor's skills lists found on their website O*NET Online (http://online.onetcenter.org/). Validity and reliability studies were conducted by and are available through the US Department of Labor.
Internal CDI Tech File - December 1999
Sample 321 high school students and 373 college students.
State of New Hampshire high school students and college students, Sponsored by Career Dimensions
1991: ECES (FOCUS II)
Sample: 425 employees.
IBM Employees in career transition, Sponsored by the IBM National Service Division, Franklin Lakes, NJ. Published Report: Minor, F. J., (1991). Field evaluation of a computer-based career planning system. JOURNAL OF CAREER DEVELOPMENT, 18, 111-122.
1975: ECES (FOCUS I)
Sample: 2335 high school students.
State of Michigan High School Students, Sponsored by the Charles Mott Foundation, East Lansing, MI and the IBM Corporation Advanced Systems Development Division, Yorktown heights, NY Published Report : Myers, R.A., Lindeman, R., Thompson, A. & Patrick, T. (1975) Effects of an Educational and Career Exploration System (ECES) on Vocational Maturity. JOURNAL OF VOCATIONAL BEHAVIOR, 6, 245-254.
1970: ECES (FOCUS 1)
Sample: 400 high school students
State of New Jersey High School Students, Sponsored by the Columbia University Teachers College, The Montclair Board of Education, and the IBM Corporation Advanced Systems Development Division, Yorktown heights, NY. Published Report: Thompson, A.S., Lindeman, R. H., Clack, S., & Bohn M. J., The Education & Career Exploration System: Field Trial and Evaluation, Teachers College, Columbia University, New York, NY, 1970.
References and Bibliography

Cairo, P.C. (1983) Evaluating the Effects of Computer-Assisted Counseling Systems. THE COUNSELING PSYCHOLOGIST, 11 (4) 55-60.

Minor, F. J., (1991). Field evaluation of a computer-based career planning system. Journal of Career Development, 18, 111-122.

Pilato, G. T., & Myers, R. A. (1975). The effects of computer-mediated vocational guidance procedures on the appropriateness of vocational preference. Journal Of Vocational Behavior, 6, 61-72.

Pilato, G. T., & Myers, R. A. (1973). Effects of computer-mediated vocational guidance procedures: Accuracy of self- knowledge. Journal Of Vocational Behavior, 3, 167-174.

Myers, R.A., Lindeman, R., Thompson, A. & Patrick, T. (1975) Effects of an Educational and Career Exploration System (ECES) on Vocational Maturity. JOURNAL OF VOCATIONAL BEHAVIOR, 6, 245-254.

Super. D. E., (1970) Using Computers in Guidance: An Experiment in Secondary Schools. CANADIAN COUNSELOR, Vol 4 , 11-21.

Minor, F.J., (1991) Field Evaluation of a Computer-Based Career Planning System. JOURNAL OF CAREER DEVELOPMENT, 1991, 18, 111-122.

Minor, F.J., Slade, A. & Myers, R.A., Career Transitions in Changing Times. In R.F. Morrison and J. Adams (Eds.), Contemporary Career Development Issues, L. Erlbaum Associates, Hillsdale, N.J., 1991.

Minor, F.J., & Slade, A., Managing Career Transitions. In J.W. Jones, B. Steffy & D.W. Bray (Eds.), Applying Psychology in Business, Lexington Books, 1991.

Super, D.E., & Minor, F.J., Career Development and Planning in Organizations. In B. Bass (Ed.) Advances in Organizational Psychology, International Review, Sage Press, Beverly Hills, 1987.

Minor, F.J., Computer-Applications in Career Development Planning. In D.T. Hall (Ed.) Career Development in Organizations. Jossey-Bass Publications, San Francisco, (May 1986). (A Frontier Series book sponsored by the Society for Industrial & Organizational Psychology, Division 14 of the American Psychological Association).

Minor, F.J., An Experimental Educational & Career Exploration System. In D.E. Super (Ed.) Computer Assisted Counseling, New York Teachers College Press, Columbia University, 1970.

Minor, F.J., Myers, R.A., & Super, D.E., An Experimental Computer Based Educational and Career Exploration System. PERSONNEL AND GUIDANCE JOURNAL, 1969, 47, 564-569.

* All reliability and validity studies were conducted on data samples collected using FOCUS©. My Golden Career uses the identical assessments as FOCUS. It is our contention that My Golden Career would produce results similar to those that follow. An evaluation of My Golden Career is scheduled for June, 2006.
Privacy Policy || Accessibility Policy || Validity and Reliability || About Us || Contact Us
 
Copyright 2014: Career Dimensions©, Inc.