Module 1: Foundations of Psychological Measurement and Scaling

• Introduction to measurement theory and the role of psychometrics

• Defining constructs, operationalization, and psychological scaling

• Levels of measurement (Nominal, Ordinal, Interval, Ratio) and their implications

• Overview of different scaling methods (Likert, Semantic Differential, Thurstone)

• Ethical and legal considerations in psychological testing and measurement

• Practical session: Developing a conceptual framework and creating initial items for a new psychological construct scale

Module 2: Classical Test Theory (CTT) and Reliability

• The fundamental CTT model: observed score, true score, and error

• Defining and quantifying measurement error

• Methods for estimating reliability: Test-retest, parallel forms, internal consistency

• Calculating and interpreting Cronbach's Alpha and the Standard Error of Measurement (SEM)

• The Spearman-Brown prophecy formula and its application

• Practical session: Calculating and interpreting multiple reliability estimates for an existing multi-item scale using statistical software

Module 3: Validity in Measurement

• Comprehensive definition of validity as a unitary concept (Messick's framework)

• Types of validity evidence: Content, Criterion (Predictive/Concurrent), and Construct Validity

• Establishing evidence for Content Validity (Expert review and Item-Objective Congruence)

• Using correlation and regression to establish Criterion Validity

• The role of the Multitrait-Multimethod (MTMM) matrix in assessing Construct Validity

• Practical session: Designing a validity study, collecting data, and calculating correlational evidence for a scale's criterion validity

Module 4: Item Analysis and Scale Development

• Purpose and process of rigorous item analysis

• Item difficulty, item discrimination indices (p and D)

• Analyzing distractor effectiveness for multiple-choice items

• Calculating the Corrected Item-Total Correlation and its use in scale refinement

• Guidelines for final scale construction and short form development

• Practical session: Performing a full item analysis on a pilot dataset, identifying poor items, and documenting scale refinement decisions

Module 5: Introduction to Factor Analysis for Scale Validation

• The role of Factor Analysis (FA) in providing evidence for Construct Validity

• Distinguishing between Exploratory Factor Analysis (EFA) and Confirmatory Factor Analysis (CFA)

• EFA steps: extraction methods (PCA vs. Principal Axis Factoring), rotation techniques

• Interpreting factor loadings and cross-loadings, and naming latent factors

• Basic introduction to CFA fit indices and model specification (overview)

• Practical session: Performing an Exploratory Factor Analysis (EFA) to confirm the underlying factor structure of a new scale

Module 6: Item Response Theory (IRT) Fundamentals

• CTT limitations and the advantages of Item Response Theory (IRT)

• Key IRT models: One-Parameter (Rasch/1PL), Two-Parameter (2PL), and Three-Parameter (3PL) models

• Interpreting item parameters: difficulty (b), discrimination (a), and guessing (c)

• The Item Characteristic Curve (ICC) and Test Information Function (TIF)

• Using the TIF for targeted test design (e.g., Computer Adaptive Testing overview)

• Practical session: Fitting a 1PL or 2PL IRT model to a dataset and interpreting the resulting item characteristic curves

Module 7: Differential Item Functioning (DIF) and Measurement Bias

• Defining test fairness, measurement bias, and the concept of Differential Item Functioning (DIF)

• DIF detection methods: Mantel-Haenszel, Lord's Chi-Square, and logistic regression methods

• Interpreting DIF statistics and classifying items as uniform or non-uniform DIF

• Strategies for addressing and mitigating DIF in test construction

• Introduction to measurement invariance for cross-cultural research

• Practical session: Using a DIF detection method to screen items for potential bias across two different demographic groups

Module 8: Standard Setting and Score Interpretation

• Methods for converting raw scores to scale scores (e.g., z-scores, T-scores, percentiles)

• Introduction to criterion-referenced score interpretation and cut scores

• Common standard setting methods: Angoff, Bookmark, and contrasting groups

• Documenting and justifying standard setting decisions

• Reporting and interpreting proficiency levels based on cut scores

• Practical session: Applying the Angoff method (simulated expert judgments) to set a pass/fail cut score for an exam

Module 9: Specialized Measurement Models and Techniques

• Introduction to Generalizability Theory (G-Theory) for multifaceted reliability

• Foundations of Latent Class Analysis (LCA) for identifying unobserved subgroups

• Using Multitrait-Multimethod (MTMM) for advanced validity studies

• Advanced scaling techniques for non-cognitive attributes (e.g., ipsative measures)

• Practical issues in longitudinal measurement and change assessment

• Practical session: Interpreting an analysis of a simulated G-Theory study to identify major sources of measurement error

Module 10: Practical Implementation and Psychometric Reporting

• Developing a full psychometric report for internal and external stakeholders

• Documentation requirements for high-stakes assessment development

• Selecting and evaluating appropriate psychometric software packages

• Establishing an ongoing quality assurance (QA) and maintenance plan for scales

• Ethics and professional standards in the reporting and use of psychometric data

• Practical session: Developing a structured psychometric summary report based on the results generated across the entire course

Requirements:

·       Participants should be reasonably proficient in English.

·       Applicants must live up to Armstrong Global Institute admission criteria.

Terms and Conditions

1. Discounts: Organizations sponsoring Four Participants will have the 5th attend Free

2. What is catered for by the Course Fees: Fees cater for all requirements for the training – Learning materials, Lunches, Teas, Snacks and Certification. All participants will additionally cater for their travel and accommodation expenses, visa application, insurance, and other personal expenses.

3. Certificate Awarded: Participants are awarded Certificates of Participation at the end of the training.

4. The program content shown here is for guidance purposes only. Our continuous course improvement process may lead to changes in topics and course structure.

5. Approval of Course: Our Programs are NITA Approved. Participating organizations can therefore claim reimbursement on fees paid in accordance with NITA Rules.

Booking for Training

Simply send an email to the Training Officer on training@armstrongglobalinstitute.com and we will send you a registration form. We advise you to book early to avoid missing a seat to this training.

Or call us on +254720272325 / +254725012095 / +254724452588

Payment Options

We provide 3 payment options, choose one for your convenience, and kindly make payments at least 5 days before the Training start date to reserve your seat:

1. Groups of 5 People and Above – Cheque Payments to: Armstrong Global Training & Development Center Limited should be paid in advance, 5 days to the training.

2. Invoice: We can send a bill directly to you or your company.

3. Deposit directly into Bank Account (Account details provided upon request)

Cancellation Policy

1. Payment for all courses includes a registration fee, which is non-refundable, and equals 15% of the total sum of the course fee.

2. Participants may cancel attendance 14 days or more prior to the training commencement date.

3. No refunds will be made 14 days or less before the training commencement date. However, participants who are unable to attend may opt to attend a similar training course at a later date or send a substitute participant provided the participation criteria have been met.

Tailor Made Courses

This training course can also be customized for your institution upon request for a minimum of 5 participants. You can have it conducted at our Training Centre or at a convenient location. For further inquiries, please contact us on Tel: +254720272325 / +254725012095 / +254724452588 or Email training@armstrongglobalinstitute.com

Accommodation and Airport Transfer

Accommodation and Airport Transfer is arranged upon request and at extra cost. For reservations contact the Training Officer on Email: training@armstrongglobalinstitute.com or on Tel: +254720272325 / +254725012095 / +254724452588