Skip to main content Accessibility help

We use cookies to distinguish you from other users and to provide you with a better experience on our websites. Close this message to accept cookies or find out how to manage your cookie settings.

Close cookie message
×
Hostname: page-component-78c5997874-t5tsf Total loading time: 0 Render date: 2024-11-10T17:34:18.919Z Has data issue: false hasContentIssue false

Chapter 10 - Testing and Measurement in North America with a Focus on Transformation

from Part III - Regional Focus

Published online by Cambridge University Press:  08 November 2023

By
Liberty Munson
Edited by
Louis Tay ,
Sang Eun Woo  and
Tara Behrend
Louis Tay
Affiliation:
Purdue University, Indiana
Sang Eun Woo
Affiliation:
Purdue University, Indiana
Tara Behrend
Affiliation:
Purdue University, Indiana
Get access

Summary

An overview of testing and measurement in North America is provided, covering topics related to privacy laws and regulations, online proctoring, artificial intelligence, accommodations, accessibility, and the “opt out of testing” movement that are currently defining measurement in North America. This is not to say that these challenges are unique to North America; in fact, the challenges related to these topics are being faced all over the world in varying degrees and the same opportunities exist, but these topics are of particular importance when it comes to measurement and assessment in North America. Building on these observations, a discussion of how advances in technology and computing power provide an opportunity to challenge the status quo related to assessment; these advancements will allow assessment of skills in more authentic ways that will provide better insight into someone’s knowledge, skills, and abilities. The question we should be asking and attempting to answer is “How can assessment developers leverage the power of the cloud and technology to measure skills more accurately and create higher fidelity in the assessment process?”

Keywords

Americameasurementtestingassessmentprivacyonline proctoringaccommodationsaccessibilityinnovationcomputational psychologyartificial intelligencetechnology
Type
Chapter
Information
Technology and Measurement around the Globe , pp. 308 - 325
Publisher: Cambridge University Press
Print publication year: 2023

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

ACTNext. (2019). Computational psychometrics: A field guide. https://actnext.org/research-and-projects/computational-psychometrics-field-guide/Google Scholar
Alleyne, R. (2011). Welcome to the Information Age – 174 newspapers a day. Daily Telegraph. https://www.telegraph.co.uk/news/science/science-news/8316534/Welcome-to-the-information-age-174-newspapers-a-day.htmlGoogle Scholar
Anderson, C. (2017). Cloud skills and organizational influence: How cloud skills are accelerating the careers of IT professionals. http://download.microsoft.com/download/C/3/0/C3068200–2F9B-4D8D-BF5D-32E1F7ED669A/IDC_Microsoft_How_Cloud_Skills_Are_Accelerating_IT_Pro_Careers_May_2017.pdfGoogle Scholar
Association for Test Publishers (ATP). (2019). Privacy in Practice Bulletin: Customer guidance on privacy compliance. Bulletin 1. Privacy in Practice Bulletin Series (memberclicks.net).Google Scholar
Association for Test Publishers (ATP). (2021, December). Nevada broadens its privacy law… what are the implications? Test Publishers News and Information from ATP, 21.Google Scholar
Bock, R. D. (1997). A brief history of item response theory. Educational Measurement: Issues and Practice, 16(4), 21–33. https://doi.org/10.1111/j.1745-3992.1997.tb00605.xCrossRefGoogle Scholar
Brown, M. F. (2021). Key challenges to remote proctoring: Communications and technology, security, and privacy. https://www.credentialinginsights.org/Article/key-challenges-to-remote-proctoring-communications-and-technology-security-and-privacy-1Google Scholar
Buchanan, R., & Finch, S. (2005). History of psychometrics. In Everitt, B. & Howell, D. (Eds.), Encyclopedia of statistics in behavioral science. John Wiley & Sons.Google Scholar
Cahn, A. F., & Deng, G. (2020). Remote test-taking software is an inaccurate, privacy-invading mess. https://www.fastcompany.com/90586386/remote-test-taking-software-is-an-inaccurate-privacy-invading-messGoogle Scholar
Californians for Consumer Privacy. (2021). Introducing the California Privacy Rights Act (CPRA) Resource Center. https://www.caprivacy.org/introducing-the-california-privacy-rights-act-cpra-resource-center/Google Scholar
CCPA. (2018). California Consumer Privacy Act (CCPA). https://www.oag.ca.gov/privacy/ccpaGoogle Scholar
Crumpler, W. (2020). The problem of bias in facial recognition. https://www.csis.org/blogs/technology-policy-blog/problem-bias-facial-recognitionGoogle Scholar
Diebert, R. J. (2020). Opinion: We’ve become dependent on a technological ecosystem that is highly invasive and prone to serial abuse. Mail. https://www.theglobeandmail.com/opinion/article-the-pandemic-has-made-us-even-more-dependent-on-a-highly-invasive/Google Scholar
DLA Piper. (2021). Law in Mexico – DLA Piper global data protection laws of the world. https://www.dlapiperdataprotection.com/index.html?t=law&c=MXGoogle Scholar
Faggella, D. (2020). Everyday examples of artificial intelligence and machine learning. https://emerj.com/ai-sector-overviews/everyday-examples-of-ai/Google Scholar
Fletcher, D. (2009). A brief history of standardized testing. http://content.time.com/time/nation/article/0,8599,1947019,00.htmlGoogle Scholar
Foster, D. (2020). SmartItem™: Stop test fraud, improve fairness, and upgrade the way you test. https://info.caveon.com/the-smartitem-ebook-promoGoogle Scholar
GDPR EU. (2021). GDPR – user-friendly guide to General Data Protection Regulation. https://www.gdpreu.org/Google Scholar
Gierl, M. J., & Haladyna, T. (2013). Automatic item generation. Routledge.Google Scholar
Gierl, M. J., Lai, H., & Tanygin, V. (2021). Advanced methods in automatic item generation. Routledge.CrossRefGoogle Scholar
Global Disability Rights Now!. (n.d.). Mexico. https://www.globaldisabilityrightsnow.org/mexicoGoogle Scholar
Goddard, W. (2020). Where is AI used today? https://itchronicles.com/artificial-intelligence/where-is-ai-used-today/Google Scholar
Government of Canada. (1977). Rights of people with disabilities. https://www.canada.ca/en/canadian-heritage/services/rights-people-disabilities.htmlGoogle Scholar
Harwell, D. (2020, November 12). Students rebel over remote test monitoring during the pandemic. The Washington Post. https://www.washingtonpost.com/technology/2020/11/12/test-monitoring-student-revolt/Google Scholar
International Data Corporation. (2020). Cloud adoption and opportunities will continue to expand leading to a $1 trillion market in 2024, according to IDC. https://www.idc.com/getdoc.jsp?containerId=prUS46934120Google Scholar
Journal Editorial Board. (2020). Online proctoring unfairly punishes cheaters & non-cheaters alike. https://www.queensjournal.ca/story/2020-11-19/editorials/online-proctoring-unfairly-punishes-cheaters-and-non-cheaters-alike/Google Scholar
Kelly, J., & Oliver, L. (2020). Senators express privacy concerns over proctoring apps. https://www.eff.org/deeplinks/2020/12/senators-express-privacy-concerns-over-proctoring-appsGoogle Scholar
Manea, A. I. (2020). Selecting subject matter experts in job and work analysis surveys: Advantages and disadvantages. Academic Journal of Economic Studies, 6(2), 52–61. https://link.gale.com/apps/doc/A631140986/AONE?u=anon~aa6ed072&sid=googleScholar&xid=b0778136Google Scholar
MIT Technology Review. (2020). Ten breakthrough technologies in 2020. https://www.technologyreview.com/10-breakthrough-technologies/2020/Google Scholar
MIT Technology Review. (2021). Ten breakthrough technologies in 2021. https://www.technologyreview.com/2021/02/24/1014369/10-breakthrough-technologies-2021/Google Scholar
Morse, J. (2020). Online testing is a biased mess, and senators are demanding answers. https://mashable.com/article/senate-open-letter-remote-proctoring-examsoft-bias-student-privacy/Google Scholar
Office of the Privacy Commissioner of Canada. (2019). The Privacy Act. https://priv.gc.ca/en/privacy-topics/privacy-laws-in-canada/the-privacy-act/Google Scholar
Patil, A., & Bromwich, J. E. (2020, September 29). How it feels when software watches you take tests. The New York Times. https://www.nytimes.com/2020/09/29/style/testing-schools-proctorio.htmlGoogle Scholar
Polyak, S. T., von Davier, A. A., & Peterschmidt, K. (2017). Computational psychometrics for the measurement of collaborative problem-solving skills. Frontiers in Psychology, 8. https://doi.org/10.3389/fpsyg.2017.02029CrossRefGoogle ScholarPubMed
Recio, D. (2017). Mexico’s new public-sector data protection law. https://iapp.org/news/a/mexicos-new-public-sector-data-protection-law/Google Scholar
Rippy, S. (2021). US state privacy legislation tracker. https://iapp.org/resources/article/us-state-privacy-legislation-tracker/Google Scholar
Saeed, F. (2020). 9 powerful examples of artificial intelligence in use today. https://www.iqvis.com/blog/9-powerful-examples-of-artificial-intelligence-in-use-today/Google Scholar
Shaw, F. X. (2021). Microsoft Cloud at Ignite 2021: Metaverse, AI, and hyperconnectivity in a hybrid world. https://blogs.microsoft.com/blog/2021/11/02/microsoft-cloud-at-ignite-2021-metaverse-ai-and-hyperconnectivity-in-a-hybrid-world/Google Scholar
Traub, R. E. (1997). Classical test theory in historical perspective. Educational Measurement: Issues and Practice, 16(4), 8–14. https://doi.org/10.1111/j.1745-3992.1997.tb00603.xCrossRefGoogle Scholar
University of California. (2020). University of California Board of Regents unanimously approved changes to standardized testing requirement for undergraduates. https://www.universityofcalifornia.edu/press-room/university-california-board-regents-approves-changes-standardized-testing-requirement#:~:text=Elimination>%20of%20the%20ACT%2FSAT%20test%20requirement%3A%20By%202025%2C,UC-endorsed%20test%20to%20measure%20UC-readiness%20would%20be%20required%20of%20the%20ACT%2FSAT%20test%20requirement%3A%20By%202025%2C,UC-endorsed%20test%20to%20measure%20UC-readiness%20would%20be%20required>Google Scholar
US Equal Employment Opportunity Commission. (1990). Americans with Disabilities Act of 1990. https://www.eeoc.gov/americans-disabilities-act-1990-original-textGoogle Scholar
Valentino-DeVries, J. (2020, January 12). How the police use facial recognition, and where it falls short. The New York Times. https://www.nytimes.com/2020/01/12/technology/facial-recognition-police.htmlGoogle Scholar
von Davier, A. A. (2017). Computational psychometrics in support of collaborative educational assessments. Journal of Educational Measurement, 54(1), 3–11. https://doi.org/10.3389/fpsyg.2017.02029CrossRefGoogle Scholar
von Davier, A. A., Munson, L., & Lottridge, S. (2021, July). In Hembry, T. (Moderator), Increased automation in our industry: How not to get it wrong. Panel discussion presented at ATP’s New World of Testing (NWT) Digital Series.Google Scholar
Weiner, J., Munson, L. J., & Foster, D. (2020, September). Test security in the digital age: Advances in design and analytics. Breakout session accepted at ATP’s Global Annual Innovations in Testing Virtual Conference.Google Scholar
Woodley, C. D. (2015, April). Careful selection of subject matter experts is the key to a successful JTA meeting. The Item Bank: The Professional Testing Blog. http://www.proftesting.com/blog/2015/04/29/2015429careful-selection-of-subject-matter-experts-is-the-key-to-a-successful-jta-meeting/Google Scholar
xAPI.com. (2021). What is xAPI aka the Experience API or Tin Can API? https://xapi.com/overview/Google Scholar

Save book to Kindle

To save this book to your Kindle, first ensure coreplatform@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

Available formats
×