| Platform | Description |
|---|
| Amazon MTurk https://www.mturk.com/ | Large scale labeling and testing experiments. From the developers: "Amazon Mechanical Turk (MTurk) is a crowdsourcing marketplace that makes it easier for individuals and businesses to outsource their processes and jobs to a distributed workforce who can perform these tasks virtually. This could include anything from conducting simple data validation and research to more subjective tasks like survey participation, content moderation, and more. MTurk enables companies to harness the collective intelligence, skills, and insights from a global workforce to streamline business processes, augment data collection and analysis, and accelerate machine learning development." |
| Cognition https://www.cognition.run/ | Free hosting and data storage for jsPsych experiments. From the developers: "1. Code your task: Use jsPsych library to code your cognitive task. Upload your Javascript code or use our online code editor to create your experiment. 2. Share your experiment: Cognition is built to make your life easier. Every experiment gets a secure URL, ready to share. Share the link with your participants to run your experiment. 3. Download your data: Designed with the latest web technology in mind. Cognition collects and stores the data in real-time for you and makes it available for download as CSV." |
| Concerto https://concertoplatform.com | Build and host experiments using an online graphical editor or upload custom R code |
| Django https://www.djangoproject.com | Controls web server backend logic when paired with front end libraries like jspsych. From developers "Django is a high-level Python Web framework that encourages rapid development and clean, pragmatic design. Built by experienced developers, it takes care of much of the hassle of Web development, so you can focus on writing your app without needing to reinvent the wheel. It’s free and open source." |
| FindingFive https://www.findingfive.com | Build and host experiments using an online code editor |
| Gorilla https://Gorilla.sc | Online experiment builder and hosting, including data collection management. From the developers "We help ambitious behavioural scientists create and host online experiments easily. Easy-to-use graphical interface - no coding necessary. Collect behavioural data with accurate reaction times. Build for free. Pay per respondent." |
| hearX https://www.hearxgroup.com/ | Healthy hearing for everyone, everywhere; affordable access to hearing care using smart digital health solutions that anyone can use, anywhere. From the developer, regarding the HearX Self-Test kit (one of many products): "A tablet-based hearing care solution that enables you, as a healthcare professional, to offer counter-side, drive-through or home-based testing with remote support to patients. You can make treatment recommendations, including the fitting of hearing aids that can be provided in low- or no-touch alternative models of care." |
| ispring https://www.ispringsolutions.com/ | E-learning, authoring took kit for online courses. From the developers: "Outstanding mobile-friendly eLearning starts with a simple PowerPoint presentation. You can quickly add a video narration, shoot a screencast, insert a quiz, and more. Once everything is ready, just click Publish and upload a course to your LMS." |
| Jacoti https://www.jacoti.com/ | To enrich consumer electronics with deep-embedable personalized sound optimizing hearing technology. From the developers, regarding Jacoti Hearing Kit (one of multiple products): "HEARING TEST + HEARING LOSS COMPENSATION. Self-administered test. Automatic fitting and noise reduction. Developed under strict medical device quality." |
| jsPsych https://www.jspsych.org | JavaScript library for front-end psychology experiments in a browser. From the developers: "jsPsych is a JavaScript library for running behavioral experiments in a web browser. The library provides a flexible framework for building a wide range of laboratory-like experiments that can be run online. To use jsPsych, you provide a description of the experiment in the form of a timeline. jsPsych handles things like determining which trial to run next, storing data, and randomization. jsPsych uses plugins to define what to do at each point on the timeline. Plugins are ready-made templates for simple experimental tasks like displaying instructions or displaying a stimulus and collecting a keyboard response. Plugins are very flexible to support a wide variety of experiments. It is easy to create your own plugin if you have experience with JavaScript programming." |
| lab.js https://lab.js.org/ | Graphical online experiment builder |
| Labvanced https://www.labvanced.com | Build and host experiments using an online graphical editor |
| MATLAB Online / MATLAB Web App Server https://www.mathworks.com/help/webappserver/getting-started-with-matlab-web-app-server.html | Host experiments coded in MATLAB to be run remotely in the web browser of participants. From the developers: "MATLAB Web App Server™ lets you host MATLAB apps and Simulink simulations as interactive web apps. You can create apps using App Designer, package them using MATLAB Compiler™, and host them using MATLAB Web App Server. Your end-users can access and run the web apps using a browser without installing additional software. MATLAB Web App Server supports integration with authentication standards such as OpenID Connect and LDAP so that you can control access to your web apps. You can host and share multiple apps developed using different releases of MATLAB and Simulink. MATLAB Web App Server is designed to run only within a trusted intranet environment, not in the open Internet. For more information, see Potential Risks. You need an installation of MATLAB and MATLAB Compiler to create web apps. Only apps designed using App Designer in MATLAB can be deployed as web apps on the server. The server can run on Windows, Linux, and macOS platforms." |
| PART/BGC Science https://braingamecenter.ucr.edu/games/p-a-r-t/ | PART is intended to be used as a stand-alone psychoacoustical test platform, capable of providing identical assessments to large numbers of participants across multiple sites. From the developers: "Portable Automated Rapid Testing (PART), a program designed to assess auditory processing abilities across a wide range of tasks. PART was designed to allow users to perform high-quality assessments of auditory processing abilities in a wide variety of settings. We believe that the nervous system processes sound in many complex ways and that hearing health is best described in terms of how well a listener is able to make use of the multiple dimensions on which sounds can vary. This application includes a wide variety of auditory tasks, all of which have been shown to have utility in assessing auditory function in the laboratory." |
| Pavlovia https://pavlovia.org | Platform for hosting JavaScript experiments built with PsychoPy/PsychoJS that also supports jsPsych and lab.js |
| Prolific https://www.prolific.co | Anonymously recruit paid participants for web-based research studies. Anybody who signs up for participant accounts on Prolific is asked to fill out several categories of "About You" surveys. Prolific allows researchers to pre-screen participants based on their responses in the About You section thus allowing for targeted recruitment. |
| PsychoJS https://github.com/psychopy/psychojs | JavaScript counterpart to PsychoPy |
| PsychoPy https://www.psychopy.org/ | Generally used for laboratory-based experiments, but starting with version 3.0, PsychoPy Builder can automatically generate the equivalent PsychoJS code and upload it to Pavlovia |
| Psychstudio https://www.psychstudio.com/ | Behavioral experiments and presentation of stimuli. From the developers: "Conduct simple psychology tests and surveys, or complex factorial experiments. Increase your sample size and automate your data collection with experiment software that does the programming for you. Behavioral experiments. Superior stimulus design. No code." |
| PsychTestR https://pmcharrison.github.io/psychTestR | R package for building experiments that extends R Shiny |
| PsyToolkit https://www.psytoolkit.org | Build and host experiments using an online code editor |
| Pushkin https://languagelearninglab.gitbook.io/pushkin/ | Pushkin provides a customizable, scalable ecosystem for massive online psychological experiments (some familiarity with JavaScript and React needed) |
| Qualtrics https://www.qualtrics.com | Used primarily to administer surveys, but an experiment may be implemented by adding custom JavaScript code or using premade question templates |
| SHOEBOX https://www.shoebox.md/ | SHOEBOX Audiometry: is a portable audiometer comprised of software, calibrated headphones, and an iPad. It offers automated, manual, and assisted mode testing, the output of which is a clinically validated diagnostic audiogram. SHOEBOX Audiometry is listed as a Class II medical device with the FDA. SHOEBOX Online: is an online hearing screening test that effectively categorizes participants based on their hearing ability. It is used to triage patients to help determine who requires more detailed follow-up testing and as a new patient acquisition tool for clinicians. SHOEBOX Online is not a medical device. Supports: Visit Scheduling/Logging, Participant Recruitment, and Online Consenting. Platform can be linked to services that handle scheduling, recruitment, and payment. "Portable, easy-to-use solution on an iPad. Features: Pure tone: air & bone with masking; Speech: SRT/SDT, speech discrimination testing (NU-6, PBK word lists); Manual, assisted, and automated testing modes; SHOEBOX Wizard: an intelligent algorithm to address background noise and unreliable responses; Extended high frequencies (to 16kHz); Embedded inventory, surveys, or customized questionnaires; Secure data archiving, backup, and export." The company provides 2 categories of products; clinically validated mobile audiometers and hearing screeners. SHOEBOX Audiometry is intended for use in occupational hearing testing, hearing clinics, and in hearing health care. SHOEBOX Online is intended for use in hearing clinics and hearing health care. |
| SoSci Survey https://www.soscisurvey.de | Platform for administering surveys which may include sound files and custom JavaScript or PHP code |
| SpeakPipe https://www.speakpipe.com/voice-recorder | Collecting data on voice ranges and singing key selection. From the developers: "SpeakPipe voice recorder allows you to create an audio recording directly from a browser by using your microphone. The recording is produced locally on your computer, and you can record as many times as you need. There is the option to save your recording on the SpeakPipe server and get a link to it, so you can send it via email or use on the web." |
| TabSINT https://tabsint.org/ | From the developers: "Develop custom hearing-related exams or general-purpose questionnaires, then deploy remotely to tablets and mobile devices at multiple sites. External Hardware: Includes interface for plugins, allowing external contributors to build hardware that can interface directly with TabSINT. Open Source: Housed on Gitlab, this software is available to researchers across the world to use and adapt to their specific needs. Researchers with engineering resources can also contribute to the repository to further improve the features and robustness of this software." |
| TeamHearing https://www.teamhearing.org/ | Web application for hearing healthcare that includes speech comprehension and binaural hearing exercises, among others |
| Testable https://www.testable.org | Build and host experiments using an online graphical editor |
