{"dataset":{"id":"55559","dataset_id":"on004196","name":"Bimodal dataset on Inner speech","description":"This dataset provides bimodal EEG and fMRI recordings acquired non-simultaneously during an inner-speech production task. Four healthy, right-handed participants silently produced eight words drawn from two semantic categories (social and numerical) across multiple trials. The dataset aims to support the development of speech prostheses and brain-computer interfaces by enabling multimodal fusion of high temporal (EEG) and high spatial (fMRI) resolution neuroimaging data.","owner_user_id":15,"status":"active","github_repo":"nemarDatasets/on004196","concept_doi":"10.82901/nemar.on004196","latest_version_doi":"10.82901/nemar.on004196.v1.0.0","created_at":"2026-06-23 15:33:29","updated_at":"2026-08-19 16:18:27","zenodo_concept_id":null,"is_sandbox":0,"visibility":"public","ezid_status":"public","enrichment_json":"{\n  \"version\": \"2.0\",\n  \"pipeline_stage\": \"enriched\",\n  \"title\": \"Bimodal dataset on Inner speech\",\n  \"description\": \"This dataset provides bimodal EEG and fMRI recordings acquired non-simultaneously during an inner-speech production task. Four healthy, right-handed participants silently produced eight words drawn from two semantic categories (social and numerical) across multiple trials. The dataset aims to support the development of speech prostheses and brain-computer interfaces by enabling multimodal fusion of high temporal (EEG) and high spatial (fMRI) resolution neuroimaging data.\",\n  \"methods_description\": \"Data were collected from four healthy, right-handed participants performing an inner-speech task involving eight word stimuli from two categories (social and numerical), each assessed with 40 trials, resulting in 320 trials per modality per participant. EEG and fMRI data were acquired in separate (non-simultaneous) sessions.\",\n  \"license\": \"CC0\",\n  \"dataset_type\": \"raw\",\n  \"authors\": {\n    \"Foteini Liwicki\": {},\n    \"Vibha Gupta\": {},\n    \"Rajkumar Saini\": {},\n    \"Kanjar De\": {},\n    \"Nosheen Abid\": {},\n    \"Sumit Rakesh\": {},\n    \"Scott Wellington\": {\n      \"orcid\": \"0000-0002-8384-8474\"\n    },\n    \"Holly Wilson\": {},\n    \"Marcus Liwicki\": {},\n    \"Johan Eriksson\": {}\n  },\n  \"keywords\": [\n    {\n      \"term\": \"EEG\"\n    },\n    {\n      \"term\": \"fMRI\"\n    },\n    {\n      \"term\": \"inner speech\"\n    },\n    {\n      \"term\": \"brain-computer interface\"\n    },\n    {\n      \"term\": \"speech prosthesis\"\n    },\n    {\n      \"term\": \"multimodal neuroimaging\"\n    }\n  ],\n  \"related_identifiers\": [\n    {\n      \"identifier\": \"https://github.com/nemarDatasets/on004196\",\n      \"identifier_type\": \"URL\",\n      \"relation_type\": \"IsDescribedBy\"\n    },\n    {\n      \"identifier\": \"10.1101/2022.05.24.492109\",\n      \"identifier_type\": \"DOI\",\n      \"relation_type\": \"IsSupplementTo\"\n    },\n    {\n      \"identifier\": \"10.18112/openneuro.ds004196.v2.0.2\",\n      \"identifier_type\": \"DOI\",\n      \"relation_type\": \"IsDerivedFrom\"\n    },\n    {\n      \"identifier\": \"https://nemar.org/dataset/on004196\",\n      \"identifier_type\": \"URL\",\n      \"relation_type\": \"IsDescribedBy\"\n    }\n  ],\n  \"funding_references\": [\n    {\n      \"funder_name\": \"This research was funded by the Grants for excellent research projects proposals of SRT.ai 2022.\"\n    },\n    {\n      \"funder_name\": \"SRT.ai\",\n      \"award_title\": \"Grants for excellent research projects proposals of SRT.ai 2022\"\n    }\n  ],\n  \"resource_type_general\": \"Dataset\",\n  \"resource_type_specific\": \"Structural MRI Dataset\",\n  \"modalities\": [\n    \"anat\",\n    \"fmap\",\n    \"func\",\n    \"eeg\"\n  ],\n  \"sizes\": [\n    \"10.0 GB (41 files)\"\n  ],\n  \"formats\": [\n    \".bdf\",\n    \".gz\",\n    \".json\",\n    \".md\",\n    \".tsv\",\n    \".yml\"\n  ],\n  \"source_hash\": \"9f7839f88f3141fbcf16d10310100a9cf1312d13f51498695aaa702ec4ff77bd\"\n}","last_activity_at":"2026-06-23 15:33:29","source":"openneuro","source_id":"ds004196","subject_count":4,"modalities":"anat,eeg,fmap,func","age_min":33,"age_max":52,"file_size":10022901529,"total_files":113,"tasks":"inner","metadata_columns_error":null,"staleness_warn_stage":null,"staleness_admin_notified_at":null,"authors":"Foteini Liwicki, Vibha Gupta, Rajkumar Saini, Kanjar De, Nosheen Abid, Sumit Rakesh, Scott Wellington, Holly Wilson, Marcus Liwicki, Johan Eriksson","license":"CC0","readme":"[![DOI](https://img.shields.io/badge/DOI-10.82901%2Fnemar.on004196-blue)](https://doi.org/10.82901/nemar.on004196)\n\nBimodal dataset on Inner Speech\n\nCode available: https://github.com/LTU-Machine-Learning/Inner_Speech_EEG_FMRI \n\nPublication available: https://www.nature.com/articles/s41597-023-02286-w\n\nAbstract:\nThe recognition of inner speech, which could give a `voice' to patients that have no ability to speak or move, is a challenge for brain-computer interfaces (BCIs). A shortcoming of the available datasets is that they do not combine modalities to increase the performance of inner speech recognition. Multimodal datasets of brain data enable the fusion of neuroimaging modalities with complimentary properties, such as the high spatial resolution of functional magnetic resonance imaging (fMRI) and the temporal resolution of electroencephalography (EEG), and therefore are promising for decoding inner speech. This paper presents the first publicly available bimodal dataset containing EEG and fMRI data acquired nonsimultaneously during inner-speech production.  Data were obtained from four healthy, right-handed participants during an inner-speech task with words in either a social or numerical category. Each of the 8-word stimuli were assessed with 40 trials, resulting in 320 trials in each modality for each participant.   \nThe aim of this work is to provide a publicly available bimodal dataset on inner speech, contributing towards speech prostheses.\n\nShort Dataset description:\nThe dataset consists of 1280 trials in each modality (EEG, FMRI). \nThe stimuli contain 8 words,  selected from 2 different categories (social, numeric):\nSocial: child, daughter, father, wife\nNumeric: four, three, ten, six\n\nThere are 4 subjects in total: sub-01, sub-02, sub-03, sub-05. Initially, there were 5 participants, however, sub-04 data was rejected due to high fluctuations. Details of valid data are available in the file participants.tsv. \n\nFor questions please contact: foteini.liwicki@ltu.se ","bids_version":"1.4","sessions_count":3,"publish_date":null,"embedding_dirty":0,"license_tier":"public","zarr_status":"ready","zarr_converted_at":"2026-08-05 17:27:32","zarr_store_count":4,"zarr_index_etag":"f9afdf00eb1a634959aff1b4bdcc4861","zarr_source_commit":"c3b563d581bb3bdb913f6a1fbe6eabff7ee21530","archive_status":"ready","archive_size":9874616939,"archive_retry_count":0,"records_status":"ready","archive_skip_reason":null,"zarr_errors":0,"zarr_failure_count":0,"zarr_deterministic":0,"zarr_failed_at":null,"num_dataset_citations":0,"num_datapaper_citations":27,"n_channels":64,"electrode_system":"10-10","has_hed":0,"hed_version":null,"is_exemplar":0,"bytes_present":10022744397,"data_complete":1,"withdrawn_at":null,"withdrawn_reason":null,"archive_complete":null,"archive_absent_files":null,"archive_declared_files":null,"zarr_pool_breaks":null,"total_recording_duration":5288,"recording_duration_min":1306,"recording_duration_max":1360,"recording_count":4,"recordings_unavailable":0,"recordings_measured":4,"channel_count_min":73,"channel_count_max":73,"sampling_frequency":512,"power_line_frequency":50,"eeg_reference":"Cz","placement_scheme":"10-20","sweep_stamps":"{\"enrichment_updated_at\":\"2026-08-19 16:18:17\",\"metadata_updated_at\":\"2026-08-19 16:18:25\",\"archive_checked_at\":\"2026-06-23 15:48:08\",\"zarr_checked_at\":null,\"records_checked_at\":\"2026-06-23 15:42:53\",\"citations_updated_at\":\"2026-09-08 03:00:48\",\"channel_montage_checked_at\":\"2026-06-28 23:21:29\",\"hed_checked_at\":\"2026-06-30 04:54:23\",\"data_checked_at\":\"2026-08-07 03:01:03\",\"availability_report_at\":\"2026-07-23 01:17:31\",\"recording_stats_at\":\"2026-09-02 11:32:40\",\"signal_defaults_at\":\"2026-09-02 12:08:58\"}","participants":4,"num_citations":27,"latest_version":"v1.0.0","zarr_verify_status":null,"zarr_verified_at":null,"owner_username":"nemarAdmin","owner_github":"nemarAdmin","file_size_formatted":"9.33 GB","zarr_data_failures":null,"zarr_index_url":"https://zarr.nemar.org/on004196/zarr/index.json","attestation_deposit_type":null,"attestation_key_status":null,"attestation_deidentified":null,"attestation_no_duplicate":null,"attestation_upstream_source":null,"attestation_accepted_at":null}}