Difference between revisions of "Main Page"

From NMReDATA
Jump to: navigation, search
(Experimental data)
(Publications)
 
(222 intermediate revisions by 10 users not shown)
Line 1: Line 1:
Direct link to page describing the [[NMReDATA tag format|format of the "<NMREDATA_...>" tags]].
 
  
Direct link to the the[[1D attributes|1D spectra attributes page]].
+
'''Quick links'''
  
= Introduction =
+
Direct link to the page describing the [[NMReDATA tag format|format of the NMREDATA tags (version 1.0/1.1)]] and [[NMReDATA tag format 2.0|format of the NMREDATA tags (version 2.0)]].
The [http://www.nmredata.org NMReDATA working group] decided to include data extracted from NMR spectra of small molecules using "tags" in SDF files.  
 
  
[[sdf files| More details about SDF files including NMReDATA here!]].
+
List of [[compatible software|compatible software and webtools]]
  
An important task of the group is to define the format of the content of the "<NMREDATA_...>" tags.  [[NMReDATA tag format|More details here!]].
+
Tentative instruction for [[Submission NMReDATA|journal submission of NMReDATA]].
  
The version 1.0 will be decided in September at the "Round table" of the Smash 2017 conference at Baveno, Italy.
+
Link to the [https://github.com/NMReDATAInitiative GitHub page] of the NMReDATA Initiative.
  
= NMR records =
+
= Introduction =
<!-- [[commented_example_nmredata|Example of commented and simplified NMREDATA tags ]] -->
+
The [http://www.nmredata.org/partners.html NMReDATA working group] decided to include data extracted from NMR spectra of small molecules in [[sdf files| SDF files]] using SD tags.  
We call "NMR record", a folder (or .zip file including the folder) or database record including:
 
  
1) All the NMR spectra (including FID, acquisition and processing parameters)
+
Link to the [https://onlinelibrary.wiley.com/doi/abs/10.1002/mrc.4737 MRC article] on the NMReDATA format.
  
2) The .nmredata.sdf file
+
An important task of the group is to define the format of the content of the "<NMREDATA_...>" tags.  [[NMReDATA tag format|More details here!]].
  
[http://www.nmredata.org/test-2.pdf Pictural representation of NMR record and example of SDF file] presented in the [http://nmredata.org/euromar_2017_v5_optimized.pdf poster] presented in July at the Euromar 2017.
+
The version 1.0 has been decided in September at the "Round table" of the Smash 2017 conference at Baveno, Italy.
  
= Currect version of the format of NMReDATA =
+
The SDF file alone (that is without the spectra) cannot be used to verify that the assignment corresponds to the spectra. It is therefore important to always have the spectra with the SDF file! We call ''"NMR Record"'' the combination of the spectra and the SDF file.
The format can be found here : [[NMReDATA tag format]]
 
  
[[V0.98|Changes to V 0.98]]
+
A 1.1 version was released to fix a problem in 1.0.
  
 +
Version 2.0 adds extensions and was released after the [[Symposium2019|'''1st NMReDATA symposium''']] (Sept. 16, Porto, Portugal).
  
= Certification=
+
= NMR records =
 +
<!-- [[commented_example_nmredata|Examples of commented and simplified NMREDATA tags ]] -->
  
When the assignment is made using a computer assisted manner, the software may want to add a certification of the validity of the data. This should be (up to the manufacturers) to somehow encode it to make it impossible to forge the certification (using hashtag, etc. ?)
+
We call "NMR record", a folder (or .zip file including the folder) or a database record including:
Certificates TAGS could be listed at the end of the .sdf file. They can originate from the CASE software or from the database hosting the data and spectra, from the journal (to say data were peered reviewed). They can be cumulated. If the text of the .sdf file needs to be hashed for certification, the list of TAG used for hashing could be listed. (I’m not sure what needs to be done to certify the validity of certificates. To be refined by the certificate specialists).
 
  
>  <NMREDATA_CERTIFICATION>
+
1) All the NMR spectra (including FID, acquisition and processing parameters). The format of these data is as produced by the manufacturer of the instrument which acquired the data. That means that software generating the data either has these crude data available or it will ask the user to point to the crude data in order to include them in the ''NMR record''.  
Software=CMC_assist
 
Author=Bruker
 
Confidence_level=4.6
 
Confidence_level_certificate=”ADFS678AG67DFG6SD5F7GS5DFGSD8F5GSD7FG7”
 
Unique_solution=YES
 
Unique_solution_certificate=”ADFS678AG67DFG6SD5F7GS5DFGSD8F5GSD7FG7”
 
ETC...
 
  
This is only a very vague example. The uniqueness of the structure proposed may be understood in the sense of J.-M. Nuzillard’s LSD tool. Software producers can tell what needs to be done for their format. Multiple certification can be listed one after the other. The “Software=...” assignment separates them all in the same <CERTIFICATION> tag.
+
2) The SDF file(s) including the NMReDATA (''.nmredata.sdf'' file)
= Role(s) and scope of the “assignment records”  =
 
  
The NMR record can be generated from experimental data but also from simulations, predictions, etc. Tools to compare, evaluate, validate, and check consistency of “assignment records” will certainly be developed. Assignment records can be generated by commercial software, but also by diverse tools analysing NMR data, homemade processing tools, simulation software, etc. This is why it is important to have a format of data including a maximum of options to be as flexible as possible, even if not all possible uses are clearly defined and used immediately. Ideally, the .sdf files should be converted into other file format or spectral description without loss.
 
  
We should see as an advantage if the databases include multiple "assignment records" associated to the same molecule. Some could be old, originating from, incomplete literature data. Others could include errors because they originate from bulk data processed automatically. But finally a computer could verify and nicely validated record combining all the other data. Aggregated record could be generated by NMR software/database scoring available data for consistency, calculated chemical shifts and spectral simulations. They could refine chemical shifts and couplings, etc.
+
[[File:nmr_record.png|600px|center|NMR record]]
 +
A more detailed picture (see [[File:test-2.pdf|600px|center|pictorial representation of NMR record and example of SDF file]]) was presented in the [http://nmredata.org/euromar_2017_v5_optimized.pdf poster] presented in July at the Euromar 2017. '''Note:''' The NMREDATA tag "SIGNALS" was renamed "ASSIGNMENT" in Version 0.98.
  
==Report assignment from experimental data==
 
  
When the NMR data originate from experimental spectra, they may be quite crude (simple automated integration, peak-picking) or follow complex automated or manual analysis. The data may be partial, incomplete, contain inconsistencies, impossible features, etc.  The content may be diversely complex depending on the origin of the data:
+
NMR records will be [http://onlinelibrary.wiley.com/doi/10.1002/mrc.4631/full requested by ''Magnetic Resonance in Chemistry''] from 2018 on. The editors of software (ADC/Labs, Bruker, cheminfo, Mestrelab) are able to grenerate MNR records.  
- only 1D 1H NMR data (with or without integration, coupling, etc).
 
- only 1D 13C data (just from a simple peak peaking)
 
- only 1D data  but for multiple isotopes (from NMRshiftDB ?)
 
- full analysis based on computer-assisted software (such as Bruker cmc-se ACDLabs Structure Elucidator or Mestrelab Mnova) or web-platform (cheminfo.org)
 
- 1D and 2D data processed automatically with ambiguities on the signal assignment and partial (for example not all signals are assigned) and/or ambiguous (due to lack of resolution, or other problems)
 
- The file may not contain the actual assignment, only the structure and the list of chemical shift (the assignment could be added by NMR tools).
 
- The data may come from scientific report i.e. the text providing the description of the spectra. It could be like the one of the text of the following figure
 
( from http://onlinelibrary.wiley.com/doi/10.1002/mrc.4527/full).
 
 
Scripts could be written to convert such a "pure text" description into .sdf file and include the .mol file.
 
- For assignment work made with only "paper and pencil", a simple webtool allowing to draw a molecule, enter lists of signal names and 2D correlation could be easily made. We could consider to accept .pdf or pictures of the spectra when the original files do not exist anymore.  
 
  
Synthetic/predicted data
+
Records will be either analysed on web pages, or downloaded, and the nmredata.sdf file opened by the software which will access automatically to the associated spectra.
  
The NMR data may originate from DFT calculations or any other type of predictor of chemical shifts, and/or coupling. In such a case, a general tag is added to provide information about the software. For example:
+
The full description can be found [[NMReDATA tag format|in the NMReDATA tag format page]].
  
>  <NMREDATA_ORIGIN>
+
An example ('''probably obsolete''') of .nmredata.sdf files with the spectra can be found [https://www.dropbox.com/sh/hu0qudy2bt56ix0/AACc8UiUoeEskSDVhYnP-cZna?dl=0 here]
Source=Calculation
 
method=DFT
 
Geometry=method/basis set
 
Shielding=method_basis set
 
Coupling=method_basis set
 
Software=...
 
Version=...
 
  
==Literature data==
+
A better source is the [https://github.com/NMReDATAInitiative/Examples-of-NMR-records GitHub example page] of the [https://github.com/nmredatainitiative GitHub page of the Initiative].
  
When the NMR data originate from publications, a reference to the published paper/book/thesis are given in the NMREDATA_LITERATURE tag.
+
== Mixtures of compounds ==
 
+
When more than one compound is present in a sample, multiple .sdf are produced and called compound1.nmredata.sdf, compound2.nmredata.sdf, etc.
>  <NMREDATA_LITERATURE>
+
= Current version of the format of NMReDATA =
Source=Journal
+
The format can be found here : [[NMReDATA tag format]]
DOI=DOI_HERE (if Reference field is DOI specify it here)
 
CompoundNumber=label used in the reference to designate the compound (typically a number in boldface)
 
 
 
>  <NMREDATA_LITERATURE>
 
Source=Book
 
ISBN=ISBN_HERE (if Reference field is DOI specify it here)
 
CompoundNumber=label used in the reference to designate the compound (typically a number in boldface)
 
 
 
>  <NMREDATA_LITERATURE>
 
Source=Thesis
 
Thesis=HTML link here (if available if not "LastName, Firstname(s), institution providing the degree, city, country, year of publication.
 
CompoundNumber=label used in the reference to designate the compound (typically a number in boldface)
 
 
 
For revised/update data
 
 
 
Assignment records may be generated after revision from experimental, literature, prediction data, etc. Ideally, the original .sdf files should be also generated to facilitate comparison or exists somewhere and be referred to. In both cases reference should be given.
 
 
 
>  <NMREDATA_UPDATE>
 
Source=Record
 
Record_number=ref_to_the_original_record (multiple reference is allowed for aggregation of records – separated by “,”).
 
Date =date.... standard format for date
 
Correction="fixed assignments of C(13) and C(15)"
 
This is also to be refined according to future developments.
 
 
 
 
= Problems related to symmetry =
 
 
 
This section is tentative... to be worked on in the future....
 
  
For symmetrical molecules a difficulty arises to code coupling and 2D correlations.
+
Various examples of NMReDATA files can be found in the [https://github.com/NMReDATAInitiative/Examples-of-NMR-records github repository].
1) Problem for coupling: For the 1H spectrum of 1, 2 dichlorobenzene, we have two signals (two different protons in an AA’XX’ system) so if the SDF file includes two signals  (one for A and one for X), in principle one can only give one coupling: the J(A,X). But we should be able to give other coupling constants with respect to the prime H. When only one symmetry property is present, it may not be too difficult to include in the format a manner to provide pairs of couplings instead of only one, but with more than one symmetry, it would become complicated…
+
= Database =
2) Problem for correlations. Consider 1, 4 dichlorobenzene, a 3J(C,H) HMBC correlation will be visible between a proton that seems to be the directly bound-carbon. Because the carbons 1J and 3J bond, relative to a proton are symmetrical.
+
The NMReDATA Inititiative define the format and rules for hosting and provide data, but hosting data is not part of our mission.  
  
We have three different possibilities:
+
Discussion on [[database_policy | about database providers ]]
1) Ignore the problem. It may not be so serious in fact. In systems with non-magnetically equivalent spins, the coupling structures are complex and the coupling will probably not be measured in routine exp. Concerning the HMBC correlation, the HMBC correlation will be ambiguous and it will be to the person/software checking consistency, i.e. to see that when signals correspond to more than one proton or more than one carbone, it suffice that one of the possible combination of Hortho, H’ortho and Cortho and C’ortho corresponds to 3JCH and the check is passed… even if it also pass a check for 1JCH.
 
2) Duplicate all signals (or the subset with symmetry). If we list two signals (with two different labels) for Hortho and H’ortho, then we will have no problem anymore with coupling (one will be able to give a J(A, X) and (JAX’) and ambiguous correlations (they will be OK) . But the problem may be that for any chemical shifts, there will always be two labels/spins and that may cause confusion for the assignment software. The complications may be worse than the problem.
 
3) Try to face the problem and develop a serious method to include symmetry… Could be the object of future work.
 
  
 +
=  Versions =
 +
==Changes to Versions 1.1 ==
  
P.S. Some names are somewhat tentative. We don’t necessarily mean to define 3D spectra here or projections of 3D to 2D (HSQC-TOCSY). The list is mostly to test the ability of the format to list as many experiments as possible with the same logic.
+
*[[end-of-line | Addition of backslash]] at the end of the line of  NMReDATA tags.
  
= Why not adding more data in NMReDATA tags? =
+
==Changes to Versions 2.0 ==
  
We consider that our task is to focus on NMR data. But SDF files could (and should!) also include other experimental data such as:
+
*Possibility to include Jcamp spectra on top of original data from the instrument.
 +
*Possibility to add a 3D structure (on top of the "flat" 2D structure).
 +
*Possibility to add author and institution information (to facilitate integration of these metadata in repositories).
  
1) The origin of the molecule. This may include the extraction method and the plant it originates from, in phytochemistry, or the reaction producing it.  
+
For details, see [[NMReDATA_tag_format_2.0|the specification]].
  
2) MS data  
+
==Changes to Versions 2.1 (future version)==
 +
<span style="color:#FF8C00">  ''Future version of the format! Suggestions are welcome! '' </span>
 +
*Possibility to include [[Jassign|J-coupling assignment data]] (coupling network and J-graph data).
  
3) other spectral data
+
Discussion and complete list on [[Future version| future versions of the NMReDATA format ]]
  
In principle authors can add any tag provided they have tools to do it and requests from the Journals... such data could have the following form...
+
= Jmol integration in this wiki =
 +
NMReDATA is being integrated with [[Jmol |  Jmol/JspecView ]]
  
The software producing SDF files including NMReDATA, should read SDF files and write SDF files only adding (or modifying/reviewing) the NMReDATA data.
+
= Publications =
 +
* NMReDATA, a standard to report the NMR assignment and parameters of organic compounds. M. Pupier et al. (2018) Magnetic Resonance in Chemistry 56:703-715. doi: [https://doi.org/10.1002/mrc.4737 10.1002/mrc.4737]  PMID: 29656574
 +
* NMReDATA: Tools and applications. S. Kuhn et al. (2021) Magnetic Resonance in Chemistry 59:792-803. doi: [https://doi.org/10.1002/mrc.5146 10.1002/mrc.5146]  PMID: 33729627

Latest revision as of 21:42, 17 February 2024

Quick links

Direct link to the page describing the format of the NMREDATA tags (version 1.0/1.1) and format of the NMREDATA tags (version 2.0).

List of compatible software and webtools

Tentative instruction for journal submission of NMReDATA.

Link to the GitHub page of the NMReDATA Initiative.

Introduction

The NMReDATA working group decided to include data extracted from NMR spectra of small molecules in SDF files using SD tags.

Link to the MRC article on the NMReDATA format.

An important task of the group is to define the format of the content of the "<NMREDATA_...>" tags. More details here!.

The version 1.0 has been decided in September at the "Round table" of the Smash 2017 conference at Baveno, Italy.

The SDF file alone (that is without the spectra) cannot be used to verify that the assignment corresponds to the spectra. It is therefore important to always have the spectra with the SDF file! We call "NMR Record" the combination of the spectra and the SDF file.

A 1.1 version was released to fix a problem in 1.0.

Version 2.0 adds extensions and was released after the 1st NMReDATA symposium (Sept. 16, Porto, Portugal).

NMR records

We call "NMR record", a folder (or .zip file including the folder) or a database record including:

1) All the NMR spectra (including FID, acquisition and processing parameters). The format of these data is as produced by the manufacturer of the instrument which acquired the data. That means that software generating the data either has these crude data available or it will ask the user to point to the crude data in order to include them in the NMR record.

2) The SDF file(s) including the NMReDATA (.nmredata.sdf file)


NMR record

A more detailed picture (see File:Test-2.pdf) was presented in the poster presented in July at the Euromar 2017. Note: The NMREDATA tag "SIGNALS" was renamed "ASSIGNMENT" in Version 0.98.


NMR records will be requested by Magnetic Resonance in Chemistry from 2018 on. The editors of software (ADC/Labs, Bruker, cheminfo, Mestrelab) are able to grenerate MNR records.

Records will be either analysed on web pages, or downloaded, and the nmredata.sdf file opened by the software which will access automatically to the associated spectra.

The full description can be found in the NMReDATA tag format page.

An example (probably obsolete) of .nmredata.sdf files with the spectra can be found here

A better source is the GitHub example page of the GitHub page of the Initiative.

Mixtures of compounds

When more than one compound is present in a sample, multiple .sdf are produced and called compound1.nmredata.sdf, compound2.nmredata.sdf, etc.

Current version of the format of NMReDATA

The format can be found here : NMReDATA tag format

Various examples of NMReDATA files can be found in the github repository.

Database

The NMReDATA Inititiative define the format and rules for hosting and provide data, but hosting data is not part of our mission.

Discussion on about database providers

Versions

Changes to Versions 1.1

Changes to Versions 2.0

  • Possibility to include Jcamp spectra on top of original data from the instrument.
  • Possibility to add a 3D structure (on top of the "flat" 2D structure).
  • Possibility to add author and institution information (to facilitate integration of these metadata in repositories).

For details, see the specification.

Changes to Versions 2.1 (future version)

Future version of the format! Suggestions are welcome!

Discussion and complete list on future versions of the NMReDATA format

Jmol integration in this wiki

NMReDATA is being integrated with Jmol/JspecView

Publications

  • NMReDATA, a standard to report the NMR assignment and parameters of organic compounds. M. Pupier et al. (2018) Magnetic Resonance in Chemistry 56:703-715. doi: 10.1002/mrc.4737 PMID: 29656574
  • NMReDATA: Tools and applications. S. Kuhn et al. (2021) Magnetic Resonance in Chemistry 59:792-803. doi: 10.1002/mrc.5146 PMID: 33729627