New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Peak List research - results error #154

Open
BBonnefille opened this Issue Dec 20, 2018 · 13 comments

Comments

Projects
None yet
4 participants
@BBonnefille
Copy link

BBonnefille commented Dec 20, 2018

Hi,

I would like to report a bug concerning the" Peak List search" tool since the update of the website.
The results scores are all set at "0.9999" and the results are not corresponding to those given by the previous version of MassBank.
Here is an example of 1/ pick list search results for oxazepam for the previous version of the website (5 top results with a deacreasing score), 2/ same search with the new version (5 top results, no oxazepam proposed in resultats and all scores at 0.9999)

Thank you in advance,
B. Bonnefille

1/ Results for oxazepam MS2 spectra with the previous version of MassBank

1 oxazepam - old version

2/ Results for (the same) oxazepam MS2 spectra with the new version of MassBank

2 oxazepam - new version

@sneumann

This comment has been minimized.

Copy link
Member

sneumann commented Dec 20, 2018

Thanks for reporting, we'll try to reproduce and come back to you.
Yours, Steffen

@sneumann

This comment has been minimized.

Copy link
Member

sneumann commented Dec 23, 2018

Hi, can you provide us with an exact query to reproduce this ?
I used the Example1 with all defaults, and got different result scores. yours, Steffen

@BBonnefille

This comment has been minimized.

Copy link

BBonnefille commented Dec 27, 2018

Hi Steffen,
Thank you for your reply.
I do not have access to my data until January 8. I will send you the data used to reproduce the request as soon as possible.
Yours, Bénilde Bonnefille

@BBonnefille

This comment has been minimized.

Copy link

BBonnefille commented Jan 8, 2019

Hi Steffen,
As discussed, you will find attached the data entered for the query for which I obtained the above results. The search was carried out using the default parameters for an analysis in positive ionization mode with an ESI source (all MS levels). The data are presented as pairs m/z / intensity ratio without any pre-selection of the experimental data.
Yours, Bénilde
MS2_oxazepam.txt

@schymane

This comment has been minimized.

Copy link
Member

schymane commented Jan 18, 2019

@meier-rene or @Treutler or @sneumann or others - any progress here?
We have just received emails to check progress; an update would be great. Thanks!

@meier-rene

This comment has been minimized.

Copy link
Contributor

meier-rene commented Jan 18, 2019

I guess its my pleasure to fix this. I already found the code location and its more complicated than I thought in the first moment. The program actually calculates a score and its not only 0.999, other results do also appear. Its just not correct or at least not identical to the results we could obtain with the old version. I have to trace were the numbers come from and I need to compare them with a few examples I calculate by hand following the original MassBank publication.

@meier-rene

This comment has been minimized.

Copy link
Contributor

meier-rene commented Jan 24, 2019

Hi, I think we could fix this problem and its online available on our development server https://msbi.ipb-halle.de/MassBank/ . Could you please test there and report your findings?

@meier-rene

This comment has been minimized.

Copy link
Contributor

meier-rene commented Jan 24, 2019

Minor issue found: The 'Instrument Type' selection is not taken into account.

@BBonnefille

This comment has been minimized.

Copy link

BBonnefille commented Jan 24, 2019

Hi,
First, thank you four the feedback.
I just did the requested test, and it seems much better! (see search results below)
However, the results are different from those obtained with the previous version: the highest score is not the same as on the results initially obtained (first example in the first message of this discussion), and the best "match" does not correspond to the same MassBank spectrum although the research data are identical. Unless these spectra have been removed from MassBank, there may still be a problem there?

Concerning the 'Instrument type': the results does not show any problem of instrument type selection, I only get results in ESI, as requested (for the first 20 results).

image

@BBonnefille

This comment has been minimized.

Copy link

BBonnefille commented Jan 24, 2019

I wrote too quickly: I confirm the 'Instrument type' selection problem. I requested only (LC-)ESI-QTOF results (always with the oxazepam data) and obtained all the ESI Instrument type results.

@meier-rene

This comment has been minimized.

Copy link
Contributor

meier-rene commented Feb 1, 2019

We have deployed a new code base on our test system. Please try! We are quite confident, that the results of the similarity score and the number of hits are now equal within the accuracy of the algorithm compared to the old version. Nevertheless you will find some minor differences in the floating point numbers, but that's not very unusual after a refactoring of code, a change of java version, different operating system and different hardware. Floating point operation have always a limited accuracy.
Nevertheless there is a difference in number of matched peaks for your example (fig. below) which we can not explain. I'm wondering how you could obtain a hit count of 86 for the second hit in the old Massbank if the query spectra has only 82 peaks. There is something strange with this numbers. 82 is definitely the max with your attached spectra. Maybe the old MassBank was giving incorrect values for this field...
screenshot_2019-02-01 massbank database quick search results
)

@schymane

This comment has been minimized.

Copy link
Member

schymane commented Feb 1, 2019

Thank you very much for your efforts @meier-rene
Look forward to hearing the feedback from @BBonnefille to see if this indeed resolves the issues they experienced

@BBonnefille

This comment has been minimized.

Copy link

BBonnefille commented Feb 1, 2019

Hi, I performed the test as requested and I get results in agreement with those obtained before the update of MassBank (I get the same results that the ones you attached).
Thank you for all the work you have done to correct the issues we have encountered.
I hadn't noticed the problem of the number of hits that seems to be solved with the corrected version you propose. Perhaps this problem was due to the difference in the acquisition mode of the reference spectrum data versus the submitted data (low resolution in opposition to high resolution).
Thank you again,
Bénilde

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment