hi @Peilin-Yang we discussed on Slack, but I still don't think we should check in the duplicate qrels into the repo... why not just add something like this?

filenames = ['file1.txt', 'file2.txt', ...]
with open('path/to/output/file', 'w') as outfile:
    for fname in filenames:
        with open(fname) as infile:
            outfile.write(infile.read())

ref: https://stackoverflow.com/questions/13613336/python-concatenate-text-files

That is, if the concatenated qrels doesn't exist, create them...