@patcon pull requests are definitely welcome. I think it would be great if there were some sections around y'all's work in the current list. Contributing document would be great as well.

Thanks for this @patcon this all looks great!

We want to support tool adoption and development (for all, not just IIPC members) but we've had trouble maintaining our tools lists over long periods of time. The old Tools page on the IIPC website had become hopelessly outdated, and having been involved with this kind of thing before (here's the relevant part of yet another tool registry called COPTR), I've been wary of setting up anything too complex/burdensome.

This is why we've ended up with a relatively brief 'awesome list' rather than something more detailed and comprehensive (like that superb spreadsheet of yours).

So, given all this, how about we try working together as follows:

First, we (IIPC) more clearly define the scope of our awesome list and contribution process (thanks for the template!).

We then aim to include (all/most?) tools in both resources, but the IIPC Awesome List focuses on giving a brief description of each in prose, and defers to your either of your spreadsheets for more details (where available). We might mention which IIPC members are using which tools, but that's about it.

Does that sound like a reasonable approach, for now at least? We're open to anything that will help build some community momentum in this area!

I've made first pass and improving the list. Feedback welcome.

I'll look at the CONTRIBUTING.md when I get time.

@anjackson Yup, what you describe sounds reasonable. When I first saw the awesome list, I wondered if that and the spreadsheet should be merged somehow, but then realized that the awesome list provides something the spreadsheet doesn't: a curated list of software grouped by purpose, with short summaries of each software package. It also has information about resources other than software. So, they each have their role.

One thing we're thinking of doing for the spreadsheet is to create a front-end form to enter the information. This would make it easier to fill out entries, and would also improve the correctness of the entries by giving people better guidance about the information being sought. (The latter by virtue of the fact that in a web form, one can explain in more detail the info being sought.) It might also help with crowd-sourcing the data entry.

Anyway, thanks for being willing and interested in connecting these resources!

I am an open data fan, and so am pondering whether the README could be generated from more structured CSV data, so long as it's a subset... ;)

(I like the idea of a world where pretty human-friendly awesome lists are generated from structured data, be that yaml or csv or whatever.)

For posterity, there are a bunch of these lists floating around, to varying degrees of accuracy:

• https://github.com/pirate/ArchiveBox/wiki/Web-Archiving-Community
• https://github.com/datatogether/research/tree/master/web_archiving#comparison-of-web-archiving-software
• http://netpreserve.org/web-archiving/tools-and-software/
• http://coptr.digipres.org/Category:Web_Crawl
• https://lifehacker.com/the-best-tools-to-archive-web-pages-1794802605
• and many more...

I also made an attempt at combining them all here: https://www.reddit.com/r/DataHoarder/wiki/software#wiki_website_archiving_tools
awesome-web-archiving seems like a really good list to keep up-to-date though, because it's indexed via the lists-of-lists network that is awesome-lists.

Are we good to close this one? We have a CONTRIBUTING.md, pull requests are always open, and we're in the process of resolving #48.