Monday, January 1, 2018

TLMC v.19 (2018.01.01)

This is the 19th version of Touhou Lossless Music Collection torrent, current total file size ~1.75 TiB. Download and seed. If you have an older version, you can update it with this script (run the script in the torrent directory after stopping the old torrent but before starting new torrent). The script renames files/directories which had their names updated at some point in time - if you don't run this script you'll end up with some duplicates.
As always cuesheets are located in a separate 7z archive - when extracted into the torrent directory it places cuesheets in proper places.

Main torrent (7z with cues and *.tta files):
Touhou lossless music collection v.19 (1.65 TiB or 1 817 738 246 162 bytes).
Torrent file size is 9 604 641 bytes.
Magnet link.

Pictures torrent (cover/booklet scans):
Touhou album image collection v.19 (76.5 GiB or 82 153 065 676 bytes).
Torrent file size is 4 582 077 bytes.
Magnet link.

Supplementary materials (everything else - pdf booklets, bundled wallpapers, lyric texts, other extras):
TLMC supplementary materials v.19 (24.2 GiB or 25 978 962 058 bytes).
Torrent file size is 2 200 879 bytes.
Magnet link.


Additional links:
Touhou wiki
Album wiki
Online player with direct downloads

Fun facts: This is the largest update to date, at about 375 GB it is almost twice as big as the whole TLMC v.01.
Not so fun facts: It also took the most time.

Special thanks to:
- friends at toholmc.com, who provided about 760 links to tta+cue albums, which is a majority of albums in this update (if you're reading this, please learn how to input all unicode characters instead of replacing them with question marks and underscores because going through ALL cue sheets fixing errors by hand is seriously tiring; also 3 albums were missing cue sheets and them being single-track is not an excuse to omit cues and 2 or 3 images were in the album archives they didn't belong to and 1 album contained a duplicate of another instead of what its name indicated and since crappy 400px covers do not replace proper scans why even bother putting them in ...).
- friends at bbs.moem.cc, who provided about 90 links to wav+cue albums (remaining 900 links are unfortunately either trash mp3, unavailable or already present in this torrent).
- several baidu users and baidu search engines which indexed their links
- all original album rippers
- all touhou doujin circles
- and you!

A bonus for everyone who patiently waited for this release: discographies of artists every man of culture should listen to and enjoy.

Hatsuki Yura complete lossless discography, excluding collaboration albums (ones where she sings like 1 track out of 10; all albums listed in the Circle section on the artist site at the moment of this post are present).
Data size is 15.9 GiB or 17 080 348 619 bytes.
Magnet link.
It comes with two relatively minor issues:
1. "HAMELN Limitedver" album has two glitches because the fileshare kept giving me the same broken file (made about 30 attempts in hopes of hitting another CDN shard, each time file hash was the same). Although I could technically try to recover it by checking for all single bitflips in each block (fortunately the archive package had zero compression), doing this with reversed specs of a closed-source format is rather annoying so I didn't bother.
2. "RAPT AQUARIUM" album was reconstructed from split tracks without the rip log, so there is some chance pre-gaps are missing.

Cuesheets are located in a separate 7z archive, just like with TLMC.

FEEDBACK REQUESTS
1. For circles with names in kana/kanji I looked at the circle websites. If they used an english version of the circle name then I used that as a spelling hint/alternate name in directory name: "[main name] alt.name". The rest I've left as-is.
What are your thoughts on adding alternate english names to all circles?
Pros: it would make navigating directory structure and referencing circle names easier for those who don't know/are bad with kana/kanji.
Cons: running rename script would be effectively mandatory, at least for that one transition, and straightforward name translation or transliteration might not mean exactly what artist intended. It would also break your existing playlists.
2. There is a large amount of recent rips which are sadly shared as separate flac tracks with no rip logs. For now they are not included in TLMC.
What are your thoughts on gluing them back into CD images and adding those to the torrent?

FAQ
Q: Why TTA and not FLAC?
A: Two reasons, one historical and one technical.
Historical one is that a huge chunk of early albums were in tta, so to be consistent about the codec I converted the rest (mostly ape) into tta and then the majority of albums were also shared as tta, so less work for me. The technical one is that I like tta better. Flac is open source and rather popular, it's the most popular lossless format on a lot of metrics, which is a big reason to adopt it. Tta is also opensource and less popular, but not completely unknown, and several of its design decisions (whether intentional or accidental) stand out to me as flat out better. These are: only one compression level and no embedded metadata support*. According to my preferences this outweighs flac's popularity.
* Mixing immutable data with metadata is a big no-no in my eyes and leads to disappointment and sad kittens. You wouldn't make a kitten sad, would you?

Q: Why album+cue and not split tracks?
A: Audio CD has one track that encodes its entire LPCM data stream. Track breaks are the metadata content.

Q: Why are cuesheets included as an archive instead of as is?
A: So that you would be able to edit them (for whatever reason, such as finding a mistake) and not break the whole torrent.

Q: When will the next version get released?
A: I am searching for a better way to share TLMC and lossless doujin music in general. While bittorrent somehow manages to get job done it is (and always been) a wrong tool for this purpose. Sadly it is good enough, so very few are pressured to develop better alternatives. With that in mind...
Best case scenario: A p2p similar to what I described in my May post gets developed and the need for this aggregator torrent is gone, as all future albums that get ripped and shared appear and are available on it, immediately and permanently.
Realistic scenario: TLMC v.20 in summer-winter 2019.
Worst case scenario: Everything is eaten by grey goo.

Q: Anything I can do to help?
A1, Easy mode: Seed.
A2, Normal mode: Compile a list of "file+cue" albums that can be downloaded on the internet but are missing in TLMC and send me links to them. "Can be downloaded" part is pretty important here.
A3, Hard mode: Buy missing albums, rip with EAC in secure mode and a proper drive read offset to single file tta+cue (or single file wav+cue if you're too lazy to run tta encoder, or single file flac+cue if you're already used to flac), then share on any reasonable host (mega preferred, mediafire is fine too; but even a bad host is better than no host at all, just make sure it doesn't require registration - these ones I drop on sight) and post a link. Even better if you can scan the booklet and covers (don't overkill like, ahem, certain someones; 600 dpi is surely enough).
Alternatively, find out how to contact nekomimi Alice and participate in toholmc group buys.

And finally, if you liked the music, please support its authors!

81 comments:

  1. Hey rwx, the script was having an issue for me. I got it to work by changing your print statements to have .encode('utf-8') at the end of the variable parameters in the print functions.

    Thanks for all your work and have a great 2018.

    ReplyDelete
    Replies
    1. I tried to test on non-unicode locale and it exploded outright, UnicodeEncodeError in os.stat(path). Can I see your LC env vars? ...wait, is it Win or Lin?

      Delete
    2. I was using Windows 10. It was failing, giving me a UnicodeEncodeError as well until I set those .encode calls.

      Delete
  2. Is this real life? Glad to see you're still keeping up with this rwx. Thanks for all the hard work.

    ReplyDelete
  3. Downloading now-- I'm looking forward to poking around and seeing what's been newly added!

    In late 2016 I linked you eight albums + scans via the TLMC 18 comment thread, but it looks like they didn't make it into this torrent D: Just curious, did they not meet your criteria? Here are the original comments, in case you missed them:

    http://www.tlmc.eu/2015/06/tlmc-v18-20150630_89.html?showComment=1470099764762#c8921280663972057497

    http://www.tlmc.eu/2015/06/tlmc-v18-20150630_89.html?showComment=1470149298495#c1596769720583075358

    ReplyDelete
    Replies
    1. (*seven, not 8) Oh and, I should add: it's totally fine if you missed my original post, I just wanted to make sure you got the downloads this time.

      The N-tone album link is broken because I fixed a typo and re-uploaded. Here's the updated link:

      https://mega.nz/#!d14BgAhS!TTYnqgtAKJm4dzrYii9w5WMurrkNYDOuajAGCuhp68c

      Delete
    2. There is absolutely nothing wrong with them, apparently I just missed them (and a couple of others).
      I'll do something to my addition process so that this crap happens less often.

      Delete
    3. No worries-- I've posted all my downloads in the Doujinstyle forums too. So it's not like people will have to wait until 2019 to get them, haha.

      Thanks again for the big update!

      Delete
  4. OMG. Best new year gift ever.

    ReplyDelete
  5. Could somebody upload the cue sheet 7z to mega? I don't have 1.75TiB of free space to store this whole thing so I'm doing partial seeding and that file just refuses to download even after 20 hours of having it on Highest priority.

    ReplyDelete
    Replies
    1. Apparently my rtorrent has some problems with DHT. I'll fix it ASAP.

      Delete
    2. Just got it, I'll throw it up on mega in case there's another issue in the future just because it's easy enough to do.
      https://mega.nz/#!RE9nybra!zfpJ_ezrFQ89jayklMD7wk7PQin75Nv8wlsmvwX2PGE

      Delete
  6. constantly seeding but torrent is stuck on 81.4% for 2 days now.

    ReplyDelete
    Replies
    1. Just as I was going to ask if anyone at all was downloading, because I'm not seeing any connections...

      Delete
    2. I only see a seed on 葉月ゆら

      Delete
    3. Might be my other client, but it should not be a full seed, I just entered my external IP manually and downloaded one 7z file to check if rtorrent can talk to other peers.

      Delete
    4. My rtorrent was somewhat ancient and I didn't want to upgrade the box OS because of usual stability precautions (it runs my entire storage after all) and also because it would pull systemd mess in, so I just compiled the most recent rtorrent and its library.
      IT DIDN'T HELP. Something is seriously wrong here...

      Delete
    5. I have great upload (~300mbps) if I can somehow get the diff from tlmc18

      Delete
    6. I only managed to download 21GB of difference from v17 and completely stuck now. I can see plenty of other people stuck on 81.4% too.

      Delete
    7. Since now I'd prioritize getting it done over figuring out how to fix it you may try manually adding my IP as a peer, which will hopefully work until it changes.
      46.188.29.202

      Delete
    8. Oh, it also needs port, which I'll arbitrarily set to 6987 (turns out you commented on this already).

      Delete
    9. Is that your DHT port or your torrent listening port? I believe we need the DHT port.

      Delete
    10. No-no-no, you'd need torrent port and that's my torrent port. But I think I understand where did I fail, and why adding IP now won't work and why everything including DHT will work when a make a change to my iptables DNAT rules.

      Delete
  7. How do we fix it then?

    ReplyDelete
    Replies
    1. Girls do their best now and are preparing. Please wait warmly until it is ready.

      Delete
    2. You don't, it was entirely on my end.
      And fixed.

      Delete
    3. Currently downloading. Ty. :)

      Delete
    4. Confirmed working now, thanks.

      Delete
    5. Also downloading! Now I have to see if I can free up enough space on my seedbox.

      Delete
  8. It would be nice if few years since the release of this torrent there was a working torrent client for windows.
    uTorrent 2.2 was the last one that worked perfectly fine. Latest qBittorrent constantly crashes and then rechecks entire folder.

    ReplyDelete
    Replies
    1. This comment has been removed by the author.

      Delete
    2. I do not encounter any problems with latest qBittorrent. :/

      Delete
  9. I've been waiting for this.
    Thanks rwx.

    ReplyDelete
  10. old files in the new torrent only have changes to the filename and not the data itself right?

    ReplyDelete
    Replies
    1. Yes, that's how it is supposed to be. I think I didn't even rename the files, only directories.

      Delete
  11. Got the thing mostly converted to Opus at my streaming site: http://151.80.40.155/

    I haven't really advertised too much, but it's like otokei which is dead. Except I'm using Opus@128kbps rather than MP3. I'd be happy if you put in the initial post like otokei was :)

    I still have to do about 30 or so albums manually because shnsplit doesn't like them for some reason.

    Some errors I found:
    [DiGiTAL WiNG]/2013.05.26 [DWCD-0008] BEST OF WiNG [例大祭10]/DiGiTAL WiNG - BEST OF WiNG Special Non-Stop Version.cue
    This is probably the biggest one: The tta seems to be cut short. I'm missing anything pass those tracks since shnsplit errors out.

    [N-tone]/2013.08.12 [NTCD-0007] FAIRY BREATH [C84]/CUESheet.cue
    Not a big one, but the filename's extension in the cue doesn't match the case sensitivity of the actual file.

    In the previous TLMC comments I mentioned an album with a different cue and tta name, and you said filename is in the cue anyways. I accounted for that in my script this time and there's only 7 albums that have a different name there.

    Also [Floating Cloud]/2011.12.30 [FLCD-016] 幻想郷事変 [C81] has a tab character in track 4's name!

    ReplyDelete
    Replies
    1. >Opus@128
      This planet is not completely hopeless yet.
      Good job, that's exactly what I'd choose.

      >I still have to do about 30 or so albums manually because shnsplit doesn't like them for some reason.
      Try to check for single quotes, wide spaces and similar unusual stuff in filenames. At least there are no newlines :)

      >the filename's extension in the cue doesn't match the case sensitivity of the actual file.
      Ah, I shouldn't have trusted foobar which followed retarded Windows "our filenames are case-sensitive in the FS, but we'll pretend they are not" policy and happily loaded incorrect cuesheet.
      Point taken, I made a script that checks for proper names and will run it before each release.
      Right now it sees 2 unmatched files (both because of case):
      [N-tone]/2013.08.12 [NTCD-0007] FAIRY BREATH [C84]/FAIRY BREATH.TTA
      [岡垣正志&フレンズ]/2011.05.01 [KPCR-119S] EDGE OF THE WORLD -SCARLET FANTASIA VIII- [M3-27]/Edge Of The World -SCARLET FANTASIA VIII-.tta

      >there's only 7 albums that have a different name there.
      Hm, maybe I'll just rename them for consistency then.

      >has a tab character in track 4's name!
      Overall 26 instances of tabs, 9 cuesheets. Will probably update them all.

      Delete
    2. >Good job, that's exactly what I'd choose.
      Yep. I even redid it since the last torrent because Opus 1.2 was released in the meantime, and is supposed to be an improvement.

      >Try to check for single quotes, wide spaces and similar unusual stuff in filenames. At least there are no newlines :)

      Finally had some time to look through it, it seems to be because shnsplit doesn't recognize the audio as CD-quality: "shnsplit: error: m:ss.ff format can only be used with CD-quality files" is the error I get.

      I checked the file and it's 48 kHz rather than Redbook's 44.1 kHZ. Any idea what is up with that?

      Some of them are:
      [COOL&CREATE]/2015.08.14 [CCCD-0036] くーくり博麗フェスティバル [C88]/COOL&CREATE - くーくり博麗フェスティバル
      [LiLA'c Records]/2015.08.14 [LLAC-0021] TOHO SPEED 04 [C88]/LiLA'c Records - TOHO SPEED 04

      Delete
    3. [Loli-Hunter Music]/2012.07.09 [LHCD-TH007] Bring Back the '98!/Bring Back the '98!.cue
      [Loli-Hunter Music]/2012.08.22 [LHCD-TH008] Distant Again/Distant Again.cue
      [Loli-Hunter Music]/2012.11.10 [LHCD-THS003] 文の唄/Loli-Hunters - 文の唄.cue

      shnsplit complains that these cuesheets are not proper mm:ss:ff : They contain ffs > 74.

      Delete
    4. >I checked the file and it's 48 kHz rather than Redbook's 44.1 kHZ. Any idea what is up with that?
      Probably direct mastering (without releasing a CD). I also remember there was one "high-def" audio in an outright insane standard: 24 bits or 96 kHz sampling freq. or something. Started with a "d".

      I scanned the entire TLMC for outliers, there are 23+2+1+1 uncommon headers.
      23 are 48 kHz instead of 44.1:
      [COOL&CREATE]/2015.08.14 [CCCD-0036] くーくり博麗フェスティバル [C88]/COOL&CREATE - くーくり博麗フェスティバル.tta
      [LiLA'c Records]/2015.08.14 [LLAC-0021] TOHO SPEED 04 [C88]/LiLA'c Records - TOHO SPEED 04.tta
      [Re:Volte (Scinicade (SonicRevolution))]/2015.08.14 [SORR-00125] 東方入眠抄7 ~小傘ちゃんと雨の音に包まれて~ [C88]/Re-Volte - 東方入眠抄7 ~小傘ちゃんと雨の音に包まれて~.tta
      [Re:Volte (Scinicade (SonicRevolution))]/2015.08.14 [SORR-00127] 夢想星霜集2 Lupus-オオカミ- [C88]/Re-Volte - 夢想星霜集2 Lupus-オオカミ-.tta
      [SYNC.ART'S]/2015.08.14 [SACD-5037] U.N.REAL [C88]/SYNC.ART'S - U.N.REAL.tta
      [sound sepher]/2015.08.14 [SEPR-0024] 東方幻奏祀典11''Libretto'' [C88]/sound sepher - 東方幻奏祀典11''Libretto''.tta
      [TAMUSIC]/2015.08.14 [TAM3-0133] 東方バイオリンロック花-HANA- [C88]/TAMUSIC - 東方バイオリンロック花-HANA-.tta
      [TATAMI STUGIWO]/2015.08.14 お部屋のBGMにしたい東方アレンジシリーズ4まだお昼休みではないはずですよね [C88]/TATAMI STUGIWO - お部屋のBGMにしたい東方アレンジシリーズ4まだお昼休みではないはずですよね.tta
      [まぃん☆しぃかぁ]/2015.08.14 Sensing [C88]/まぃん☆しぃかぁ - Sensing DISC1.tta
      [まぃん☆しぃかぁ]/2015.08.14 Sensing [C88]/まぃん☆しぃかぁ - Sensing DISC2.tta
      [マッカチン企画]/2015.08.14 [MCK-0012] DIVE INTO STARSHIP [C88]/マッカチン企画 - DIVE INTO STARSHIP.tta
      [君の美術館]/2015.08.14 [MUSE-0023] Blazing Soul - アシンメトリィ [C88]/君の美術館 - Blazing Soul - アシンメトリィ.tta
      [東京アクティブNEETs]/2015.08.14 [ANCD-0017] 東方爆音ジャズ8 風 [C88]/東京アクティブNEETs - 東方爆音ジャズ8 風.tta
      [株式会社虎の穴] とらのあな/2015.08.14 [TORA-00131] 東方幻奏響UROBOROS肆 ~dEATHtINYoVERdRIVE~ [C88]/とらのあな - 東方幻奏響UROBOROS肆 ~dEATHtINYoVERdRIVE~ DISC1.tta
      [株式会社虎の穴] とらのあな/2015.08.14 [TORA-00131] 東方幻奏響UROBOROS肆 ~dEATHtINYoVERdRIVE~ [C88]/とらのあな - 東方幻奏響UROBOROS肆 ~dEATHtINYoVERdRIVE~ DISC2.tta
      [株式会社虎の穴] とらのあな/2015.08.14 [TORA-00131] 東方幻奏響UROBOROS肆 ~dEATHtINYoVERdRIVE~ [C88]/とらのあな - 東方幻奏響UROBOROS肆 ~dEATHtINYoVERdRIVE~ DISC3.tta
      [株式会社虎の穴] とらのあな/2015.08.14 [TORA-00131] 東方幻奏響UROBOROS肆 ~dEATHtINYoVERdRIVE~ [C88]/とらのあな - 東方幻奏響UROBOROS肆 ~dEATHtINYoVERdRIVE~ DISC4.tta
      [A-GEAR]/2015.08.14 レイシィ・サーヴァント [C88]/A-GEAR - レイシィ・サーヴァント.tta
      [Accord on Codes]/2015.08.14 Secret Jazz Club [C88]/Accord on Codes - Secret Jazz Club.tta
      [Chronographic Records]/2015.08.14 [CRCD-0001] Semiglossy Heartbeat [C88]/Chronographic Records - Semiglossy Heartbeat.tta
      [High Onatious State Theory]/2015.08.14 Festa Diagram [C88]/High Onatious State Theory - Festa Diagram.tta
      [monoralGrey]/2015.08.14 Heavy Gauge [C88]/monoralGrey - Heavy Gauge.tta
      [外柿山]/2015.08.14 [TGCD-0013] 東方邦楽集2 [C88]/外柿山 - 東方邦楽集2.tta

      2 are 24 bits instead of 16:
      [Dxtliant Child]/2009.12.30 Utopia Far East [C77]/Utopia Far East.tta
      [Dxtliant Child]/2010.08.14 The Hagoromo of the sky [C78]/The Hagoromo of the sky.tta

      1 and 1 are false positives (ID3-tag at the start of a file):
      [Loli-Hunter Music]/2009.11.22 [LHCD-THS002] Kreton vs DJ Werwolf - Lullaby from Hell/Lullaby from Hell.tta
      [とほほお~けすとら]/2010.09.18 とほほお~けすとら -STAGE 2- [例大祭SP]/STAGE 2.tta

      >shnsplit complains that these cuesheets are not proper mm:ss:ff : They contain ffs > 74.
      "Loli-Hunter Music is a Polish net label". Yep, these are not rips too, they just used some broken software to generate cuesheets for their FLAC release. The albums you listed are the only ones with this problem.

      Delete
  12. I have been attempting to download this for a few days, but I'm not finding any peers through DHT except for the supplementary materials (those finished and I'm seeding them).

    Any tracker or peers I could add? rwx's IP seems to no longer work, get a connection refused.
    Thanks!

    ReplyDelete
    Replies
    1. All swarms are pretty healthy at the moment, can you try a different client?

      Delete
    2. I came back to my computer a bit ago and noticed all torrents were downloading properly, maybe it was some network issue (my ISP is doing some hardware maintenance the past week or so)

      Thank you for this great release! I will make sure to keep seeding it when it is done.

      Delete
    3. I am getting 0 peers over DHT as well (with PicoTorrent), not sure what the problem is. It is still downloading, though it does seem like I am only getting incoming connections and no outgoing ones are being established. Downloaded 132 GB since 6th and uploaded over 1 TB.

      Wonder if PicoTorrent has issues with DHT…

      Delete
  13. OMG THX THX THX

    ReplyDelete
  14. what do you recommend for splitting the .tta on windows?

    ReplyDelete
    Replies
    1. I'd use Linux console tools in VBox if I ever needed mass splitting and native foobar for single album.

      Delete
    2. Btw, with that said, I'd recommend not splitting at all and getting player which supports cue+file instead.

      Delete
    3. why do you not recommend splitting it? isn't it technically the same thing? there's no loss in data or quality at all right

      Delete
    4. For example, if any cuesheet turns out to be wrong then you would have to worry about more than just editing cuesheet in question.

      Delete
  15. Just finished updating. I'll be seeding until the end of time.

    Thank you so much <3

    ReplyDelete
  16. I am downloading v18 and it became quite slow a couple days ago.
    Is there any way for me to download the v19 without losing those files downloaded in v18?
    I'm using Deluge.

    ReplyDelete
    Replies
    1. If you switch to v19 you won't lose _files_ per se, but you will lose some progress because of block boundary mismatch (one of questionable decisions of protocol authors to go with single stream for multifile torrents).
      I think a rule of thumb is that completion of x (between 0 and 1) on older torrent will turn into completion of x^2*(new_size/old_size) on newer torrent.
      Unless you're on extremely slow internet I'd recommend switching right away. You could remount volume as readonly and verify new torrent over old files to check how much progress you'd lose.

      Delete
    2. Gah, x^2*(old_size/new_size), obviously.

      Delete
    3. Already switched to v19! I thought Deluge would wipe all my previous files, but after a long check it continued to download. Smart!

      Delete
    4. It should work, assuming the bits in the files are still the same. If the hashes match, the checking will be complete and it'll simply resume from where you left it last time.

      Delete
  17. Thanks for the great work! And a few things I would like to ask:

    1. As you mentioned in "feedback request" about gluing the separate flac tracks back into one CD image. I know very little about the codec thing, but is that even possible without the rip log? And the image you generate in this way, can it be burnt back to a CD?
    I ask this because I consider your reason for not using flac means that you want to keep the albums just the way they are in discs, not something we use for listening on other devices. If so, gluing the tracks back will not generate the original image, will it?

    2. I noticed you said that you get some resources from baidu users. Does it mean that you have an access to baidu net disk share links? If so, maybe I can provide you with more resources in that way. And if not, maybe I can try to move some resources from baidu to mega if you wish?

    3. Is there a more convenient way to contact you other than commenting here?

    ReplyDelete
    Replies
    1. >1. As you mentioned in "feedback request" about gluing the separate flac tracks back into one CD image. I know very little about the codec thing, but is that even possible without the rip log?
      Of course it is. You can trivially concatenate arbitrary audio files together.

      >And the image you generate in this way, can it be burnt back to a CD?
      Yes, it can, CD Audio is content-agnostic. Just read the Redbook specs on wikipedia if you wish to learn the details.

      >I ask this because I consider your reason for not using flac means that you want to keep the albums just the way they are in discs, not something we use for listening on other devices. If so, gluing the tracks back will not generate the original image, will it?
      Nope, the reasons for preferring tta over flac are all there in the post. Gluing the tracks will generate something that is pretty close to the original.

      >2. I noticed you said that you get some resources from baidu users. Does it mean that you have an access to baidu net disk share links? If so, maybe I can provide you with more resources in that way. And if not, maybe I can try to move some resources from baidu to mega if you wish?
      Last update is >90% baidu-sourced.
      All my baidu links are public, so I wouldn't call that "access". If you have good links that I somehow missed then by all means, post them (in batches).

      >3. Is there a more convenient way to contact you other than commenting here?
      Commenting here is fine for me.

      Delete
    2. >Gluing the tracks will generate something that is pretty close to the original.
      If you don't mind gluing the track, then I can do that to the resources I get and re-share them here. Will it help? or would you like to do it yourself?
      Currently I have about 20 albums from Reitasai14 which are separated flac tracks and not in TLMC. I'm still checking for the older ones.

      >All my baidu links are public, so I wouldn't call that "access".
      So you mean that you just download from webpages and don't have any baidu account, right?
      Well, downloading and sharing files between baidu accounts is much easier and less restrictive, but, never mind, public links are fine.

      Delete
    3. >Will it help? or would you like to do it yourself?
      I'll do it.
      >So you mean that you just download from webpages and don't have any baidu account, right?
      Yes, just feed the links to the downloader.
      >Well, downloading and sharing files between baidu accounts is much easier and less restrictive, but, never mind, public links are fine.
      While moving files between accounts might be faster, I'd still have to transfer them to my machine at some point.

      Delete
    4. >I'll do it.
      OK. Then I'll skip those ones.

      >While moving files between accounts might be faster, I'd still have to transfer them to my machine at some point.
      One of the most annoying thing about sharing through baidu public link is: the link can go dead easily, and once it's down, the file can never be shared again without changing its md5. And there's even some "key words" which may lead to instant fail of sharing if they are found in the filenames(for example, "舞風", which is a circle's name). But, again, never mind that :p

      Delete
    5. >and once it's down, the file can never be shared again without changing its md5
      That's super retarded if true.
      >And there's even some "key words" which may lead to instant fail of sharing if they are found in the filenames(for example, "舞風", which is a circle's name).
      Believable, but either wrong or underspecified. See http://www.yumuso.com/q/舞風

      Delete
    6. >Believable, but either wrong or underspecified. See http://www.yumuso.com/q/舞風
      It's not always true, but in most cases I'm sure. If you check those searching results you'll find many of them dead links.
      I noticed theses things because I used to share some of this circle's albums and kept failing immediately after the link generated. At last I had to change both the file name and content to make it work. There may be some other mechanisms behind that but it just behaves like what I've said.

      Delete
  18. Came here just to tell you that this is the greatest thing ever. I usually have to do manual tagging with mp3tag when downloading from rutracker etc but the tags in this torrent fit my autism perfectly.
    YOU ARE THE BESTEST

    ReplyDelete
    Replies
    1. Thanks, but actually TLMC metadata is a bit disorganized.

      Delete
    2. lolwut? there are no tags except for "Game" for some albums which makes no sense to me

      Delete
  19. Thank you for the release!
    I see the .cue sheets' weight is around 20MB, so it's easy to put them in a GitLab instance for editing (I doubt we can get away with it on GitHub for copyright reasons). Did you investigate my suggestion? We can get a TLMC community project going, first for the metadata, then moving on to the rest. Right now even discussing missing albums is difficult in the comments, the "issues" git feature would be cleaner.
    My fear is that we'll wait too much for a P2P silver bullet that never materializes. If we get the project started on GitLab we as a community can at least remove a bit of burden from your shoulders. I wouldn't mind offering a VPS instance for the cause. Maybe even a Resilio (Bittorrent Sync) machine for seeding updated data+metadata.

    ReplyDelete
    Replies
    1. >I see the .cue sheets' weight is around 20MB
      10MB
      >Did you investigate my suggestion?
      I answered about IPFS here http://www.tlmc.eu/2017/05/next-gen-p2p.html?showComment=1501926301817#c1327825449287267547
      >We can get a TLMC community project going, first for the metadata
      There is an album wiki (see main post), which is fairly complete, I even used some of its album codes after double-checking with suruga-ya.
      There is also vgmdb, which has less content but uses proper sql behind the scenes already.
      I think the easiest way to extract initial batch of metadata would be to convince either to add mass export of some sort, then to edit one could just register as user there and add changes as usual.

      Delete
    2. There's also https://touhou.arrangement-chronicle.com/ for metadata. Has plenty of information, but I do not know Japanese and am unsure about an API. Maybe will just have to scrape it.

      Delete
    3. I didn't know about it until now.
      Hmm, that's good. That's seriously good. Author of Opus DDL site, please take note (it would be great to be able to pick by vocalist, arranger or original track).
      I'd suggest to ask for the DB directly before resorting to scraping.

      Delete
    4. I am the maker of that site. Should probably stop being Anon.

      I don't know Japanese to ask for the DB. Also love to add more features to my site with the database.

      Delete
  20. I've finally made a plan on how to contribute to your work. Here's the plan:

    1. I've shared a folder on MEGA
    https://mega.nz/#F!bRpUgJpB!hA2VZZ8MkBM2n-YQAHiR5g
    which contains the following files:
    (1) An Excel document; it's a list of all the albums I have but not in TLMC.
    (2) Album files; only the "one file+cue" albums are uploaded.
    Considering my limited space and poor upload speed on MEGA, the separated flac tracks will not be included, perhaps you already had most of them.
    In case that you need some of those flac albums, their baidu links are listed in the Excel document as well.

    2. As I keep searching for missing albums in TLMC, the files in this folder will be updated gradually.
    Each time I think there are already quite a lot missing albums found, I'll updated the list file and make a new post here to inform you about it. So you don't have to check this folder constantly.

    If you have any comments or suggestions to this plan, just tell me about it. I really hope I can help.

    By the way, do you know where to find nekomimi Alice's new share lists after Reitasai14? His homepage stopped updating for some reason and he has moved to some other platforms recently. He said he would contact you soon but I haven't seen his post here yet.

    ReplyDelete
    Replies
    1. >2. As I keep searching for missing albums in TLMC, the files in this folder will be updated gradually.
      >If you have any comments or suggestions to this plan, just tell me about it. I really hope I can help.

      Thanks. Can you please do a csv or tab-delimited or any other plaintext format instead and stuff in into some text storage service? Here are three, github can even version-control the content:
      https://gist.github.com/
      https://privatebin.info/
      https://ghostbin.com/

      >By the way, do you know where to find nekomimi Alice's new share lists after Reitasai14? His homepage stopped updating for some reason and he has moved to some other platforms recently.
      I don't know.

      >He said he would contact you soon but I haven't seen his post here yet.
      He did? My chinese is limited to google translate and with that I didn't find any mentions on toholmc.

      Delete
    2. I meant plaintext instead of excel file (clarifying just in case).

      Delete
    3. >Can you please do a csv or tab-delimited or any other plaintext format instead and stuff in into some text storage service? Here are three, github can even version-control the content
      Sure. GitHub is fine for me. But I don't quite get your idea. You want me to post a new plain text list each time, which only contains the new missing albums I find since last post? or keep adding to one list and post here to announce significant updates? And the album files will still stored in net disks with their links listed in the file, right?
      I used an Excel file because I can order the list by different columns, and I intended to list albums from different events on different pages in order to keep each page short. But it seems that you have a different idea on how to organize the contents of the list, so I'd like to understand your opinions first.

      >I don't know.
      >He did? My chinese is limited to google translate and with that I didn't find any mentions on toholmc.
      Well, for now, the albums of C92, Autumn Reitasai&Koromu from his project can be found here:
      https://pan.baidu.com/s/1qYjw7q0
      https://pan.baidu.com/s/1miQlSSC
      https://pan.baidu.com/s/1skGrTKT
      These links can be found if you have a baidu account and subscribe him. And it is also showed on his WeChat public channel(if you know what that is). However, I think both ways are impossible for you so I've talked with him recently through instant messages. He just said he would contact you himself so I guess maybe he will find some way to share his resources with you, or maybe he will just continue updating his homepage some day.

      Delete
    4. >keep adding to one list and post here to announce significant updates? And the album files will still stored in net disks with their links listed in the file, right?
      This.

      >I used an Excel file because I can order the list by different columns, and I intended to list albums from different events on different pages in order to keep each page short. But it seems that you have a different idea on how to organize the contents of the list, so I'd like to understand your opinions first.
      You can do whatever is most convenient for you internally and then export.
      Actually, if it's once-a-month then don't bother, I'll use xls sheet.
      I just have a bit of personal dislike for spreadsheets because they occupy a tiny niche between plaintext lists and proper databases, software to work with them is significantly more bloated than either alternative and it's a pain to set up any kind of (non-manual) I/O with them.

      >Well, for now, the albums of C92, Autumn Reitasai&Koromu from his project can be found here:
      Whoa, last update could have been even bigger if I found it before. I'll grab the files once they fix my downloader.

      >These links can be found if you have a baidu account and subscribe him. And it is also showed on his WeChat public channel(if you know what that is). However, I think both ways are impossible for you
      Yup, I have neither wechat nor baidu account.

      >so I've talked with him recently through instant messages. He just said he would contact you himself some day.
      Oh, well, maybe he has his reasons.

      Delete
  21. Is there a non-official 320k MP3 version of this torrent? I don't have a single hard drive big enough to hold all of this :(

    ReplyDelete
    Replies
    1. Hopefully not.

      However, if you are simply looking for a lossy version of TLMC, and not specifically for the maximum stupidity lossy version, then there is a 128kbps Opus one. I don't know if it is shared as a torrent, though.

      Delete
  22. it'd be great if there was a list of new albums and updated albums... pls!

    ReplyDelete