Wii U Database?

Post all database contributions here.
Post Reply
User avatar
DeriLoko3
Posts: 85
Joined: 28 Oct 2015 07:53

Wii U Database?

Post by DeriLoko3 » 18 Apr 2018 09:24

Not the CDN-stuff. We want to have just a Wii U DLC database. Something like a retro Wii U Virtual Console database.

User avatar
xuom2
High Council
Posts: 827
Joined: 22 May 2008 18:45

Re: Wii U Database?

Post by xuom2 » 18 Apr 2018 18:02

why not :9

User avatar
xuom2
High Council
Posts: 827
Joined: 22 May 2008 18:45

Re: Wii U Database?

Post by xuom2 » 18 Apr 2018 18:06

on a side note: we can fill DOM with every data we want (example: add game names) simply as placeholder, excluded from datfile.
when dumps are known/available, you can add such data and include it in datfile.
this is how undumped lists can be always online on database.

Hiccup
Datter
Posts: 505
Joined: 09 Oct 2015 11:29

Re: Wii U Database?

Post by Hiccup » 18 Apr 2018 20:35

how exactly can it be DLC but not raw CDN? Wii U doesn't have a CIA equivalent AFAIK.

User avatar
DeriLoko3
Posts: 85
Joined: 28 Oct 2015 07:53

Re: Wii U Database?

Post by DeriLoko3 » 19 Apr 2018 08:49


jimmsu
Posts: 377
Joined: 14 May 2010 22:14

Re: Wii U Database?

Post by jimmsu » 19 Apr 2018 19:41

But virtual console is only a small part off the DLC.

And the best way is to do the CDN , because of the existing tools for installation

User avatar
xuom2
High Council
Posts: 827
Joined: 22 May 2008 18:45

Re: Wii U Database?

Post by xuom2 » 19 Apr 2018 20:33

I think Hiccup and Jimmsu are (and this happens often :P) correct. Plus, Deriloko added the fake dump :P and who knows how many more will add in the future :P :P
But, correct me if I am wrong: like we have "encrypted" and "decrypted" PS3 we can have the "lame" DLC and the CDN DLC, or?

(in an ideal world, PS3 should be merged and encrypted/decrypted should be a download option, but it's impossible now due to tech reasons)

Whovian9369
Datter
Posts: 70
Joined: 09 Sep 2016 18:36

Re: Wii U Database?

Post by Whovian9369 » 20 Apr 2018 04:51

My 2 cents is to honestly just mass-download from the CDN as best as we can for a "Wii U (CDN)" DAT.

To use the USA version of Shovel Knight as an example of what I'd personally be thinking:

Code: Select all

000500001016E100/00000002.app
000500001016E100/00000004.app
000500001016E100/00000004.h3
000500001016E100/00000005.app
000500001016E100/00000005.h3
000500001016E100/00000006.app
000500001016E100/00000006.h3
000500001016E100/00000007.app
000500001016E100/00000007.h3
000500001016E100/00000008.app
000500001016E100/00000008.h3
000500001016E100/0000000b.app
000500001016E100/0000000c.app
000500001016E100/0000000d.app
000500001016E100/0000000D.h3
000500001016E100/0000000e.app
000500001016E100/0000000f.app
000500001016E100/0000000F.h3
000500001016E100/title.cert
000500001016E100/title.tmd
This WOULD separate the updates from the base game, but not terribly. (000500001016E100 versus 0005000E1016E100)

Hiccup
Datter
Posts: 505
Joined: 09 Oct 2015 11:29

Re: Wii U Database?

Post by Hiccup » 20 Apr 2018 07:46

You can see the 3DS, DSi and Wii CDN dats for examples of how it can be done. They are very incomplete as no batch downloading was involved :P

Whovian9369
Datter
Posts: 70
Joined: 09 Sep 2016 18:36

Re: Wii U Database?

Post by Whovian9369 » 20 Apr 2018 17:37

Oh for sure. I forgot that the Wii U did separate by a version string (v80 as an example), so I do think that the other DATs are good examples at the moment for "doing it right" for the U too.

User avatar
DeriLoko3
Posts: 85
Joined: 28 Oct 2015 07:53

Re: Wii U Database?

Post by DeriLoko3 » 21 Apr 2018 07:12

Well, I found http://www.abgx.net (the one that has the Wii U database) and http://rom-news.org (the one that also has the Wii U database and the Switch database).

Hiccup
Datter
Posts: 505
Joined: 09 Oct 2015 11:29

Re: Wii U Database?

Post by Hiccup » 21 Apr 2018 12:10

What has lists of scene releases got to do with this?
The only CDN stuff that scene releases have is unpacked files, which can be created from the actual CDN data easily.

norkmetnoil577
Datter
Posts: 20
Joined: 20 Aug 2016 21:30

Re: Wii U Database?

Post by norkmetnoil577 » 22 Apr 2018 04:21

Whovian9369 wrote:
20 Apr 2018 04:51
My 2 cents is to honestly just mass-download from the CDN as best as we can for a "Wii U (CDN)" DAT.

To use the USA version of Shovel Knight as an example of what I'd personally be thinking:

Code: Select all

000500001016E100/00000002.app
000500001016E100/00000004.app
000500001016E100/00000004.h3
000500001016E100/00000005.app
000500001016E100/00000005.h3
000500001016E100/00000006.app
000500001016E100/00000006.h3
000500001016E100/00000007.app
000500001016E100/00000007.h3
000500001016E100/00000008.app
000500001016E100/00000008.h3
000500001016E100/0000000b.app
000500001016E100/0000000c.app
000500001016E100/0000000d.app
000500001016E100/0000000D.h3
000500001016E100/0000000e.app
000500001016E100/0000000f.app
000500001016E100/0000000F.h3
000500001016E100/title.cert
000500001016E100/title.tmd
This WOULD separate the updates from the base game, but not terribly. (000500001016E100 versus 0005000E1016E100)
I think this sounds good, and I like it better to have that top level folder than just having all the files in one folder as bsbt dat has it. But what about title.tik? If these can be deterministically redumped it is a way to know what is preserved and what is an encrypted hunk of data still needing to be dumped.

I am also uncertain about the _v123 suffix. If a title is dumped at one point in time when there is no update, and then later on an update gets added, the original name would change. I am not sure how they are stored on the server but I would name as 000500001016E100 and keep the (v16) (v64) to the name.

I had on my "to do" list to rename the bsbt dat with all of the IDs as a top level folder (e.g. 000500001016E100/0000000.app) for a mass import, but it keeps getting put off, in case anyone else wants to.

FYI about decrypted, I think with certain jnus tool and all of the relevant keys, it can be downloaded/extracted into "code" "content" and "meta" folders. .rpx executable is in "code" folder. I think a key is needed to do this (except for updates maybe). This may be more "emulator ready" but since we are concerned with preservation if we get a better encrypted format that is still usable we want emulators to be made to support that, not the other way around.
Hiccup wrote:
21 Apr 2018 12:10
What has lists of scene releases got to do with this?
The only CDN stuff that scene releases have is unpacked files, which can be created from the actual CDN data easily.
If the unpacked files can really be made from CDN data (I assume this needs a tik too though, which would need to be datted as well) then that is good and CDN sounds superior, but it may be service to the community to dat both, I don't know.

Whovian9369
Datter
Posts: 70
Joined: 09 Sep 2016 18:36

Re: Wii U Database?

Post by Whovian9369 » 22 Apr 2018 05:44

norkmetnoil577 wrote:
22 Apr 2018 04:21
I think this sounds good, and I like it better to have that top level folder than just having all the files in one folder as bsbt dat has it. But what about title.tik? If these can be deterministically redumped it is a way to know what is preserved and what is an encrypted hunk of data still needing to be dumped.

FYI about decrypted, I think with certain jnus tool and all of the relevant keys, it can be downloaded/extracted into "code" "content" and "meta" folders. .rpx executable is in "code" folder. I think a key is needed to do this (except for updates maybe). This may be more "emulator ready" but since we are concerned with preservation if we get a better encrypted format that is still usable we want emulators to be made to support that, not the other way around.
Title.tik:
Now are we talking "real" eShop TIKs, with per-console data zeroed out?
Then there's the disc TIK files, that are valid for all consoles, but only work for that exact TitleID (since Wii U uses the same TID and Keys for the eShop and Disc versions) and those would only be there for games that aren't eShop Only.
Or should there just be tickets that are "bare minimum" allowed? (Ones that are just based on disc tickets and modified to have the TID and key of the appropriate title?)

Decryption of CDN files:
  • JNUSTool and CDecrypt (I would PERSONALLY compile CDecrypt.) can both decrypt CDN downloads.

    But yeah, you'd get three folders:
    • code
    • content
    • meta
    Code normally has the executable files (The rpx file is the main executable... but I never really poked at it personally.)
    Content is normally the game asset files (basically the 3DS/Switch romFS imo)
    Meta is, in my experience, the Title information, home menu logo, etc.
    (If anyone wants to correct me on this or anything, PLEASE feel free to)

    And if you have the titlekey, you can decrypt the CDN Downloaded files to those three folders.
    Oh and there is also a WiiU Titlekey site that has a lot of em, so that's not a TOTAL issue.
    So preservation of those is pretty easy once you have the encrypted files.

    Oh yeah, I BELIEVE that the Update title just takes ll the updates for one single download. (wording's weird there, sorry :P)

Hiccup
Datter
Posts: 505
Joined: 09 Oct 2015 11:29

Re: Wii U Database?

Post by Hiccup » 22 Apr 2018 08:54

IMO, cetk (the CommonETicKet - used for system titles) should be included, because it is on the server.
There is project for collecting the title keys on the web (search "wii u title key"), so I'm not sure there is much point in making a project for those.

Post Reply