Rethinking the 3DS (DLC) DAT

General No-Intro related discussions.
Post Reply
jimmsu
Datter
Posts: 442
Joined: 14 May 2010 22:14

Re: Rethinking the 3DS (DLC) DAT

Post by jimmsu » 28 Jan 2018 00:17

[quote="Hiccup"]yeah but should cetk be in every revision or just the original one?[/quote

in all.
And also make a directory , so when you unpack all files are in it.

like this:

000300044B323250/tmd
000300044B323250/cetk
000300044B323250/00000000

And with rev like this

000300044B323250_v1024/tmd
000300044B323250_v1024/cetk
000300044B323250_v1024/00000000


And wich rev format you gonna use :

hex 0400 or dec 1024

Hiccup
Datter
Posts: 269
Joined: 09 Oct 2015 11:29

Re: Rethinking the 3DS (DLC) DAT

Post by Hiccup » 28 Jan 2018 13:34

1. won't that waste space?
2. won't it be in a directory anyway because there are multiple files? (like xbox dlc)
2a. if that folder is needed, would it auto-update its name to match the entry name?
2b. why is the "_titleversion" needed in the folder name?
3. decimal, because that is how the tmd filenames display it and it is the most commonly known

jimmsu
Datter
Posts: 442
Joined: 14 May 2010 22:14

Re: Rethinking the 3DS (DLC) DAT

Post by jimmsu » 29 Jan 2018 23:07

Hiccup wrote:1. won't that waste space?
2. won't it be in a directory anyway because there are multiple files? (like xbox dlc)
2a. if that folder is needed, would it auto-update its name to match the entry name?
2b. why is the "_titleversion" needed in the folder name?
3. decimal, because that is how the tmd filenames display it and it is the most commonly known

2 you need to make a dir like the xbox
2a without folder , when unpacking multiple files you will overwrite other ones.
2b , when you unpack the same games , the _titleversion will not overwrite the other.

3 oke

Hiccup
Datter
Posts: 269
Joined: 09 Oct 2015 11:29

Re: Rethinking the 3DS (DLC) DAT

Post by Hiccup » 30 Jan 2018 22:11

okay, but does DoM have a feature that auto-renames the folder to match the entry name?

gamecaptor
Posts: 210
Joined: 16 Jul 2010 06:27

Re: Rethinking the 3DS (DLC) DAT

Post by gamecaptor » 30 Jan 2018 23:23

I'm glad to see there is still discussion around this.

So is the consensus to keep the RAW (folder/file) format vs the .cia format?

Getting caught up on the recent conversation, the plan is to keep them in a folder/file structure, so would it make sense to use something similar to Wii U USB Helper?
Yoshi's New Island [0004000000111B00]\
00000000.app
00000001.app
00000002.app
title.tik
title.tmd

And likewise for the update/DLC files?

User avatar
xuom2
High Council
Posts: 1062
Joined: 22 May 2008 18:45

Re: Rethinking the 3DS (DLC) DAT

Post by xuom2 » 31 Jan 2018 18:45

Hiccup wrote:1. won't that waste space?
no, it's the best idea (used with .rap files in pns encrypted sets).
Hiccup wrote:but does DoM have a feature that auto-renames the folder to match the entry name?
actually not. it could be implemented but it's more easy to directly add folder name to database.
"test" system is open for temporary experiments, anyway I will assist the initial import of data.
DOM can import a Dir2DAT XML file.
gamecaptor wrote:So is the consensus to keep the RAW (folder/file) format vs the .cia format?
it's not really a "versus", but a new (additional) set of datfiles in this format, proposed by Hiccup. actually this set is "ready" on DOM but empty.
if there is enough interest to attract datters... I have only time and knowledge to keep the tech stuff working and help with imports.
gamecaptor wrote:the plan is to keep them in a folder/file structure
Yoshi's New Island [0004000000111B00]\
00000000.app
00000001.app
00000002.app
title.tik
title.tmd
my suggestion:
Yoshi's New Island.zip contains:
0004000000111B00\00000000.app
0004000000111B00\00000001.app
0004000000111B00\00000002.app
0004000000111B00\title.tik
0004000000111B00\title.tmd

Hiccup
Datter
Posts: 269
Joined: 09 Oct 2015 11:29

Re: Rethinking the 3DS (DLC) DAT

Post by Hiccup » 31 Jan 2018 19:52

not sure if there is any need to add the ".app" to the contents or the "title." to the ticket/tmd - it might be better to leave it as it is on the server.

@xuom2
when making a dir2dat dat, should each "Game Name (Region) (Revision)" folder have a "TitleID_TitleVersion" subfolder with the contents in? or must that be done in DoM?

User avatar
xuom2
High Council
Posts: 1062
Joined: 22 May 2008 18:45

Re: Rethinking the 3DS (DLC) DAT

Post by xuom2 » 31 Jan 2018 20:36

two ways.
- you prepare on your disk the folders (like ASJICI23MC91VNNQ\*), then zip them, rename the zip (like "Zelda (Europe).zip") and do the dir2dat
- you have zipfiles with no folders but the zipfilenames are in a format that during the import I can split to the correct fields (like Zelda (Europe) (ajjf9nbqobnubu3).zip).
To sum up: send me any format, I will fix it for the import. After a first batch job, single future dumps need to be added via the usual way.
The result should be something like I just added to zTEST.

Hiccup
Datter
Posts: 269
Joined: 09 Oct 2015 11:29

Re: Rethinking the 3DS (DLC) DAT

Post by Hiccup » 01 Feb 2018 12:10

Do I have to zip the "Game Name (Region)" folders or can I send them to you as folders? I guess I just use clrmamepro to zip everything?

jimmsu
Datter
Posts: 442
Joined: 14 May 2010 22:14

Re: Rethinking the 3DS (DLC) DAT

Post by jimmsu » 02 Feb 2018 12:12

Hiccup wrote:Do I have to zip the "Game Name (Region)" folders or can I send them to you as folders? I guess I just use clrmamepro to zip everything?
you prepare on your disk the folders (like ASJICI23MC91VNNQ\*), then zip them, rename the zip (like "Zelda (Europe).zip") and do the dir2dat


so make dir
put the files in it
zip dir
rename zip to name the game is
do this with all the files
and with clrmamepro do dir2dat
send the file to xuom2

norkmetnoil577
Datter
Posts: 16
Joined: 20 Aug 2016 21:30

Re: Rethinking the 3DS (DLC) DAT

Post by norkmetnoil577 » 03 Feb 2018 06:01

You don't even need to zip, you can do CMP dir2dat on folders so it's easier to rename and move things around. make sure to allow long paths by input \\?\C:\My Directory\...

directory Yoshi's New Island (Europe) (En,Fr,De,Es,It) contains:
0004000000111B00\00000000
0004000000111B00\00000001
0004000000111B00\00000002
0004000000111B00\title.tik
0004000000111B00\title.tmd
(this is without .app extension)

As for appending the "version as _v1024 etc... I know that download tools do this, but does the system itself recognize this natively or is this just something the tools use to not overwrite then they have to be renamed in order to use? For example, if there is only one version v16 existing, if I try to just download the latest version, it will give me 0004000000111B00\ but if I specifically put in v16 it will give 0004000000111B00_v16\ which is ambiguous, so we would have to have a rule like "every folder has a version" or "no folder has a version"

jimmsu
Datter
Posts: 442
Joined: 14 May 2010 22:14

Re: Rethinking the 3DS (DLC) DAT

Post by jimmsu » 03 Feb 2018 15:29

norkmetnoil577 wrote:You don't even need to zip, you can do CMP dir2dat on folders so it's easier to rename and move things around. make sure to allow long paths by input \\?\C:\My Directory\...

directory Yoshi's New Island (Europe) (En,Fr,De,Es,It) contains:
0004000000111B00\00000000
0004000000111B00\00000001
0004000000111B00\00000002
0004000000111B00\title.tik
0004000000111B00\title.tmd
(this is without .app extension)

As for appending the "version as _v1024 etc... I know that download tools do this, but does the system itself recognize this natively or is this just something the tools use to not overwrite then they have to be renamed in order to use? For example, if there is only one version v16 existing, if I try to just download the latest version, it will give me 0004000000111B00\ but if I specifically put in v16 it will give 0004000000111B00_v16\ which is ambiguous, so we would have to have a rule like "every folder has a version" or "no folder has a version"

About the version number youre right.
Some only have one version like v16 , but there are others that have many diferent versions.

So think we need to say first what are we going to do :

0004000000111B00\tmd as with v0
0004000000111B00_v16\tmd as with v16

rule like "every folder has a version when there are more then one"

And tmd is just tmd like it will be on the server

gamecaptor
Posts: 210
Joined: 16 Jul 2010 06:27

Re: Rethinking the 3DS (DLC) DAT

Post by gamecaptor » 04 Feb 2018 08:19

I don't know that adding the version to the file name is completely necessary. If you look at the normal ROMs and they way they are handled, the primary/first has no numbering (presumed v1) and any additional versions then get it amended (v2, v3, etc). I would just assume keeping that model.

When it comes to the case of DLC or updates would be the exception. In those instances it should be added always.

Side question (that I probably asked before but can't remember the answer), is there a tool to convert RAW to CIA format? The downside to RAW format is the usability; in that state you can't really do anything with it so the ability to convert it to a CIA would be useful.

jimmsu
Datter
Posts: 442
Joined: 14 May 2010 22:14

Re: Rethinking the 3DS (DLC) DAT

Post by jimmsu » 04 Feb 2018 16:14

gamecaptor wrote:I don't know that adding the version to the file name is completely necessary. If you look at the normal ROMs and they way they are handled, the primary/first has no numbering (presumed v1) and any additional versions then get it amended (v2, v3, etc). I would just assume keeping that model.

When it comes to the case of DLC or updates would be the exception. In those instances it should be added always.

Side question (that I probably asked before but can't remember the answer), is there a tool to convert RAW to CIA format? The downside to RAW format is the usability; in that state you can't really do anything with it so the ability to convert it to a CIA would be useful.
Cardridges have rev00 , rev01, rev02 and so on.

Eshop uses different version v0 , v16, v32, v64, v1024, v1040, v1056, v1072 , v2080, v2096 , v2112, v2191,v3120 and so on.

And there are some eshop games that have many versions , so when you have 10 same dirs and you want to unpack those , you will get some overwrite files.
Adding the _v to the dir will solve that problem.

Hiccup
Datter
Posts: 269
Joined: 09 Oct 2015 11:29

Re: Rethinking the 3DS (DLC) DAT

Post by Hiccup » 04 Feb 2018 22:11

The 0 , v16, v32, v64, v1024, v1040 etc naming shouldn't be used for names as it isn't consistent. Revisions should: they revisions are still used internally (in the binaries and when developers submit revisions), and they make sense.

Post Reply