DOM - things to do

Post bug reports and suggestions for the website, forums and DOM here.
Post Reply
User avatar
xuom2
High Council
Posts: 786
Joined: 22 May 2008 18:45

DOM - things to do

Post by xuom2 » 14 Apr 2018 18:36

1) DUMP STATUS *DONE*

the code that defines the rom status seems to be written 3 times and different in DOM (when I show the records, when I download the verifications, when I download the xml datfile)
we need to unify this code.

2) REDUMP *DONE*

In DOM there is an option to add a "redump", while at this point is better to submit simply "dump", and let DOM scan and define what is a "redump" and what not.

3) DATA IMPORT

I already load gameheader data (size, md5, etc) automatically, but not archive and source data.
i think that adding fields directly in the txt will save me the time of loading pages and interface and pushing buttons many times.

4) HIDDEN DATA

Will add a new field to ARCHIVE: hidden. Such items will disappear from the public eye.
Nothing secret here: simply work in progress data.

5) PRIVACY

at the moment nicknames are hidden, will show nicknames of users that agree to this.

6) BULK IMPORT OF MEDIA DATA

I will add support to csv import for MEDIA table.

7) the future *DONE*

But there is no support to 3 or more dump formats. Or to formats with different file structure.
For this reason actually we have 1 NDS set with decrypted/encrypted options and 2 separated PS3 sets.

User avatar
xuom2
High Council
Posts: 786
Joined: 22 May 2008 18:45

Re: DOM - things to do

Post by xuom2 » 16 Apr 2018 13:14

point (3): an initial version of this tool is online at SUBMIT / Upload Txt
other upload tools (dir2dat and pclone) were moved from ADMIN menu to SUBMIT menu.
feel free to check it but BE SURE YOU ARE USING THE ZTEST ROMSET!

User avatar
xuom2
High Council
Posts: 786
Joined: 22 May 2008 18:45

Re: DOM - things to do

Post by xuom2 » 08 May 2018 12:50

(out of the list)
Created a page for "reports". At the moment only one is available: missing and excluded archives.
You can find it under SEARCH / REPORTS.

User avatar
xuom2
High Council
Posts: 786
Joined: 22 May 2008 18:45

Re: DOM - things to do

Post by xuom2 » 10 May 2018 08:20

I know you don't care/understand but I see point 7 is really more urgent than expected.
It will do deep changes in the structure. I will try to debug as much as possible.
Of course data will be automatically converted.

At the moment the idea is to not link a file list directly to Source. A "container" should be linked to Source where you only declare the type of dump (encrypted, big endian, etc). Each specific file list will be linked at each container.

Datsets with only 1 type of rom (99%) will automatically get a container when you submit data. Should be the same for the other (n64, nds). Will do any efforts to avoid confusion.

With this move we can merge Sony enc/dec sets, and have more than 2 types of dumps. We can have a encrypted set with 1 file and for example the decrypted set with more files.

The negative result may be a tiny slowdown of the engine because we are adding a new "layer" to the data.

Will do experiments on local machine, and I will upload only when all is ready. For this reason the actual version of DOM won't get bugfixes and changes until I finish this point.

Screwtape
Posts: 30
Joined: 29 Aug 2017 08:46

Re: DOM - things to do

Post by Screwtape » 10 May 2018 11:49

Will this make it possible for the SNES set to have a "program ROM" file and zero or more "coprocessor firmware" files as part of the same game? Or the NES set to have separate "program ROM" and "character ROM" files?

User avatar
xuom2
High Council
Posts: 786
Joined: 22 May 2008 18:45

Re: DOM - things to do

Post by xuom2 » 10 May 2018 12:54

Exactly. We can have 1 Nes datfile with options to get a "merged" or "splitted" set (or as you want to name them).
At the moment it's impossible. At the moment you are limited to store 2 different hashes to the same file (like nds and n64).

User avatar
xuom2
High Council
Posts: 786
Joined: 22 May 2008 18:45

Re: DOM - things to do

Post by xuom2 » 19 Jun 2018 13:23

preview of DOM that will be able to support any number of dump formats, each one with any file format.
still testing, hope to upload near the end of this month.

Image
:trumpet:
Image
:trumpet:
Image
:trumpet:
Image
:trumpet:
Image

User avatar
xuom2
High Council
Posts: 786
Joined: 22 May 2008 18:45

Re: DOM - things to do

Post by xuom2 » 21 Jun 2018 10:16

Users and datters ask for special reports: I'm moving them all into a single place.

Image
:trumpet:

User avatar
Connie
Posts: 238
Joined: 20 Jun 2008 12:15

Re: DOM - things to do

Post by Connie » 22 Jun 2018 07:16

Good work!

Now we can add Wii ISO & ISO.DEC (NASOS) :love:

While I'm here, do you want the NFO files for Switch to add to DoM ?
Maybe an integrated viewer/downloader could be added for NFO ?

Hiccup
Datter
Posts: 527
Joined: 09 Oct 2015 11:29

Re: DOM - things to do

Post by Hiccup » 22 Jun 2018 17:49

Add Wii ISO? That's redump's thing :P. There isn't really any need for a No-Intro Wii dat. You should suggest they add iso.dec to their dat.

User avatar
xuom2
High Council
Posts: 786
Joined: 22 May 2008 18:45

Re: DOM - things to do

Post by xuom2 » 22 Jun 2018 18:00

No-Intro goal is world domination

User avatar
xuom2
High Council
Posts: 786
Joined: 22 May 2008 18:45

Re: DOM - things to do

Post by xuom2 » 23 Jun 2018 19:22

Advanced search will return.

Image
:trumpet:

Screwtape
Posts: 30
Joined: 29 Aug 2017 08:46

Re: DOM - things to do

Post by Screwtape » 24 Jun 2018 02:05

Are we at the point yet where the SNES set can include co-processor firmware with the games that need it, or is that a thing for later? If it's a later thing, is there anything I can do to help it along?

User avatar
xuom2
High Council
Posts: 786
Joined: 22 May 2008 18:45

Re: DOM - things to do

Post by xuom2 » 24 Jun 2018 07:21

I'm still preparing DOM for the technical upgrade, I hope ready near the end of this month.
It will be possibile to have any romdata format attached to any source, which means it could be possible to have NES and SNES with "spearate ROM files" or not, NES and FDS "headered" or not, we can merge PSN encrypted with decrypted, add CDN to decrypted datfiles, add 3 hashes to ique and n64, distinguish dump types of PSV, etc.
We will see if community will add such data :P

norkmetnoil577
Datter
Posts: 20
Joined: 20 Aug 2016 21:30

Re: DOM - things to do

Post by norkmetnoil577 » 24 Jun 2018 15:08

xuom2 wrote:
24 Jun 2018 07:21
I'm still preparing DOM for the technical upgrade, I hope ready near the end of this month.
It will be possibile to have any romdata format attached to any source, which means it could be possible to have NES and SNES with "spearate ROM files" or not, NES and FDS "headered" or not, we can merge PSN encrypted with decrypted, add CDN to decrypted datfiles, add 3 hashes to ique and n64, distinguish dump types of PSV, etc.
This looks amazing! We will be so high-tech. I love the ideas like headered dats, special coprocessors, fixing PSV.
xuom2 wrote:
24 Jun 2018 07:21
We will see if community will add such data :P
I am excited to work on a merged encrypted+decrypted WiiU set, finish decrypting the rest of PSP PSN and check for bad ones using our clean encrypted sources (as long as the initial merge is done since PSP decrypted is quite substantial) as first orders of business that come to mind.

Some sort of import mechanism will need to be worked out since currently even if the names are the same new sets are created on .dat import. Maybe an option to "merge sets with identical names", or even if bulk import is not possible, to bulk import a bunch of files on a per-set basis like I go to the GUI and create a "decrypted" version of the game and copy-paste CMP XML for the 50 files or whatever instead of having to copy individual hashes and filenames for each 000000.app and 0000001.app. We'll see when it gets out.

:D :gba: :clown:

Post Reply