[Research] Famicom Disk System FDS dumps study

General No-Intro related discussions.
Post Reply
root
Site Admin
Posts: 738
Joined: 19 May 2008 09:26

[Research] Famicom Disk System FDS dumps study

Post by root »

Rif: 918 [Research] Famicom Disk System FDS dumps study \ Yakushi~Kabuto on 31st October 2006, 19:04 wrote:

There is a huge flaw with the fds format.
Important bytes, GAP data and crc checksum, are missing from all existing dumps.
This is a flaw (or intended?) in copiers, conversion utility, or driver softwares. I don't know the details about how these bytes are skipped but this means no perfect dump of a FDS disk will exist as long as a new method to dump the disks properly is conceived.

I just wanted you all to be informed. No FDS dump can be called perfect. And accurate emulation can't be achieved as long as these bytes are missing.

===============================================

Re: Famicom Disk System discussion \ Yuki on 31st October 2006, 21:07 wrote:

Is there a title that doesn't operate correctly by FDS?
It is not at all realistic to assume that new Format was made, and to do all ReDump of FDS. :|

I think that obtaining FDS is difficult if it is not Japan perhaps.
And, it doesn't like to offer it to us though many of Japanese who do Dump boast of the file that does Dump.
I have seen such a lot of Japanese.
Anger to it makes me face a lot of FDSDump. :(

===============================================

Re: Famicom Disk System discussion \ Yakushi~Kabuto on 5th November 2006, 14:13 wrote:

was my post so technical that no one understood it :?

===============================================

Re: Famicom Disk System FDS dumps study \ Yakushi~Kabuto on 4th February 2007, 17:25 wrote:

Here is a little study of the differences in the save area between
-bad dump / used disk
-save cleaned
-good dump / sealed disk

Conclusions
-bad dump / used disk has 13 wrong bytes
-save cleaned has 3 wrong bytes (10 corrected properly)

This little study illustrates perfectly that the No-Intro cleaned dump was more accurate to the good dump than the original bad dump. However, cleaning doesn't make good dumps, and redump is still needed.

===============================================

Re: Famicom Disk System FDS dumps study \ Yakushi~Kabuto on 25th March 2007, 15:43 wrote:

It came to my attention that some FDS disks are protected against copy.
Here is how the protection does work from the infos I could gather:

All FDS disks have their own size written on the header.
In the protected FDS disk, the size written on the header is wrong (smaller than it really is).
So when the FDS copier does a backup, it misses a few DUMMY bytes at the end of the disk.

When the disk is loaded, it changes temporarily the header to indicate the correct size. It then scans the disk in an attempt to find the DUMMY data. If it can not be found, then the disk is considered as an illegal copy and it will display an anti-piracy message.

here is the difference between a "normal dump" (missing data) and a "protected dump" (with dummy data included).

However, the problem is the real disk should display a wrong size.
The current FDS copiers are fixing the size in headers, so they are likely HACKED DUMPS.

I'm waiting for a confirmation from some NES devcs, but it is likely all protected disk will need to have their header reverted in the next dat.

===============================================

Re: Famicom Disk System FDS dumps study \ Skrybe on 30th May 2007, 18:20 wrote:

I see where a sealed disk redump would be needed for games that save to the disk, but what about games that don't, like most unlicensed disks?

I ask because I have a friend who has a copy of the undumped Disk Keeper program, and an FDS copier. His copy of Disk Keeper isn't new, though, nor is it an original disk. It's a bootleg copy he bought in an auction. Would you accept a dump of that copy as a "good" dump, even though it's not a sealed disk dump?

===============================================

Re: Famicom Disk System FDS dumps study \ Yakushi~Kabuto on 30th May 2007, 21:24 wrote:
I see where a sealed disk redump would be needed for games that save to the disk, but what about games that don't, like most unlicensed disks?

I ask because I have a friend who has a copy of the undumped Disk Keeper program, and an FDS copier. His copy of Disk Keeper isn't new, though, nor is it an original disk. It's a bootleg copy he bought in an auction. Would you accept a dump of that copy as a "good" dump, even though it's not a sealed disk dump?
Unlicencied usually don't write back into the disk AFAIK. So yes we would gladly accept it if it's undumped and documented enough (shots), however its dump status would be "UNCONFIRMED".

===============================================

Re: Famicom Disk System FDS dumps study \ Skrybe on 31st May 2007, 23:49 wrote:

What do you require for a "confirmed" dump, then?

===============================================

Re: Famicom Disk System FDS dumps study \ KingHanco on 2nd June 2007, 20:06 wrote:

I will be glad this will be straighten out soon. I just hated to know all those aren't good dumps.

===============================================

Re: [Research] Famicom Disk System FDS dumps study \ Tidegear on 19th July 2007, 23:14 wrote:

Is there a way to slip the crc checksum and gap data into an FDS file and still have it be readable by most emulators/programs? Maybe at the end of the file? Or will the FDS format need to be totally restructured requiring emulators/programs to be updated in order to read them?

Automerged Doublepost.

Sorry to bug you here, Yakushi~Kabuto but I think there's something wrong with the PM system. I responded to your PM and it didn't show up in the sent box, nor did I receive any response from you even after a couple days. I tried sending a couple follow-up PMS but they didn't show in my sent box either. I'm hoping you got them and just haven't had time to respond yet. If not is there a better way to reach you about the Knight Move dump?

===============================================

Re: [Research] Famicom Disk System FDS dumps study \ Manowar on 24th July 2007, 12:08 wrote:

The work done here on the FDS system is wonderful. I think the FDS is a great system that needs to be documented properly (which it is), along with the great dumping capabilities being put forward here!
You do not have the required permissions to view the files attached to this post.
User avatar
BigFred
High Council
Posts: 1261
Joined: 22 May 2008 22:42

Re: [Research] Famicom Disk System FDS dumps study

Post by BigFred »

To feed this discussion a bit I went and ripped the Super Mario Bros. 2 image from the WII VC release which is the first time we have access to a (probably) true FDS-image. Here is the result: Our current dump's size in the dat is 65500 bytes. The ripped one is 65536 bytes, a logical size we'd expect for a correct dump.

Before each data block there are 2 bytes "0000" and after each block again 2 bytes "0000". As it was discussed in other places before there is missing gap data before a block and missing crc16 (2 bytes value) -data after a block which appears to be true according to this Wii rip. Now in this case all those values are 00 but obviously this doesn't have to be true for all images.

I filled the current FDS-image with the zero-bytes accordingly and it almost matches the ripped image but 3 bytes don't which means we probably have a bad dump here too.

Edit: Attachments removed
relax
High Council
Posts: 938
Joined: 27 May 2008 17:52

Re: [Research] Famicom Disk System FDS dumps study

Post by relax »

Interesting find! I extracted some more FDS images from VC-releases for you. ;)

Ice Hockey (Japan) (VC).fds
Zelda no Densetsu - The Hyrule Fantasy (Japan) (VC).fds
Legend of Zelda 2, The - Link no Bouken (Japan) (VC).fds
relax
High Council
Posts: 938
Joined: 27 May 2008 17:52

Re: [Research] Famicom Disk System FDS dumps study

Post by relax »

I found one more FDS from a VC-release.

Akumajou Dracula (Japan) (VC).fds

I also checked Xevious thinking it might be in FDS-format, but it was in NES-format. Anyway, the NES-ROM matched Xevious 1.1 in the undumped list (ROM CRC A2469526). :o

Are these VC-releases dumped? They might be in FDS-format.

Esper Dream
Hikari Shinwa: Palutena no Kagami
Nazo no Murasamej?
Smash Ping Pong
Tantei Jing?ji Sabur?: Shinjuku Ch?? K?en Satsujin Jiken
Volleyball
User avatar
xuom2
High Council
Posts: 910
Joined: 22 May 2008 18:45

Re: [Research] Famicom Disk System FDS dumps study

Post by xuom2 »

only Nazo.no.Murasame.JPN.VC.Wii-OneUp
relax
High Council
Posts: 938
Joined: 27 May 2008 17:52

Re: [Research] Famicom Disk System FDS dumps study

Post by relax »

xuom2 wrote:only Nazo.no.Murasame.JPN.VC.Wii-OneUp
Thanks, it's not in FDS-format.
User avatar
BigFred
High Council
Posts: 1261
Joined: 22 May 2008 22:42

Re: [Research] Famicom Disk System FDS dumps study

Post by BigFred »

Thanks a lot for these files! Strange enough they are pretty much different from what we got. Might require more study.
User avatar
BigFred
High Council
Posts: 1261
Joined: 22 May 2008 22:42

Re: [Research] Famicom Disk System FDS dumps study

Post by BigFred »

It looks like a lot of releases have been changed from their cart version - I stumbled about a changed built of SMB3 japan for instance - so we can't say anything about the integrity of available dumps.
kiddocabbusses
Posts: 153
Joined: 25 May 2008 17:48

Re: [Research] Famicom Disk System FDS dumps study

Post by kiddocabbusses »

relax wrote:
xuom2 wrote:only Nazo.no.Murasame.JPN.VC.Wii-OneUp
Thanks, it's not in FDS-format.
What ROM format is it? IIRC the original Nazo no Murasamejo was only on FDS, so an NES format ROM would be kinda strange.
relax
High Council
Posts: 938
Joined: 27 May 2008 17:52

Re: [Research] Famicom Disk System FDS dumps study

Post by relax »

kiddocabbusses wrote:
relax wrote:
xuom2 wrote:only Nazo.no.Murasame.JPN.VC.Wii-OneUp
Thanks, it's not in FDS-format.
What ROM format is it? IIRC the original Nazo no Murasamejo was only on FDS, so an NES format ROM would be kinda strange.
I'm not sure, it didn't look like a normal NES ROM neither. Sorry for the late reply.

One more FDS Virtual Console has been released:

Hikari Shinwa - Parthenon no Kagami (Japan) (VC).fds
relax
High Council
Posts: 938
Joined: 27 May 2008 17:52

Re: [Research] Famicom Disk System FDS dumps study

Post by relax »

One more found. :)

Volleyball (Japan) (VC).fds


Virtual Console missing FDS:

Esper Dream
Smash Ping Pong
Tantei Jinguuji Saburou - Shinjuku Chuuou Kouen Satsujin Jiken

Virtual Console most wanted FC:

Elevator Action (Japan)
Mighty Bomb Jack (Japan)
relax
High Council
Posts: 938
Joined: 27 May 2008 17:52

Re: [Research] Famicom Disk System FDS dumps study

Post by relax »

Three more found inside WADs, including Metroid v1.3, which was not known to exist. 8-)

Bio Miracle Bokutte Upa (Japan) (VC).fds
Famicom Tantei Club - Kieta Kokeisha (Japan) (VC).fds
Metroid (Japan) (v1.3) (VC).fds
User avatar
Connie
Datter
Posts: 218
Joined: 20 Jun 2008 12:15

Re: [Research] Famicom Disk System FDS dumps study

Post by Connie »

Nice Work! :D

I'm a bit out of touch with FDS now because I've been so busy and just blindly grabbing updates for the latest dats, so:

1) Am I still right in understanding that these VC extracted dumps are a 'pure/clean' dump, i.e. a full 524288 bytes per side (IIRC, the padding - usually 2 bytes) was at the beginning/end of a 'file' which was missed by the dumper as a sort of copy protection?

2) They will be unplayable by existing PC emulators because the dump is unrecognisable since it has a file table that doesn't match it's file contents? - copy protection only?

3) How are they being dealt with for the dat - do we need to figure out how to 'pad' existing dumps and fix the file counts/FAT? I know BF had a play with a 'mario' dump a while back (...if you know what dump refers to in England, it may be funny), but don't know the outcome.

Please fill me in. :gba:
relax
High Council
Posts: 938
Joined: 27 May 2008 17:52

Re: [Research] Famicom Disk System FDS dumps study

Post by relax »

Yes, these extracted fds-images are believed to be pure. Please read the first post of this thread for more info about what's missing from current dumps

Yes, they are unplayable by existing emulators.

No-Intro usually doesn't add extracted images to the offcial dats, but I could make a custom dat for them.
User avatar
BigFred
High Council
Posts: 1261
Joined: 22 May 2008 22:42

Re: [Research] Famicom Disk System FDS dumps study

Post by BigFred »

many VC releases have been altered from the regular release (many NES and SNES games!) and there are also some N64 titles with versions that are unfound yet despite intensive search was done. It is not definite that all versions you find as VC also exist on real carts.
Post Reply