Jump to content


Photo

Changing biffing for megamod


  • Please log in to reply
216 replies to this topic

#61 the bigg

the bigg

    2083 is a prime number.

  • Modder
  • 3331 posts

Posted 01 January 2010 - 12:36 PM

So ... tweaking with minimization?? ^_^ Keep the backups for tweaking, but do some intelligent biffing (patchy files biffed later ... non-patchy stuff gets biffed with megamod)??

Biffing large static files early (TIS/WAV/...) is useful, both because it means that the final gen_biff is faster, and because you don't need gen_biff if you only install BGT. Also, you can't safely tweak your install if anything was deleted (notably, biffing moves the files in a temp folder and creates an archive out of that, thus leaving two copies of the content).

Italian users: help test the Stivan NPC!

Author or Co-Author: WeiDU - Widescreen - Generalized Biffing - Refinements - TB#Tweaks - IWD2Tweaks - TB#Characters - Traify Tool - Some mods that I won't mention in public
Maintainer: Semi-Multi Clerics - Nalia Mod - Nvidia Fix
Code dumps: Detect custom secondary types - Stutter Investigator

If possible, send diffs, translations and other contributions using Git.


#62 Miloch

Miloch

    Barbarian

  • Modder
  • 6579 posts

Posted 01 January 2010 - 02:09 PM

Biffing large static files early (TIS/WAV/...) is useful

I think not for BAMs though, because some early-installed megamods overwrite creature animations and then biff them (NEJ I suspect does this at least). Infinity Animations restores the proper ones, and reorganises the added ones in proper slots, but it's not as simple as overwriting the buggered ones, because the megamods put completely different structures in there (such as weapon overlays) that could really fubar things. So our only solution now is to batch delete the faulty animations from the override, but I'm not sure how or even if that'll work if animations are biffed. Not sure a WeiDU MOVE command will even help with that. I guess we could move/delete the biffs too, assuming there are specific ones for animation BAMs but I doubt there are. I suppose there is something insanely complex patching we could do with the .bif and .key files, but I don't really want to go there. I don't think there's anything like an "UNMAKE/REMAKE_BIFF" in WeiDU either (not that I would want to go there either, but we probably need to do something about this eventually).

Infinity Engine Contributions
Aurora * BG1 NPC * BG1 Fixpack * Haiass * Infinity Animations * Level 1 NPCs * P5Tweaks
PnP Free Action * Thrown Hammers * Unique Containers * BG:EE * BGII:EE * IWD:EE
================================================================
Player & Modder Resources
BAM Batcher * Creature Lister * Creature Checker * Creature Fixer * Tutu/BGT Area Map & List * Tutu Mod List
================================================================
"Infinity turns out to be the opposite of what people say it is. It is not 'that which has nothing beyond itself' that is infinite, but 'that which always has something beyond itself'." -Aristotle


#63 the bigg

the bigg

    2083 is a prime number.

  • Modder
  • 3331 posts

Posted 01 January 2010 - 02:18 PM

I suppose BAMs shouldn't be biffed in that case ;)

Italian users: help test the Stivan NPC!

Author or Co-Author: WeiDU - Widescreen - Generalized Biffing - Refinements - TB#Tweaks - IWD2Tweaks - TB#Characters - Traify Tool - Some mods that I won't mention in public
Maintainer: Semi-Multi Clerics - Nalia Mod - Nvidia Fix
Code dumps: Detect custom secondary types - Stutter Investigator

If possible, send diffs, translations and other contributions using Git.


#64 Lollorian

Lollorian

    smiley addict

  • Member
  • 4150 posts

Posted 02 January 2010 - 12:56 AM

Aye then, no BAM biffing either ^_^ I probably should wait for the 12 days thing to finish but, any idea when IA's gonna be up?? (now that you have extra time cause the download manager's down :lol:)

(and is this forum looking nifty or wot?? ... kinda miss the codeboxes though :crying: ... is it my browser or is the crying simley not showing up?? :o)

Cheers,
Lol

Edited by Lollorian, 02 January 2010 - 12:57 AM.

"I am the smiley addict, yellow and round, this is my grin :D when I'm usually around :P.
When there's trouble brewing, see me post, cuz it's usually a wall o' yellow and your eyes are toast!!!"

BWP GUIDE - BWP FIXES - impFAQ - NPC LIST - KIT LIST - AREA LIST

GitHub Links : BWP Fixpack | Lolfixer | BWP Trimpack | RezMod


#65 Lollorian

Lollorian

    smiley addict

  • Member
  • 4150 posts

Posted 03 January 2010 - 01:46 AM

So here's my part of the deal, all the stuff needed to biff only the stuff that need be biffed :wacko: (unpack and let im run!!!)

Pack contains the .tp2's and .bat's that are changed so that no sto/itm/spl/cre/dlg/bcs/2da/are/eff/ids biffing is done in any mod (all the others get biffed ;))

Oh, and I left bam's in too, it'd be easy to remove them later anyway :P If someone could check the code with the originals, I'd be mighty grateful :D

Cheers,
Lol

EDIT: Ok, I ran it on me test install, and I'd say it did pretty well :P (and I should also mention that SoBH didn't install because it couldn't find _KAGAIJ.DLG?? A Tutu file?? :blinking:)

AND I also found out that the Cleanup.bat given out by the BWP8.2.2 installpack saves backups too :D So no need to use robocopy or anything :P

Anyway, final statistics:

Time elapsed - Don't have the exact time cause I paused the installer when SoBH broke :( But I'd say it took much less than the first one ... some 4-4.5 hrs (a HUGE improvement imho!!! :D)

data - 13.0 GB
override - 737 kB
BGII-SoA - 21.5 GB

So, in summary, I'll say the main gain seems to be time here (apart from the ~1 GB less space too :P)

Cheers,
Lol

Attached Files


Edited by Lollorian, 03 January 2010 - 06:47 AM.

"I am the smiley addict, yellow and round, this is my grin :D when I'm usually around :P.
When there's trouble brewing, see me post, cuz it's usually a wall o' yellow and your eyes are toast!!!"

BWP GUIDE - BWP FIXES - impFAQ - NPC LIST - KIT LIST - AREA LIST

GitHub Links : BWP Fixpack | Lolfixer | BWP Trimpack | RezMod


#66 Lollorian

Lollorian

    smiley addict

  • Member
  • 4150 posts

Posted 10 January 2010 - 07:43 AM

Ok, these are the mods that make a backup of the entire override and chitin.key when installed (some of them are commented out in the .tp2 but I list them for completeness sake :D)

//These still make backups of the override, dialog.tlk & chitin.key

DrizztSaga
BGT
CtB
PlanarSphereMod
SoS
TDD
TS-BP

//These have the backup lines commented out

AzenMod
RevisedBattles
Vault

Btw, Revised Battles has 3 .tp2's within it, ImpBattles.tp2, ImprovedBattles.tp2 and NythrunFiXBGT.tp2 :unsure: What are they used for?? :P

"I am the smiley addict, yellow and round, this is my grin :D when I'm usually around :P.
When there's trouble brewing, see me post, cuz it's usually a wall o' yellow and your eyes are toast!!!"

BWP GUIDE - BWP FIXES - impFAQ - NPC LIST - KIT LIST - AREA LIST

GitHub Links : BWP Fixpack | Lolfixer | BWP Trimpack | RezMod


#67 Lollorian

Lollorian

    smiley addict

  • Member
  • 4150 posts

Posted 11 January 2010 - 06:42 AM

Btw, I was thinking about Helborn's statement that the newer tisunpack/oggdec are faster and overall better than the ones provided with the mods.

So, why not update the tisunpack/oggdecs just like WeiDU?? ^_^ Why not provide the latest versions in the BWPInstall/Fixpack and update all the mod .exe's with the newer versions with these lines in the .bat??

I tried it (using the last modified tisunpack/oggdec in my installs)

tisunpack -> from BGIUB
oggdec -> from Wheels of prophecy

renamed them to tisunpackX and oggdecX, moved them to the BGII-SoA folder and ran this:
FOR /f "tokens=*" %%s IN ('DIR /b /s tisunpack.exe') DO xcopy /y tisunpackX.exe "%%s"
FOR /f "tokens=*" %%s IN ('DIR /b /s oggdec.exe') DO xcopy /y oggdecX.exe "%%s"
Is there a newer version of these .exe's?? I'm gonna start a new install soon :D (I'll note down the time :P)

Btw, there are other .exe's in there, mosunpack, snd2acm, xm2wav, tis2bg2 and acm2wav ... would they need updating too??

Edited by Lollorian, 11 January 2010 - 06:54 AM.

"I am the smiley addict, yellow and round, this is my grin :D when I'm usually around :P.
When there's trouble brewing, see me post, cuz it's usually a wall o' yellow and your eyes are toast!!!"

BWP GUIDE - BWP FIXES - impFAQ - NPC LIST - KIT LIST - AREA LIST

GitHub Links : BWP Fixpack | Lolfixer | BWP Trimpack | RezMod


#68 the bigg

the bigg

    2083 is a prime number.

  • Modder
  • 3331 posts

Posted 11 January 2010 - 06:55 AM

If you're tweaking tisunpack and oggdec, the most important thing to do is ensure that you're using the non-verbose switch (tisunpack is 3x faster if you remember to use said option, for instance).

Italian users: help test the Stivan NPC!

Author or Co-Author: WeiDU - Widescreen - Generalized Biffing - Refinements - TB#Tweaks - IWD2Tweaks - TB#Characters - Traify Tool - Some mods that I won't mention in public
Maintainer: Semi-Multi Clerics - Nalia Mod - Nvidia Fix
Code dumps: Detect custom secondary types - Stutter Investigator

If possible, send diffs, translations and other contributions using Git.


#69 Lollorian

Lollorian

    smiley addict

  • Member
  • 4150 posts

Posted 11 January 2010 - 07:02 AM

I'm sorry :P but I'm rather ignorant on these new utilities and their switches, their usages etc :doh:

Is there some kinda documentation on them??

I've seen these switches though, dunno what they are :lol:

tisunpack -f -s -h -o

//AND

oggdec -w

Edited by Lollorian, 11 January 2010 - 07:05 AM.

"I am the smiley addict, yellow and round, this is my grin :D when I'm usually around :P.
When there's trouble brewing, see me post, cuz it's usually a wall o' yellow and your eyes are toast!!!"

BWP GUIDE - BWP FIXES - impFAQ - NPC LIST - KIT LIST - AREA LIST

GitHub Links : BWP Fixpack | Lolfixer | BWP Trimpack | RezMod


#70 the bigg

the bigg

    2083 is a prime number.

  • Modder
  • 3331 posts

Posted 11 January 2010 - 07:03 AM

run one of:

<programname> -h
<programname> -help
<programname> --help
<programname> -?
<programname> /help
<programname> /h
<programname> /?

Edited by the bigg, 11 January 2010 - 07:04 AM.

Italian users: help test the Stivan NPC!

Author or Co-Author: WeiDU - Widescreen - Generalized Biffing - Refinements - TB#Tweaks - IWD2Tweaks - TB#Characters - Traify Tool - Some mods that I won't mention in public
Maintainer: Semi-Multi Clerics - Nalia Mod - Nvidia Fix
Code dumps: Detect custom secondary types - Stutter Investigator

If possible, send diffs, translations and other contributions using Git.


#71 Lollorian

Lollorian

    smiley addict

  • Member
  • 4150 posts

Posted 11 January 2010 - 07:10 AM

:doh: I'd tried "x /?" and "help x", but they gave me ... stuff :lol: Thanks!

So, tisunpack -s?? or -s -s?? ^_^
and oggdec -q??

Wait ... why does Jan's Extended Quest's oggdec have a -w switch when it doesn't exist?? :o

Edited by Lollorian, 11 January 2010 - 07:19 AM.

"I am the smiley addict, yellow and round, this is my grin :D when I'm usually around :P.
When there's trouble brewing, see me post, cuz it's usually a wall o' yellow and your eyes are toast!!!"

BWP GUIDE - BWP FIXES - impFAQ - NPC LIST - KIT LIST - AREA LIST

GitHub Links : BWP Fixpack | Lolfixer | BWP Trimpack | RezMod


#72 Lollorian

Lollorian

    smiley addict

  • Member
  • 4150 posts

Posted 11 January 2010 - 07:49 AM

Ok, so that means 43 file mods for tisunpack and 112 files for oggdec ^_^ (yeah, it's a sinch :crying:)

I'll try to get the tisunpack stuff up today :P

Btw, is -s or -s -s better for tisunpack? There has to be some sorta trade-off for increased silent-ness :P

Edited by Lollorian, 11 January 2010 - 07:50 AM.

"I am the smiley addict, yellow and round, this is my grin :D when I'm usually around :P.
When there's trouble brewing, see me post, cuz it's usually a wall o' yellow and your eyes are toast!!!"

BWP GUIDE - BWP FIXES - impFAQ - NPC LIST - KIT LIST - AREA LIST

GitHub Links : BWP Fixpack | Lolfixer | BWP Trimpack | RezMod


#73 the bigg

the bigg

    2083 is a prime number.

  • Modder
  • 3331 posts

Posted 11 January 2010 - 08:21 AM

Single -s is as good as -s -s regarding speed, so I'd go with the single -s (just to have slightly more information in the *.debug files). It's just the non-silent behavior that is embarrassingly slow.

Italian users: help test the Stivan NPC!

Author or Co-Author: WeiDU - Widescreen - Generalized Biffing - Refinements - TB#Tweaks - IWD2Tweaks - TB#Characters - Traify Tool - Some mods that I won't mention in public
Maintainer: Semi-Multi Clerics - Nalia Mod - Nvidia Fix
Code dumps: Detect custom secondary types - Stutter Investigator

If possible, send diffs, translations and other contributions using Git.


#74 Lollorian

Lollorian

    smiley addict

  • Member
  • 4150 posts

Posted 11 January 2010 - 11:41 AM

And here she is!!! :D

Man, I can't believe I did that :P All the stuff that needs to be overwritten, have a look :P

So, the biffmeister package now has:
  • Better biffing:
    • The package now biffs only the files that need to be biffed, so that all the other stuff can be biffed after being patched to HELL!!! :devil:
  • Utility updater
    • After unpacking this to your BGII - SoA folder, run the Unpacker_updater.bat to update ALL your tisunpacks and oggdecs to the latest version (included)
  • Safer Cleanup
    • Also provided is the CleanupX.bat, which afaict only works on systems with the windows resource kits installed :P
  • No stupid backups
    • No more backing up the entire override, a humongous dialog.tlk and the chitin.key :D It's common knowledge that once your game's fubared, IT IS FUBARED!!! :lol:

EDIT: Package removed cause of blatantly stupid typos that freakin broke your BWP install!!! :o Sorry for the trouble :doh:

Edited by Lollorian, 12 January 2010 - 05:03 AM.

"I am the smiley addict, yellow and round, this is my grin :D when I'm usually around :P.
When there's trouble brewing, see me post, cuz it's usually a wall o' yellow and your eyes are toast!!!"

BWP GUIDE - BWP FIXES - impFAQ - NPC LIST - KIT LIST - AREA LIST

GitHub Links : BWP Fixpack | Lolfixer | BWP Trimpack | RezMod


#75 Hoppy

Hoppy

    Mage Hunter

  • Member
  • 2107 posts

Posted 11 January 2010 - 12:14 PM

It's common knowledge that once your game's fubared, IT IS FUBARED!!! :lol:[/list][/list]



Not my cup of tea since you can't even try to fix the game after this :P . I would rather fubar my game myself than have Weidu do it (twice) :lol: :whistling:
?May God defend me from my friends; I can defend myself from my enemies.? - Voltaire

"If you think that a size of the mod indicates an amount of bugs that it introduces and their severity you're totally wrong...
Try not to use next time a load of shitty "super-mega-improving-tweaking-revising" small mods that you have installed and try to meet Wulfgar once again."
- King Diamond


Posted Image The Definitive Guide to Trolls

"Finding food and a place to sleep is your own business. I imagine Paul the Cat should have some fun with you, too" - Potencius in The Darkest Day
"You have been warned, little bastard!" -Khelben to a young <CHARNAME>in Check the Bodies
There are those who will snivel, and offer nothing in return except criticism, meanwhile never lifting a finger to do other than to cut other peoples labor down simply for the fact that they lack the capability to put anything of their own together. -erebusant

#76 the bigg

the bigg

    2083 is a prime number.

  • Modder
  • 3331 posts

Posted 11 January 2010 - 12:18 PM

Not my cup of tea since you can't even try to fix the game after this :P . I would rather fubar my game myself than have Weidu do it (twice) :lol: :whistling:

Either do setup-mymod --uninstall or restore your manually created backup. No point in wasting gigabytes of space backing up your override mid-install multiple times (case in point: worldmap).

Italian users: help test the Stivan NPC!

Author or Co-Author: WeiDU - Widescreen - Generalized Biffing - Refinements - TB#Tweaks - IWD2Tweaks - TB#Characters - Traify Tool - Some mods that I won't mention in public
Maintainer: Semi-Multi Clerics - Nalia Mod - Nvidia Fix
Code dumps: Detect custom secondary types - Stutter Investigator

If possible, send diffs, translations and other contributions using Git.


#77 Lollorian

Lollorian

    smiley addict

  • Member
  • 4150 posts

Posted 12 January 2010 - 12:06 AM

It's common knowledge that once your game's fubared, IT IS FUBARED!!! :lol:

Not my cup of tea since you can't even try to fix the game after this :P . I would rather fubar my game myself than have Weidu do it (twice) :lol: :whistling:

Mate, the megamods that backup the override etc are installed pretty early in even the BWPStandard, total reinstalling is much better than uninstalling and then doing the stack thing that WeiDU does :lol:

Now, question time :D What are the latest and greatest and fastest versions of all the unpackers?? I googled, with no results :crying:

Edited by Lollorian, 12 January 2010 - 12:08 AM.

"I am the smiley addict, yellow and round, this is my grin :D when I'm usually around :P.
When there's trouble brewing, see me post, cuz it's usually a wall o' yellow and your eyes are toast!!!"

BWP GUIDE - BWP FIXES - impFAQ - NPC LIST - KIT LIST - AREA LIST

GitHub Links : BWP Fixpack | Lolfixer | BWP Trimpack | RezMod


#78 Lollorian

Lollorian

    smiley addict

  • Member
  • 4150 posts

Posted 12 January 2010 - 05:47 AM

Well, the biff"meister" I attached above turned out to be a disaster :lol: It didn't create BG1ARE.bif (the check for BGT) and suffice to say, that the last install was simply put ... shit :ROFL:

I ran a string search of "FILE_EXISTS ~data" on all the .tp2's and it reveals something ... BPv179 checks for BG1BCS.bif :o

Damn, I'm moving 2 of the .mos's into those 2 bif's (BG1ARE and BG1BCS) ... This should be done then :P

Ok, found a new problem with the older mega's that should be resolved by added this block to all the biffing .bat's ^_^
FOR %%s IN (
.\override\*.baf
.\override\*.d
.\override\*.ogg
.\override\*.tiz
) DO del %%s
Are there any other packaged files that need be deleted??

Edited by Lollorian, 12 January 2010 - 06:16 AM.

"I am the smiley addict, yellow and round, this is my grin :D when I'm usually around :P.
When there's trouble brewing, see me post, cuz it's usually a wall o' yellow and your eyes are toast!!!"

BWP GUIDE - BWP FIXES - impFAQ - NPC LIST - KIT LIST - AREA LIST

GitHub Links : BWP Fixpack | Lolfixer | BWP Trimpack | RezMod


#79 Hoppy

Hoppy

    Mage Hunter

  • Member
  • 2107 posts

Posted 12 January 2010 - 10:50 AM

Well, the biff"meister" I attached above turned out to be a disaster :lol: It didn't create BG1ARE.bif (the check for BGT) and suffice to say, that the last install was simply put ... shit :ROFL:

I ran a string search of "FILE_EXISTS ~data" on all the .tp2's and it reveals something ... BPv179 checks for BG1BCS.bif :o

Damn, I'm moving 2 of the .mos's into those 2 bif's (BG1ARE and BG1BCS) ... This should be done then :P

Ok, found a new problem with the older mega's that should be resolved by added this block to all the biffing .bat's ^_^

FOR %%s IN (
.\override\*.baf
.\override\*.d
.\override\*.ogg
.\override\*.tiz
) DO del %%s
Are there any other packaged files that need be deleted??



Maybe using FILE_EXISTS ~Some signature file from the mod you are checking. Could be an item, area, creature etc and that may help get what you want to achieve.
?May God defend me from my friends; I can defend myself from my enemies.? - Voltaire

"If you think that a size of the mod indicates an amount of bugs that it introduces and their severity you're totally wrong...
Try not to use next time a load of shitty "super-mega-improving-tweaking-revising" small mods that you have installed and try to meet Wulfgar once again."
- King Diamond


Posted Image The Definitive Guide to Trolls

"Finding food and a place to sleep is your own business. I imagine Paul the Cat should have some fun with you, too" - Potencius in The Darkest Day
"You have been warned, little bastard!" -Khelben to a young <CHARNAME>in Check the Bodies
There are those who will snivel, and offer nothing in return except criticism, meanwhile never lifting a finger to do other than to cut other peoples labor down simply for the fact that they lack the capability to put anything of their own together. -erebusant

#80 Lollorian

Lollorian

    smiley addict

  • Member
  • 4150 posts

Posted 12 January 2010 - 10:56 AM

Yeah :D

But that'd mean editing all the .tp2's of many non-biffing/tisunpacking/oggdecing mods, I say we put all the non patchy stuff into those bif's that get checked and leave the patchy stuff in the override (which is what my install is doing right now ^_^)

3:30 hrs in and it's now reached SCSII, with NO errors (except the Rupert Dye merchant thing, which is a typo in the .tp2 :P)

Edited by Lollorian, 12 January 2010 - 10:58 AM.

"I am the smiley addict, yellow and round, this is my grin :D when I'm usually around :P.
When there's trouble brewing, see me post, cuz it's usually a wall o' yellow and your eyes are toast!!!"

BWP GUIDE - BWP FIXES - impFAQ - NPC LIST - KIT LIST - AREA LIST

GitHub Links : BWP Fixpack | Lolfixer | BWP Trimpack | RezMod