The agonizing grind........

Now that 2.0 is in public testing I switched back to looking at the parser. There have been a number of posts about random pieces of compendium data which do not scrape correctly. I decided to investigate these by attempting to scrape every published book and seeing what breaks and why.

Since the compendium feature is a new component of the parser, I never went back and ran serious testing against all the modules I had completed. In fact I've only been using it on material published after Divine Power. Any publication that predates that I parsed using either a purchased pdf or OCR from my purchased printed copy. This means several of the "big" books (PHB, MM, etc) never got the full testing.

That's not say I ran no testing on them, but I typically ran a sampling, because extracting and processing something like the entire Adventurer's vault is a pain. It's even more of a pain when your extraction process is still a bit suspect and you know you're going to have to do it more than once.

Anyhow, I decided to bite the bullet and go through each and every book and note what's broken, what I can fix, and what's beyond my control. I've been going in alphabetical order (for lack of a better system) and I am currently on the Player's Handbook and Player's Handbook 2. Both had issues with certain rituals which I think are fixed. I still need to re-scrape/parse them both and make sure the issue is taken care of and I didn't break anything else along the way.

I'm hopeful that I'll be able to complete the process this week.

Dynamic........

A sample...complete with WoTCs typos:

Paragon;Stoneblessed;Paragon;Powers
Paragon;Turathi Highborn;Paragon;Powers
Paragon;Twilight Guardian;Paragon;Powers
Epic;Fatesinger;Epic;Spells
Epic;Glorious Spirit;Epic;Powers
Epic;Harbinger of Doom;Epic;Powers
Epic;Lorekeeper;Epic;Powers
Epic;Primal Avatar;Epic;Evocations
Epic;Revered One;Epic;Prayers
Dynamic;Aftereffect
Dynamic;First Failed Saving Throw
Dynamic;Virtue of Cunning
Dynamic;Virtue of Valor
Dynamic;Primal Guardian
Dynamic;Primal Predator
Dynamic;Covenant of Wrath
Dynamic;Covenant of Preservation
Dynamic;Censure of Retribution
Dynamic;Censure of Pursuit
Dynamic;Covenant of Perservation
Dynamic;Each Additional Failed Saving Throw
Dynamic;Dragon Magic
Dynamic;Wild Magic
Dynamic;Stalker Spirit
Dynamic;Protector Spirit
Dynamic;Rageblood Vigor
Dynamic;Thaneborn Triumph
Dynamic;Earthstrength
Dynamic;Wildblood
Dynamic;Second Failed Saving Throw
Dynamic;Rageblood vigor

Bug found, bug fixed

So I was looking through the PHB2 and discovered a power that had Aftereffect: followed by.... Aftereffect: The parser was not fond of double dynamic tags. It merged them into a single tag which isn't the desired effect. A little magic involving negation and....

Oh and some debugging found a second double Aftereffect power. The parser should now handle any double dynamic tags correctly now.

Fun with the PHB2 text

Yay for text reference.

Appropriate

I think I have the last few powers parsing correctly...and what's the last power to parse?
I find it fitting that I declare victory after getting "Summon Angel of Victory" to parse correctly.

I need to do a little clean up to the ruleset but everything looks correct.....oh and for the WOTC Genius who thought up the invoker powers....I'm casting Summon Finger....and you can guess which one.

Fun times with the PHB2

First I did some work to parse the prereq for rituals. It needs a little cleaning up but it's functional for now. Next I switched the \r conversion from using paragraph markers to using tabular formatting. It looks a little better.

Next I moved onto one of the big problems...something I call "Granted" powers. The Warden is rife with these, but a few other classes have them as well. Essentially the Warden activates a Wonder Twin power and they get another power. The parser now handles this garbage.


And finally, because it annoyed me.... I went through and rewrote the output routine for powers. Now it maintains the order of items that it parsers. Previous versions always sorted them in a specific order. The powers below go "Hit-Dynamic-Miss" and "Hit-Miss-Dynamic"


Now I just need to get the Invoker summon garbage working.

Moving right along....

I hate some of the new classes. Sorcerer and whichever stupid treehugger class has all the polymorph powers. Anyhow I added support for \r in powers....it'll take more effort to get the silly polymorph powers working correctly.
I got almost everything else in....except for the rituals. I just wasn't up to formatting them tonight.

PHB 2

I began the first pass through the PHB 2 this morning. So far I've finished the races and I'm 6 classes in. There are a few things that will need adjusting, but nothing particularly serious. I expect to have the powers, feats, and probably even the magic items finished today. The backgrounds and text reference will take a bit longer:
Not bad for 2 hours worth of work.